54 spark data engineer jobs at 33 companies in Wayne, PA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
1w
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNYSE: BMY: Develops and manufactures innovative prescription biopharmaceutical medicines.
5+ YOE5+ years data engineering experience with Databricks, cloud-native data platforms, Python/SQL/Spark, GenAI/LLM experience, data pipeline and governance expertise for clinical/cross-study data.
Generative AI, Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, vector embeddings
1w
Save
Mark Applied
Hide
Principal Data Engineer
Philadelphia, Pennsylvania, United States
HybridFull Time
Medical Guardian
Medical Guardian: Provides medical alert systems and emergency monitoring for seniors.
10+ YOE3+ Mgmt10+ years in data or software engineering, 7+ years building production data pipelines, strong Databricks/Spark/PySpark/SQL experience, Azure and streaming expertise, plus leadership and production operations experience.
Databricks, PySpark, Spark SQL, Spark, Python, SQL, Delta Lake, Databricks Workflows, CI/CD, Azure, Azure Event Hubs, Azure Stream Analytics, Azure Service Bus, Azure Data Factory, Azure Functions, ADLS, Azure Cosmos DB, Event Grid
1w
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
Susquehanna International Group
Susquehanna International Group: Global quantitative trading firm providing proprietary financial market liquidity.
5+ YOE5+ years data engineering experience in large-scale distributed processing; strong Python; experience with Spark/Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka; capital markets domain experience.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
1w
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteFull Time
Susquehanna International Group
Susquehanna International Group: Global quantitative trading firm specializing in proprietary financial markets.
5+ YOE5+ years data engineering experience, capital markets domain knowledge, strong Python skills, experience with Spark/Databricks/Trino/Snowflake/Kafka and large-scale batch/stream processing, ability to support off-hours/weekend needs.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
1w
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNew York Stock Exchange: BMY: Develops and distributes innovative medicines for serious diseases.
5+ YOE5+ years data engineering experience with cloud platforms, Databricks (Delta Lake, Unity Catalog), Python, SQL, Spark/PySpark, GenAI/LLM (RAG, embeddings), and building production-grade ETL/ELT pipelines and data products.
Generative AI (GenAI), Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, LLM
1mo
Save
Mark Applied
Hide
Associate Data Engineer
Ambler, Pennsylvania, United States
$70k-$90k/yr HybridFull Time
Phenom
Phenom: AI-powered talent experience platform for recruiting and retention.
Bachelor's degree in Data Science/CS/Information Systems, exposure to Python or Java, SQL knowledge, interest in data engineering, semantic technologies and data modeling; familiarity with Airflow or Spark is a plus; candidates must reside within 50 miles of Ambler, PA.
Python, Java, SQL, Airflow, Spark
2mo
Save
Mark Applied
Hide
Data Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
Perpay
Perpay: Financial platform offering interest-free shopping and credit building via payroll.
2+ YOEMinimum 2 years of production data engineering experience; proficient in Python and SQL; experience with AWS, Redshift, ETL tools; able to design data pipelines and collaborate across teams.
AWS, Redshift, Glue, Fivetran, Airflow, ECS, DMS, DataHub, Terraform, Python, SQL, Spark
1mo
Save
Mark Applied
Hide
Associate Data Engineer
Ambler, Pennsylvania, United States
$70k-$90k/yr HybridFull Time
Phenom
Phenom: AI-powered talent experience platform for hiring and retaining talent.
Bachelor's degree in CS/Info Systems/Data Science, exposure to Python or Java, SQL knowledge, familiarity with Airflow or Spark preferred, strong analytical and problem-solving skills; hybrid role based in Ambler, PA; employer will not sponsor visas.
Python, Java, SQL, Airflow, Spark
2mo
Save
Mark Applied
Hide
Data Engineer
Princeton, New Jersey, United States
$100k-$120k/yr HybridFull Time
CURE Auto Insurance
CURE Auto Insurance: Provides automobile insurance based primarily on individual driving records.
3+ YOEDesign, build, and maintain data pipelines; integrate core insurance data; ensure data quality and governance; develop data lake/warehouse.
Python, SQL, Snowflake, BigQuery, Redshift, Databricks, Spark, dbt, Great Expectations, Kafka, Kinesis, Debezium, Fivetran, HVR
1mo
Save
Mark Applied
Hide
Associate Data Engineer
Ambler, Pennsylvania, United States
$70k-$90k/yr HybridFull Time
Phenom
Phenom: AI-powered software platform for talent acquisition and management.
Bachelor's degree in Data Science/Computer Science/Information Systems, exposure to Python or Java, SQL knowledge, interest in data modeling/semantic technologies, coursework or projects in data engineering; recent graduates encouraged.
Python, Java, SQL, Airflow, Spark
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
Austin or Chicago or New Hartford or Philadelphia
$130k-$144k/yr RemoteFull Time
PAR Technology
PAR TechnologyNYSE: PAR: Provides unified software and hardware for restaurant operations.
5+ YOE5+ years data engineering; project leadership; strong problem-solving; excellent communication; continuous learning; experience with AI/LLM tooling.
Python, SQL, Terraform, Spark, Databricks, Structured Streaming, Postgres, DynamoDB, CircleCI, DroneCI, Github Actions, Spacelift, DataDog, AWS, Azure, data governance, AI/ML integration, Claude Code, Cursor, Copilot, MCP, Agent Orchestrators, Git, Github
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia or Aurora or King of Prussia
$82k-$172k/yr OnsiteFull Time
CACI
CACINYSE: CACI: Provides information technology and professional services to government clients.
5+ YOE5+ years in data engineering/science with TS/SCI clearance; BS in data science/CS; experience building data pipelines and using Python data libraries; experience with git.
Python, NumPy, Pandas, Polars, Git, Docker, Docker Compose, AWS, Spark, PySpark, Linux, CUDA
1w
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
Susquehanna International Group
Susquehanna International Group: Global quantitative trading and market making firm.
5+ YOE5+ years in data engineering with strong Python and experience with modern data platforms (Spark, Databricks, Trino, Iceberg, Snowflake, Kafka); capital markets/financial services experience required.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
4d
Save
Mark Applied
Hide
Senior Data Engineer
Newark, Delaware, United States
$140k-$150k/yr RemoteFull Time
Horizon Services
Horizon Services: Provides residential HVAC, plumbing, and electrical repair services.
8+ YOEBachelor's or master's in CS/statistics/analytics, 8+ years data engineering, 5+ years cloud (preferably AWS), strong SQL, Databricks, Snowflake, Python/PySpark, Kafka experience preferred.
Databricks, Spark, Confluent Kafka, Snowflake, AWS, SQL, Python, PySpark, Microsoft Power BI
1mo
Save
Mark Applied
Hide
AI Data Engineer
Princeton or Arizona or California or Colorado or Delaware or Florida or Georgia or Illinois or Indiana or Massachusetts or Maryland or Minnesota or North Carolina or New Jersey or New York or Pennsylvania or Tennessee or Texas or Utah or Virginia or United States or United Kingdom or North America or Asia or Australia or Europe
HybridFull Time, Contract
FDM Group
FDM GroupLondon Stock Exchange: FDM: Provides IT consulting, technical training, and staff augmentation services.
3+ YOE3+ years in data engineering, software engineering, or full stack development; strong Java or Python skills; experience building data pipelines/backend services; exposure to AI/ML; experience with AWS, Azure, or GCP.
Java, Python, AWS, Azure, GCP, React, Node.js, Spark, Databricks, APIs, CI/CD
1mo
Save
Mark Applied
Hide
AVP, Lead Data Engineer
Philadelphia or Jersey City or Simsbury
$153k-$221k/yr OnsiteFull Time
Chubb
ChubbNYSE: CB: Provides property, casualty, and life insurance and reinsurance services globally.
12+ YOEBachelor's degree required; 12+ years data engineering with ETL/ELT, data warehouse design, and automated pipelines. Expertise in Informatica/IICS, Azure (Synapse, ADF, Databricks), Snowflake, Databricks, Autosys, Python/Shell. Must be based in NJ or Greater Philadelphia.
Informatica, IICS, Azure, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks, Delta Lake, Spark, Snowflake, Snowpark, Autosys, Python, Shell
1mo
Save
Mark Applied
Hide
Senior Data Engineer
King of Prussia or Aurora
$82k-$172k/yr OnsiteFull Time
CACI International
CACI InternationalNYSE: CACI: Provides information technology and engineering services for government agencies.
5+ YOEActive TS/SCI clearance, B.S. in Data Science/AI/CS or related, 5+ years experience, building data pipelines using Python (NumPy, Pandas, Polars), version control (git/GitLab/Bitbucket), and contributing to AI/ML solutions.
NumPy, Pandas, Polars, Python, git, GitLab, Bitbucket, Docker, Docker Compose, AWS, Spark, PySpark, Gymnasium, OpenEnv, TorchRL, RLlib, Stable Baselines, LangFuse, MLFlow, Arize Phoenix, HuggingFace, LangChain, Linux, EC2, S3, Lambda, Bedrock, Java, C++, Rust, Go, C#, CUDA, Podman, Kubernetes, Rancher
2mo
Save
Mark Applied
Hide
Data Engineer (Philadelphia, PA, US, 19103)
Philadelphia, Pennsylvania, United States
$120k-$150k/yr HybridFull Time
Aramark
AramarkNYSE: ARMK: Provides food and facility management services to diverse organizations.
7+ YOE7+ years in data domain with Python, SQL, Azure/AWS, ETL/ELT, data modeling, Spark, real-time streaming, CI/CD; BS/MS in CS or equivalent experience.
Python, SQL, Azure, AWS, ETL/ELT, Data modeling, Apache Spark, Real-time streaming, CI/CD
2w
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
NBME
NBME: Develops and manages medical licensing and healthcare professional assessments.
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
AWS, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS step functions, Luigi, Pinecone, Milvus, pgvector, Git, CI/CD, Feature Stores, Vector Databases, APIs, MLOps
3w
Save
Mark Applied
Hide
Lead Data Engineer (Bank Tech)
New York City or Wilmington
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, ≥4 years application development, ≥2 years big data technologies, ≥1 year cloud (AWS/Azure/GCP); preferred: 7+ yrs app dev, cloud and distributed systems, streaming, NoSQL, data warehousing, UNIX/Linux, Agile.
Java, Scala, Python, SQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, AWS, Microsoft Azure, Google Cloud