52 spark data engineer jobs at 31 companies in Devon, PA

1mo
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNYSE: BMY: Develops and manufactures innovative prescription biopharmaceutical medicines.
5+ YOE5+ years data engineering experience with Databricks, cloud-native data platforms, Python/SQL/Spark, GenAI/LLM experience, data pipeline and governance expertise for clinical/cross-study data.
Generative AI, Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, vector embeddings
1mo
Save
Mark Applied
Hide
Principal Data Engineer
Philadelphia, Pennsylvania, United States
HybridFull Time
Medical Guardian
Medical Guardian: Provides medical alert systems and emergency monitoring for seniors.
10+ YOE3+ Mgmt10+ years in data or software engineering, 7+ years building production data pipelines, strong Databricks/Spark/PySpark/SQL experience, Azure and streaming expertise, plus leadership and production operations experience.
Databricks, PySpark, Spark SQL, Spark, Python, SQL, Delta Lake, Databricks Workflows, CI/CD, Azure, Azure Event Hubs, Azure Stream Analytics, Azure Service Bus, Azure Data Factory, Azure Functions, ADLS, Azure Cosmos DB, Event Grid
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
Susquehanna International Group
Susquehanna International Group: Global quantitative trading firm providing proprietary financial market liquidity.
5+ YOE5+ years data engineering experience in large-scale distributed processing; strong Python; experience with Spark/Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka; capital markets domain experience.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteFull Time
Susquehanna International Group
Susquehanna International Group: Global quantitative trading firm specializing in proprietary financial markets.
5+ YOE5+ years data engineering experience, capital markets domain knowledge, strong Python skills, experience with Spark/Databricks/Trino/Snowflake/Kafka and large-scale batch/stream processing, ability to support off-hours/weekend needs.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
1mo
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNew York Stock Exchange: BMY: Develops and distributes innovative medicines for serious diseases.
5+ YOE5+ years data engineering experience with cloud platforms, Databricks (Delta Lake, Unity Catalog), Python, SQL, Spark/PySpark, GenAI/LLM (RAG, embeddings), and building production-grade ETL/ELT pipelines and data products.
Generative AI (GenAI), Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, LLM
2mo
Save
Mark Applied
Hide
Data Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
Perpay
Perpay: Financial platform offering interest-free shopping and credit building via payroll.
2+ YOEMinimum 2 years of production data engineering experience; proficient in Python and SQL; experience with AWS, Redshift, ETL tools; able to design data pipelines and collaborate across teams.
AWS, Redshift, Glue, Fivetran, Airflow, ECS, DMS, DataHub, Terraform, Python, SQL, Spark
2w
Save
Mark Applied
Hide
Data Engineer
Lititz, Pennsylvania, United States
OnsiteFull Time
TAIT
TAIT: Designs and manufactures staging, automation, and show control systems.
7+ YOE7+ years data engineering experience delivering Databricks on AWS solutions; strong SQL and Python/PySpark; experience with data pipelines, lakehouse patterns, governance, CI/CD, and production support.
Databricks, AWS, S3, IAM, KMS, VPC, Secrets Manager, CloudWatch, Delta Lake, Spark, SQL, Python, PySpark, Git, CI/CD, Power BI, Unity Catalog, MuleSoft, Salesforce, Epicor, Kantata
5d
Save
Mark Applied
Hide
Security Data Solutions Engineer
Quincy or Princeton or Irvine or Boston or Austin or Sacramento
$120k-$203k/yr HybridFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
8+ YOEDesign and implement enterprise security telemetry and data products; 8+ years in cybersecurity/data engineering; strong Python, SQL, Spark, Databricks, Snowflake, SIEM experience; product management skills.
Splunk, Microsoft Sentinel, QRadar, Elastic, Chronicle, Databricks, Snowflake, Kafka, Spark, Cribl, OpenTelemetry, FluentBit, Python, SQL, AWS, Azure, Google Cloud
2mo
Save
Mark Applied
Hide
Data Engineer
Princeton, New Jersey, United States
$100k-$120k/yr HybridFull Time
CURE Auto Insurance
CURE Auto Insurance: Provides automobile insurance based primarily on individual driving records.
3+ YOEDesign, build, and maintain data pipelines; integrate core insurance data; ensure data quality and governance; develop data lake/warehouse.
Python, SQL, Snowflake, BigQuery, Redshift, Databricks, Spark, dbt, Great Expectations, Kafka, Kinesis, Debezium, Fivetran, HVR
2w
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia, Pennsylvania, United States
$68k-$153k/yr OnsiteFull Time
Universal Music Group
Universal Music GroupEuronext Amsterdam: UMG: Global music recording, publishing, merchandising, and content production.
5+ YOE5+ years data engineering experience building scalable pipelines, ecommerce/Shopify data expertise, strong SQL and Python, cloud and modern data platform experience, semantic layer and AI/ML data readiness skills.
Shopify, dbt, LookML, Spark, Snowflake, Databricks, BigQuery, Redshift, Parquet, SQL, Python, AWS, Azure, GCP
2w
Save
Mark Applied
Hide
Lead Data Engineer
Wilmington or McLean
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, 1+ year cloud experience, proficiency in Java/Scala/Python and data engineering tools.
Java, Scala, Python, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, AWS, Microsoft Azure, Google Cloud, SQL
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
Austin or Chicago or New Hartford or Philadelphia
$130k-$144k/yr RemoteFull Time
PAR Technology
PAR TechnologyNYSE: PAR: Provides unified software and hardware for restaurant operations.
5+ YOE5+ years data engineering; project leadership; strong problem-solving; excellent communication; continuous learning; experience with AI/LLM tooling.
Python, SQL, Terraform, Spark, Databricks, Structured Streaming, Postgres, DynamoDB, CircleCI, DroneCI, Github Actions, Spacelift, DataDog, AWS, Azure, data governance, AI/ML integration, Claude Code, Cursor, Copilot, MCP, Agent Orchestrators, Git, Github
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia or Aurora or King of Prussia
$82k-$172k/yr OnsiteFull Time
CACI
CACINYSE: CACI: Provides information technology and professional services to government clients.
5+ YOE5+ years in data engineering/science with TS/SCI clearance; BS in data science/CS; experience building data pipelines and using Python data libraries; experience with git.
Python, NumPy, Pandas, Polars, Git, Docker, Docker Compose, AWS, Spark, PySpark, Linux, CUDA
3w
Save
Mark Applied
Hide
Senior Data Engineer
Newark, Delaware, United States
$140k-$150k/yr RemoteFull Time
Horizon Services
Horizon Services: Provides residential HVAC, plumbing, and electrical repair services.
8+ YOEBachelor's or master's in CS/statistics/analytics, 8+ years data engineering, 5+ years cloud (preferably AWS), strong SQL, Databricks, Snowflake, Python/PySpark, Kafka experience preferred.
Databricks, Spark, Confluent Kafka, Snowflake, AWS, SQL, Python, PySpark, Microsoft Power BI
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
Susquehanna International Group
Susquehanna International Group: Global quantitative trading and market making firm.
5+ YOE5+ years in data engineering with strong Python and experience with modern data platforms (Spark, Databricks, Trino, Iceberg, Snowflake, Kafka); capital markets/financial services experience required.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
2w
Save
Mark Applied
Hide
Hadoop PySpark Data Engineer
Charlotte or Jersey City or Newark or Plano
$82k-$127k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Hadoop ecosystem (Cloudera), PySpark, Spark, Hive, Python, Unix shell scripting, Autosys/Airflow, SQL; Bachelor\u0002s or equivalent experience; ability to work across SDLC and travel/relocate as needed.
Hadoop, Cloudera, PySpark, Spark, Hive, Python, Unix shell scripting, Autosys, Airflow, SQL, Tableau
2mo
Save
Mark Applied
Hide
AVP, Lead Data Engineer
Philadelphia or Jersey City or Simsbury
$153k-$221k/yr OnsiteFull Time
Chubb
ChubbNYSE: CB: Provides property, casualty, and life insurance and reinsurance services globally.
12+ YOEBachelor's degree required; 12+ years data engineering with ETL/ELT, data warehouse design, and automated pipelines. Expertise in Informatica/IICS, Azure (Synapse, ADF, Databricks), Snowflake, Databricks, Autosys, Python/Shell. Must be based in NJ or Greater Philadelphia.
Informatica, IICS, Azure, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks, Delta Lake, Spark, Snowflake, Snowpark, Autosys, Python, Shell
2mo
Save
Mark Applied
Hide
Senior Data Engineer
King of Prussia or Aurora
$82k-$172k/yr OnsiteFull Time
CACI International
CACI InternationalNYSE: CACI: Provides information technology and engineering services for government agencies.
5+ YOEActive TS/SCI clearance, B.S. in Data Science/AI/CS or related, 5+ years experience, building data pipelines using Python (NumPy, Pandas, Polars), version control (git/GitLab/Bitbucket), and contributing to AI/ML solutions.
NumPy, Pandas, Polars, Python, git, GitLab, Bitbucket, Docker, Docker Compose, AWS, Spark, PySpark, Gymnasium, OpenEnv, TorchRL, RLlib, Stable Baselines, LangFuse, MLFlow, Arize Phoenix, HuggingFace, LangChain, Linux, EC2, S3, Lambda, Bedrock, Java, C++, Rust, Go, C#, CUDA, Podman, Kubernetes, Rancher
3mo
Save
Mark Applied
Hide
Data Engineer (Philadelphia, PA, US, 19103)
Philadelphia, Pennsylvania, United States
$120k-$150k/yr HybridFull Time
Aramark
AramarkNYSE: ARMK: Provides food and facility management services to diverse organizations.
7+ YOE7+ years in data domain with Python, SQL, Azure/AWS, ETL/ELT, data modeling, Spark, real-time streaming, CI/CD; BS/MS in CS or equivalent experience.
Python, SQL, Azure, AWS, ETL/ELT, Data modeling, Apache Spark, Real-time streaming, CI/CD
1mo
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
NBME
NBME: Develops and manages medical licensing and healthcare professional assessments.
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
AWS, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS step functions, Luigi, Pinecone, Milvus, pgvector, Git, CI/CD, Feature Stores, Vector Databases, APIs, MLOps