67 spark data engineer jobs at 48 companies in Yardley, PA
2d
Save
Mark Applied
Hide
Data Engineer
Whippany or New Jersey
$100k-$135k/yr HybridFull Time
6+ YOE6+ years experience, strong SQL, Python and Spark; Python expertise mandatory; hands-on AWS and/or Databricks; experience with cloud data platforms (AWS/Azure); knowledge of data modeling, governance, and metadata.
SQL, Python, Spark, AWS, Databricks, Azure
1mo
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience with Databricks, cloud-native data platforms, Python/SQL/Spark, GenAI/LLM experience, data pipeline and governance expertise for clinical/cross-study data.
Generative AI, Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, vector embeddings
1mo
Save
Mark Applied
Hide
Principal Data Engineer
Philadelphia, Pennsylvania, United States
HybridFull Time
10+ YOE3+ Mgmt10+ years in data or software engineering, 7+ years building production data pipelines, strong Databricks/Spark/PySpark/SQL experience, Azure and streaming expertise, plus leadership and production operations experience.
Databricks, PySpark, Spark SQL, Spark, Python, SQL, Delta Lake, Databricks Workflows, CI/CD, Azure, Azure Event Hubs, Azure Stream Analytics, Azure Service Bus, Azure Data Factory, Azure Functions, ADLS, Azure Cosmos DB, Event Grid
4w
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
5+ YOE5+ years data engineering experience in large-scale distributed processing; strong Python; experience with Spark/Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka; capital markets domain experience.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
4w
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteFull Time
5+ YOE5+ years data engineering experience, capital markets domain knowledge, strong Python skills, experience with Spark/Databricks/Trino/Snowflake/Kafka and large-scale batch/stream processing, ability to support off-hours/weekend needs.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
1mo
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience with cloud platforms, Databricks (Delta Lake, Unity Catalog), Python, SQL, Spark/PySpark, GenAI/LLM (RAG, embeddings), and building production-grade ETL/ELT pipelines and data products.
Generative AI (GenAI), Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, LLM
1mo
Save
Mark Applied
Hide
Data Engineer - AVP
Whippany, New Jersey, United States
$190k-$195k/yr OnsiteFull Time
Experience building Java-based data pipelines, data warehouses and lakes; strong skills in Java, Spark, Kafka, Kubernetes, OAuth2/JWT, JUnit, Mockito, GitLab/Bitbucket; experience leading technical teams and ensuring data governance and observability.
Java, Spark, Kafka, Kubernetes, OAuth2, JWT, JUnit, Mockito, GitLab, Bitbucket
23h
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
2mo
Save
Mark Applied
Hide
Data Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
2+ YOEMinimum 2 years of production data engineering experience; proficient in Python and SQL; experience with AWS, Redshift, ETL tools; able to design data pipelines and collaborate across teams.
AWS, Redshift, Glue, Fivetran, Airflow, ECS, DMS, DataHub, Terraform, Python, SQL, Spark
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Iselin or Charlotte or Irving
$119k-$224k/yr HybridFull Time
5+ YOE5+ years database and cloud data management experience (GCP preferred), 5+ years Python or Java with Spark/SQL, orchestration and CI/CD experience, BigQuery/Dataflow/Dataproc knowledge, ability to support off-hours; not eligible for visa sponsorship.
Google Cloud Platform (GCP), BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer, Cloud Composer, Apache Beam, Python, SQL, Java, Spark SQL, Spark, Airflow, Cloud Workflows, Cloud Build, Git, Cloud Logging, Cloud Monitoring, IAM, VPC‑SC, CMEK
2w
Save
Mark Applied
Hide
Staff Data Engineer - Data Engineering
Livingston or New York City or Sunnyvale or San Francisco or Bellevue
$207k-$275k/yr OnsiteFull Time
10+ YOE10+ years in data or software engineering with enterprise data architecture experience; expertise in lakehouse architectures, data modeling, governance, SQL and production programming (Python/Scala/Java/Rust); strong cross-team leadership.
Apache Iceberg, Delta Lake, Apache Hudi, Apache Paimon, Apache Fluss, StarRocks, ClickHouse, Trino, Spark, Flink, Kafka, AutoMQ, Pulsar, SQL, Python, Scala, Java, Rust, Kubernetes
1d
Save
Mark Applied
Hide
Security Data Solutions Engineer
Quincy or Princeton or Irvine or Boston or Austin or Sacramento
$120k-$203k/yr HybridFull Time
8+ YOEDesign and implement enterprise security telemetry and data products; 8+ years in cybersecurity/data engineering; strong Python, SQL, Spark, Databricks, Snowflake, SIEM experience; product management skills.
Splunk, Microsoft Sentinel, QRadar, Elastic, Chronicle, Databricks, Snowflake, Kafka, Spark, Cribl, OpenTelemetry, FluentBit, Python, SQL, AWS, Azure, Google Cloud
1mo
Save
Mark Applied
Hide
Senior Data Engineer - PGIM Technology (Hybrid - Newark, NJ)
Newark, New Jersey, United States
$115k-$155k/yr HybridFull Time
3+ YOEBachelor's or Master's in CS/data engineering, 3+ years data/AI engineering, strong Python and SQL, experience with Spark/PySpark, Microsoft Fabric/Azure Data Factory/AWS Glue, ML model deployment, CI/CD and data governance.
Microsoft Fabric, Azure Data Factory, AWS Glue, PySpark, Spark, Python, SQL, REST APIs, GitHub Actions, Azure DevOps, Git, LLM APIs
2w
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia, Pennsylvania, United States
$68k-$153k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience building scalable pipelines, ecommerce/Shopify data expertise, strong SQL and Python, cloud and modern data platform experience, semantic layer and AI/ML data readiness skills.
Shopify, dbt, LookML, Spark, Snowflake, Databricks, BigQuery, Redshift, Parquet, SQL, Python, AWS, Azure, GCP
2mo
Save
Mark Applied
Hide
Data Engineer
Princeton, New Jersey, United States
$100k-$120k/yr HybridFull Time
3+ YOEDesign, build, and maintain data pipelines; integrate core insurance data; ensure data quality and governance; develop data lake/warehouse.
Python, SQL, Snowflake, BigQuery, Redshift, Databricks, Spark, dbt, Great Expectations, Kafka, Kinesis, Debezium, Fivetran, HVR
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Cary or Bridgewater or New York
$120k-$176k/yr HybridFull Time
8+ YOE8+ years data solutions experience with 4+ years in Azure/Databricks; strong SQL, Spark, Scala/Python, Big Data (Hive/HBase), Azure services, ETL/warehousing, CI/CD, data governance, and leadership/mentoring experience.
Microsoft Azure, Microsoft Azure Databricks, Databricks, Apache Spark, SQL, Scala, Python, Hive, HBase, Microsoft Azure Functions, Microsoft Cosmos DB, Microsoft Azure Data Factory, Delta Lake, Shell, Bash, Microsoft PowerShell, Microsoft Event Hub, Oracle, Microsoft SQL Server, CI/CD
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
Austin or Chicago or New Hartford or Philadelphia
$130k-$144k/yr RemoteFull Time
5+ YOE5+ years data engineering; project leadership; strong problem-solving; excellent communication; continuous learning; experience with AI/LLM tooling.
Python, SQL, Terraform, Spark, Databricks, Structured Streaming, Postgres, DynamoDB, CircleCI, DroneCI, Github Actions, Spacelift, DataDog, AWS, Azure, data governance, AI/ML integration, Claude Code, Cursor, Copilot, MCP, Agent Orchestrators, Git, Github
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia or Aurora or King of Prussia
$82k-$172k/yr OnsiteFull Time
5+ YOE5+ years in data engineering/science with TS/SCI clearance; BS in data science/CS; experience building data pipelines and using Python data libraries; experience with git.
Python, NumPy, Pandas, Polars, Git, Docker, Docker Compose, AWS, Spark, PySpark, Linux, CUDA
1mo
Save
Mark Applied
Hide
Senior Data Engineer - PGIM Technology (Hybrid - Newark, NJ)
Newark, New Jersey, United States
$115k-$155k/yr HybridFull Time
3+ YOE3–6 years data/AI engineering experience; strong Python, SQL, Spark/PySpark; experience with data pipelines (ETL/ELT) and tools like Microsoft Fabric or Azure Data Factory; ML deployment and basic MLOps; knowledge of generative AI (embeddings, RAG).
Microsoft Fabric, Azure Data Factory, PySpark, Spark, SQL, Python, AWS Glue, REST APIs, GitHub Actions, Azure DevOps, Git
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
5+ YOE5+ years in data engineering with strong Python and experience with modern data platforms (Spark, Databricks, Trino, Iceberg, Snowflake, Kafka); capital markets/financial services experience required.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
Explore Jobs