82 spark engineer jobs at 39 companies in Media, PA
1mo
Save
Mark Applied
Hide
Principal Data Engineer
Philadelphia, Pennsylvania, United States
HybridFull Time
10+ YOE3+ Mgmt10+ years in data or software engineering, 7+ years building production data pipelines, strong Databricks/Spark/PySpark/SQL experience, Azure and streaming expertise, plus leadership and production operations experience.
Databricks, PySpark, Spark SQL, Spark, Python, SQL, Delta Lake, Databricks Workflows, CI/CD, Azure, Azure Event Hubs, Azure Stream Analytics, Azure Service Bus, Azure Data Factory, Azure Functions, ADLS, Azure Cosmos DB, Event Grid
2w
Save
Mark Applied
Hide
Sr. Platform Engineer, Kubernetes
West Chester, Pennsylvania, United States
OnsiteFull Time
7+ YOE7+ years in DevOps/Systems Engineering with deep Apache Spark, Kubernetes, cloud (AWS/Azure/GCP), Terraform/Ansible, Python/Java/Scala, observability (Prometheus/Grafana), networking, and CI/CD experience.
Prometheus, Grafana, Apache Spark, Apache Flyte, Terraform, Ansible, Python, Java, Scala, Bash, SQL, GitHub, Apache Iceberg, Unity Catalog, Delta Lake, Apache Kafka, Hadoop, Amazon S3, HDFS, Databricks Platform, Snowflake, Alluxio, Docker, Kubernetes, AWS, Azure, GCP, Linux, Adobe Spark, Go Programming Language
5d
Save
Mark Applied
Hide
Senior Managing Engineer (US)
Mount Laurel, New Jersey, United States
$124k-$200k/yr OnsiteFull Time
10+ YOEBachelor's or graduate degree, strong academic background in computer science or engineering, and 10+ years of relevant experience. Expert Azure data platform, distributed processing, software engineering, and DevOps expertise required.
Azure, Databricks, Spark, Delta Lake, ADLS, Azure Data Factory, Event Hubs, Python, SQL, Scala, APIs, microservices, DataOps, DevOps, CI/CD, GitOps
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
5+ YOE5+ years in data engineering with strong Python and experience with modern data platforms (Spark, Databricks, Trino, Iceberg, Snowflake, Kafka); capital markets/financial services experience required.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
1mo
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
1mo
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience with Databricks, cloud-native data platforms, Python/SQL/Spark, GenAI/LLM experience, data pipeline and governance expertise for clinical/cross-study data.
Generative AI, Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, vector embeddings
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteFull Time
5+ YOE5+ years data engineering experience, capital markets domain knowledge, strong Python skills, experience with Spark/Databricks/Trino/Snowflake/Kafka and large-scale batch/stream processing, ability to support off-hours/weekend needs.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
1mo
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience with cloud platforms, Databricks (Delta Lake, Unity Catalog), Python, SQL, Spark/PySpark, GenAI/LLM (RAG, embeddings), and building production-grade ETL/ELT pipelines and data products.
Generative AI (GenAI), Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, LLM
2w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
McLean or New York City or Richmond or San Francisco or Philadelphia or Canada or United Kingdom or Philippines
$179k-$246k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, and 1+ year cloud computing; Python, SQL, data pipelines, and cloud technologies required.
Python, Amazon Web Services (AWS), Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, Generative AI (GenAI), Open Source RDBMS, NoSQL, MapReduce, Hadoop, Hive, Amazon EMR, MySQL, Mongo, Cassandra, Redshift, UNIX, Linux, Claude Code, GitHub Copilot, AWS Glue, ETL
1w
Save
Mark Applied
Hide
Distinguished Engineer -Developer Insights & AI Telemetry
New York City or McLean or Richmond or Wilmington
$294k-$335k/yr OnsiteFull Time
7+ YOEBachelor’s degree and 7+ years in software, solution, or enterprise architecture; expertise in big data, streaming, ML/AI, cloud computing, distributed systems, and technical leadership.
Spark, Kafka, Kinesis, ClickHouse, Snowflake, AWS, Microsoft Azure, Google Cloud, Python, Go, Java, TypeScript, OpenTelemetry, Protobuf, DORA, SPACE
1w
Save
Mark Applied
Hide
Distinguished Engineer -Developer Insights & AI Telemetry
New York City or McLean or Wilmington or Richmond
$245k-$335k/yr OnsiteFull Time
7+ YOEBachelor’s degree and 7+ years in software, solution, or enterprise architecture; 5+ years in big data; 4+ years in production ML/AI; 2+ years in cloud computing.
Spark, Kafka, Kinesis, ClickHouse, Snowflake, AWS, Microsoft Azure, Google Cloud, Python, Go, Java, TypeScript, OpenTelemetry, Protobuf, DORA, SPACE
2w
Save
Mark Applied
Hide
Lead Software Engineer - Python, Databricks and AWS
Jersey City or Wilmington
$152k-$215k/yr OnsiteFull Time
5+ YOE5+ years SDLC experience, strong data engineering with Databricks Lakehouse, Delta Lake, Spark; AWS (S3, IAM, KMS); streaming and batch pipelines; CI/CD and Terraform; governance and monitoring.
Databricks, Delta Lake, Spark, Delta Live Tables (DLT), Databricks Workflows, Structured Streaming, AWS, S3, IAM, KMS, Unity Catalog, Terraform
1w
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
3w
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano
OnsiteFull Time
Experience with Hadoop, PySpark, Hive, Spark, Python, SQL, Autosys/Airflow, Unix shell; bachelor\u0002s degree or equivalent; strong communication and SDLC experience required.
Hadoop, PySpark, Hive, Spark, Python, SQL, Unix Shell, Autosys, Airflow, Cloudera, Tableau
2d
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano or Delaware or Florida or New Jersey or North Carolina or Texas or United States
$82k-$127k/yr OnsiteFull Time
Bachelor's degree or equivalent experience; Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, SQL, data warehousing, orchestration tools, Agile, and production Big Data experience required.
Hadoop, PySpark, Cloudera, Hive, Spark, Python, Unix, Autosys, Airflow, SQL, Agile, Tableau, AI, cloud, containerization
1mo
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
AWS, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS step functions, Luigi, Pinecone, Milvus, pgvector, Git, CI/CD, Feature Stores, Vector Databases, APIs, MLOps
1mo
Save
Mark Applied
Hide
Principal Machine Learning Engineer
Philadelphia, Pennsylvania, United States
OnsiteContract
5+ YOE5+ years ML model development, 3+ years production model operationalization, strong Python and SQL skills, experience with Databricks/Spark/MLflow, model evaluation and MLOps, and stakeholder communication.
Python, SQL, Spark, Databricks, MLflow, scikit-learn, XGBoost, Snowflake, Azure, AWS
1mo
Save
Mark Applied
Hide
Machine learning Engineer
Pennington, New Jersey, United States
$105k-$125k/yr OnsiteFull Time
10+ YOEHands-on ML engineer with expertise in model development, MLOps, deployment, feature engineering, and scalable ML pipelines; strong Python, cloud, and data engineering skills.
MLflow, Kubeflow, SageMaker, Azure ML, Docker, Kubernetes, Python, NumPy, pandas, scikit-learn, PyTorch, TensorFlow, AWS, Azure, GCP, Spark, Databricks, Airflow, Great Expectations, XGBoost, LightGBM
3mo
Save
Mark Applied
Hide
Data Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
2+ YOEMinimum 2 years of production data engineering experience; proficient in Python and SQL; experience with AWS, Redshift, ETL tools; able to design data pipelines and collaborate across teams.
AWS, Redshift, Glue, Fivetran, Airflow, ECS, DMS, DataHub, Terraform, Python, SQL, Spark
1d
Save
Mark Applied
Hide
Data Engineer, Specialist - DADES3001
Malvern or Charlotte
HybridFull Time
8+ YOE8+ years in data or software engineering; scalable pipelines and cloud platforms; SQL, data modeling, Python, databases, modern data platforms, AI-assisted engineering, leadership, and collaboration.
SQL, Python, Scala, Java, AWS, Azure, GCP, Spark, Databricks, Snowflake, Kafka, Hadoop, Infrastructure as Code, DevOps, CI/CD, machine learning, GenAI
Explore Jobs