44 spark engineer jobs at 17 companies in Ephrata, PA
2w
Save
Mark Applied
Hide
Sr. Platform Engineer, Kubernetes
West Chester, Pennsylvania, United States
OnsiteFull Time
7+ YOE7+ years in DevOps/Systems Engineering with deep Apache Spark, Kubernetes, cloud (AWS/Azure/GCP), Terraform/Ansible, Python/Java/Scala, observability (Prometheus/Grafana), networking, and CI/CD experience.
Prometheus, Grafana, Apache Spark, Apache Flyte, Terraform, Ansible, Python, Java, Scala, Bash, SQL, GitHub, Apache Iceberg, Unity Catalog, Delta Lake, Apache Kafka, Hadoop, Amazon S3, HDFS, Databricks Platform, Snowflake, Alluxio, Docker, Kubernetes, AWS, Azure, GCP, Linux, Adobe Spark, Go Programming Language
1mo
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
1w
Save
Mark Applied
Hide
Distinguished Engineer -Developer Insights & AI Telemetry
New York City or McLean or Richmond or Wilmington
$294k-$335k/yr OnsiteFull Time
7+ YOEBachelor’s degree and 7+ years in software, solution, or enterprise architecture; expertise in big data, streaming, ML/AI, cloud computing, distributed systems, and technical leadership.
Spark, Kafka, Kinesis, ClickHouse, Snowflake, AWS, Microsoft Azure, Google Cloud, Python, Go, Java, TypeScript, OpenTelemetry, Protobuf, DORA, SPACE
1w
Save
Mark Applied
Hide
Distinguished Engineer -Developer Insights & AI Telemetry
New York City or McLean or Wilmington or Richmond
$245k-$335k/yr OnsiteFull Time
7+ YOEBachelor's degree and 7+ years in software, solution, or enterprise architecture; 5+ years in big data; 4+ years in production ML/AI; 2+ years in cloud computing.
Spark, Kafka, Kinesis, ClickHouse, Snowflake, AWS, Microsoft Azure, Google Cloud, Python, Go, Java, TypeScript, OpenTelemetry, Protobuf, DORA, SPACE
1w
Save
Mark Applied
Hide
Distinguished Engineer -Developer Insights & AI Telemetry
New York City or McLean or Wilmington or Richmond
$245k-$335k/yr OnsiteFull Time
7+ YOEBachelor’s degree and 7+ years in software, solution, or enterprise architecture; 5+ years in big data; 4+ years in production ML/AI; 2+ years in cloud computing.
Spark, Kafka, Kinesis, ClickHouse, Snowflake, AWS, Microsoft Azure, Google Cloud, Python, Go, Java, TypeScript, OpenTelemetry, Protobuf, DORA, SPACE
2w
Save
Mark Applied
Hide
Lead Software Engineer - Python, Databricks and AWS
Jersey City or Wilmington
$152k-$215k/yr OnsiteFull Time
5+ YOE5+ years SDLC experience, strong data engineering with Databricks Lakehouse, Delta Lake, Spark; AWS (S3, IAM, KMS); streaming and batch pipelines; CI/CD and Terraform; governance and monitoring.
Databricks, Delta Lake, Spark, Delta Live Tables (DLT), Databricks Workflows, Structured Streaming, AWS, S3, IAM, KMS, Unity Catalog, Terraform
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp, Maryland, United States
$78k-$176k/yr RemoteFull Time
5+ YOE5+ years application development experience, 3+ years building ETL/ELT workflows, experience with PySpark/Spark SQL and Palantir Foundry, ability to build/operate scalable data platforms, Secret clearance, Bachelor's degree.
PySpark, Spark SQL, Foundry Ontology, Foundry Workshop, Palantir Foundry Data Pipeline Builder, Palantir Foundry, Python, SQL, Scala, Java, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp or Aberdeen Proving Ground
$78k-$176k/yr OnsiteFull Time
5+ YOE5+ years building enterprise data applications; 3+ years creating ETL/ELT workflows; experience with PySpark, Spark SQL, Palantir Foundry (Ontology, Workshop, Data Pipeline Builder); scripting, log debugging; Secret clearance; Bachelor’s degree.
PySpark, Spark SQL, Palantir Foundry, Foundry Ontology, Foundry Workshop, Palantir Foundry Data Pipeline Builder, Python, SQL, Scala, Java, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
1w
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
3w
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano
OnsiteFull Time
Experience with Hadoop, PySpark, Hive, Spark, Python, SQL, Autosys/Airflow, Unix shell; bachelor\u0002s degree or equivalent; strong communication and SDLC experience required.
Hadoop, PySpark, Hive, Spark, Python, SQL, Unix Shell, Autosys, Airflow, Cloudera, Tableau
2d
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano or Delaware or Florida or New Jersey or North Carolina or Texas or United States
$82k-$127k/yr OnsiteFull Time
Bachelor's degree or equivalent experience; Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, SQL, data warehousing, orchestration tools, Agile, and production Big Data experience required.
Hadoop, PySpark, Cloudera, Hive, Spark, Python, Unix, Autosys, Airflow, SQL, Agile, Tableau, AI, cloud, containerization
2d
Save
Mark Applied
Hide
Data Engineer, Specialist - DADES3001
Malvern or Charlotte
HybridFull Time
8+ YOE8+ years in data or software engineering; scalable pipelines and cloud platforms; SQL, data modeling, Python, databases, modern data platforms, AI-assisted engineering, leadership, and collaboration.
SQL, Python, Scala, Java, AWS, Azure, GCP, Spark, Databricks, Snowflake, Kafka, Hadoop, Infrastructure as Code, DevOps, CI/CD, machine learning, GenAI
2d
Save
Mark Applied
Hide
Data Engineer, Specialist - DADES3001
Charlotte or Malvern
HybridFull Time
8+ YOERequires 8+ years in data or software engineering, strong SQL, Python, data modeling, scalable pipelines, cloud platforms, modern data technologies, AI-assisted engineering, and technical leadership.
SQL, Python, Scala, Java, AWS, Azure, GCP, Spark, Databricks, Snowflake, Kafka, Hadoop, Infrastructure as Code, DevOps, CI/CD
2w
Save
Mark Applied
Hide
Senior Cloud Ops and Dev Ops Engineer
Cambridge or Plymouth Meeting or United States
OnsiteFull Time
4+ YOE4+ years operating data management solutions on cloud, experience with AWS services, CI/CD, Terraform, database technologies, HIPAA-aware data handling, and onshore/offshore collaboration.
Jenkins, GitHub Actions, Terraform, S3, EFS, EC2, RDS, EKS, Glue, Secrets Manager, AWS Batch, PostgreSQL, MongoDB, Redshift, Elasticsearch, Spark, Bash, Git, LLMOps, GenAI LLM
3w
Save
Mark Applied
Hide
Senior Databricks Engineer
Malvern, Pennsylvania, United States
$120k-$135k/yr OnsiteFull Time
10+ YOEExpertise in Apache Spark, Delta Lake, Databricks (DLT, Workflows, Unity Catalog), Python/PySpark and SQL; experience with AWS (S3, Redshift, IAM, KMS); 10+ years experience and bachelor in computer science.
Apache Spark, Spark SQL, DataFrame API, Delta Lake, Delta Live Tables (DLT), Databricks Workflows, Unity Catalog, Python, PySpark, SQL, Amazon S3, Amazon Redshift, AWS KMS, Databricks Git Folders, Git, MLflow, AWS Glue, Amazon Kinesis, AWS Step Functions
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia or Aurora or King of Prussia
$82k-$172k/yr OnsiteFull Time
5+ YOE5+ years in data engineering/science with TS/SCI clearance; BS in data science/CS; experience building data pipelines and using Python data libraries; experience with git.
Python, NumPy, Pandas, Polars, Git, Docker, Docker Compose, AWS, Spark, PySpark, Linux, CUDA
2mo
Save
Mark Applied
Hide
AI Lead Developer
Exton, Pennsylvania, United States
OnsiteFull Time
10+ YOE10+ years software engineering (4+ years in AI/GenAI), strong Python with FastAPI/Flask, experience with LangChain/LangGraph/AutoGen/ADK/MCP, RAG and vector DBs, cloud (AWS/Microsoft Azure/GCP), Docker/Kubernetes, Redis, Kafka, and AI productionization.
ADK, AutoGen, Chroma, Claude, Docker, FAISS, FastAPI, Flask, GCP, Gemini, Hugging Face, Kafka, LangChain, LangGraph, MCP (Model Context Protocol), Microsoft Azure, Microsoft Azure AI Search, Microsoft Azure OpenAI, OpenAI, Pinecone, Python, Redis, Spark, Weaviate, CI/CD, AWS
1w
Save
Mark Applied
Hide
Data Engineer | Active Top Secret clearance
Yorktown or Mechanicsburg
$130k-$150k/yr OnsiteFull Time
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
10+ YOERequires active Top Secret clearance, U.S. citizenship, 10+ years of data engineering experience, SQL, PostgreSQL, data modeling, ETL, cloud databases, and 8570/8140 IAT II Security+ certification.
Amazon Relational Database Service (RDS), Java, MySQL, PostgreSQL, Pentaho, GitLab, Liquibase, CI/CD, Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ, Python, Scala, Go, AWS, Azure, GCP, Amazon Aurora, Redshift, MicroStrategy, Erwin Data Modeler, Oracle PL/SQL, SQL, AWS GovCloud, SAFe, EHR
1w
Save
Mark Applied
Hide
Data Engineer | Active Top Secret clearance
Yorktown or Mechanicsburg
$130k-$150k/yr OnsiteFull Time
10+ YOERequires 10+ years of data engineering experience, active Top Secret clearance, U.S. citizenship, SQL, PostgreSQL, data modeling, ETL, cloud databases, and 8570/8140 IAT II Security+ CE certification.
Amazon Relational Database Service (RDS), Java, MySQL, PostgreSQL, Pentaho, SQL, Oracle PL/SQL, GitLab, Liquibase, Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ, AWS, Azure, GCP, Aurora DB, RedShift, MicroStrategy, Erwin Data Modeler, Python, Scala, Go, AWS GovCloud, CI/CD
1w
Save
Mark Applied
Hide
Data Engineer
Mechanicsburg or Yorktown
OnsiteFull Time
10+ YOERequires Secret clearance, U.S. citizenship, Security+ and cloud or database certification, degree or equivalent experience, and 10+ years relevant experience; requires data warehousing, ETL, PostgreSQL, SQL, Oracle migration, modeling, and optimization expertise.
AWS GovCloud, Pentaho, PostgreSQL, SQL, Oracle PL/SQL, Amazon Aurora DB, MySQL, GitLab, Liquibase, CI/CD, Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ, AWS, Azure, GCP, AWS RDS, RedShift, MicroStrategy, Erwin Data Modeler, Python, Java, Scala, Go
Explore Jobs