38 spark engineer jobs at 19 companies in Lititz, PA
4w
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
1w
Save
Mark Applied
Hide
Distinguished Engineer -Developer Insights & AI Telemetry
New York City or McLean or Richmond or Wilmington
$294k-$335k/yr OnsiteFull Time
7+ YOEBachelor’s degree and 7+ years in software, solution, or enterprise architecture; expertise in big data, streaming, ML/AI, cloud computing, distributed systems, and technical leadership.
Spark, Kafka, Kinesis, ClickHouse, Snowflake, AWS, Microsoft Azure, Google Cloud, Python, Go, Java, TypeScript, OpenTelemetry, Protobuf, DORA, SPACE
1w
Save
Mark Applied
Hide
Distinguished Engineer -Developer Insights & AI Telemetry
New York City or McLean or Wilmington or Richmond
$245k-$335k/yr OnsiteFull Time
7+ YOEBachelor's degree and 7+ years in software, solution, or enterprise architecture; 5+ years in big data; 4+ years in production ML/AI; 2+ years in cloud computing.
Spark, Kafka, Kinesis, ClickHouse, Snowflake, AWS, Microsoft Azure, Google Cloud, Python, Go, Java, TypeScript, OpenTelemetry, Protobuf, DORA, SPACE
2w
Save
Mark Applied
Hide
Lead Software Engineer - Python, Databricks and AWS
Jersey City or Wilmington
$152k-$215k/yr OnsiteFull Time
5+ YOE5+ years SDLC experience, strong data engineering with Databricks Lakehouse, Delta Lake, Spark; AWS (S3, IAM, KMS); streaming and batch pipelines; CI/CD and Terraform; governance and monitoring.
Databricks, Delta Lake, Spark, Delta Live Tables (DLT), Databricks Workflows, Structured Streaming, AWS, S3, IAM, KMS, Unity Catalog, Terraform
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp, Maryland, United States
$78k-$176k/yr RemoteFull Time
5+ YOE5+ years application development experience, 3+ years building ETL/ELT workflows, experience with PySpark/Spark SQL and Palantir Foundry, ability to build/operate scalable data platforms, Secret clearance, Bachelor's degree.
PySpark, Spark SQL, Foundry Ontology, Foundry Workshop, Palantir Foundry Data Pipeline Builder, Palantir Foundry, Python, SQL, Scala, Java, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp or Aberdeen Proving Ground
$78k-$176k/yr OnsiteFull Time
5+ YOE5+ years building enterprise data applications; 3+ years creating ETL/ELT workflows; experience with PySpark, Spark SQL, Palantir Foundry (Ontology, Workshop, Data Pipeline Builder); scripting, log debugging; Secret clearance; Bachelor’s degree.
PySpark, Spark SQL, Palantir Foundry, Foundry Ontology, Foundry Workshop, Palantir Foundry Data Pipeline Builder, Python, SQL, Scala, Java, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
1w
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
3w
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano
OnsiteFull Time
Experience with Hadoop, PySpark, Hive, Spark, Python, SQL, Autosys/Airflow, Unix shell; bachelor\u0002s degree or equivalent; strong communication and SDLC experience required.
Hadoop, PySpark, Hive, Spark, Python, SQL, Unix Shell, Autosys, Airflow, Cloudera, Tableau
1mo
Save
Mark Applied
Hide
Gen AI Engineer
Atlanta or Richmond or Lake Mary or Nashville or Indianapolis or Wilmington or Mason or Grand Prairie or Norfolk or United States
HybridFull Time
4+ YOEBachelor's in a quantitative field (or equivalent) and 4+ years experience; advanced Python and SQL; hands-on experience with LLM/GenAI, NLP, Hugging Face, TensorFlow, Keras, PyTorch, Spark; cloud (GCP/AWS) and MLOps/model deployment experience.
Python, SQL, Hugging Face, TensorFlow, Keras, PyTorch, Spark, GCP, AWS, vLLM, Text Generation Inference, FastAPI, GPTQ, AWQ, bitsandbytes, AWS EKS, AWS ECS, GCP GKE, Azure AKS
2w
Save
Mark Applied
Hide
Data Engineer
Lititz, Pennsylvania, United States
OnsiteFull Time
7+ YOE7+ years data engineering experience delivering Databricks on AWS solutions; strong SQL and Python/PySpark; experience with data pipelines, lakehouse patterns, governance, CI/CD, and production support.
Databricks, AWS, S3, IAM, KMS, VPC, Secrets Manager, CloudWatch, Delta Lake, Spark, SQL, Python, PySpark, Git, CI/CD, Power BI, Unity Catalog, MuleSoft, Salesforce, Epicor, Kantata
4w
Save
Mark Applied
Hide
Senior Data Engineer
Newark, Delaware, United States
$140k-$150k/yr RemoteFull Time
8+ YOEBachelor's or master's in CS/statistics/analytics, 8+ years data engineering, 5+ years cloud (preferably AWS), strong SQL, Databricks, Snowflake, Python/PySpark, Kafka experience preferred.
Databricks, Spark, Confluent Kafka, Snowflake, AWS, SQL, Python, PySpark, Microsoft Power BI
3w
Save
Mark Applied
Hide
Senior Databricks Engineer
Malvern, Pennsylvania, United States
$120k-$135k/yr OnsiteFull Time
10+ YOEExpertise in Apache Spark, Delta Lake, Databricks (DLT, Workflows, Unity Catalog), Python/PySpark and SQL; experience with AWS (S3, Redshift, IAM, KMS); 10+ years experience and bachelor in computer science.
Apache Spark, Spark SQL, DataFrame API, Delta Lake, Delta Live Tables (DLT), Databricks Workflows, Unity Catalog, Python, PySpark, SQL, Amazon S3, Amazon Redshift, AWS KMS, Databricks Git Folders, Git, MLflow, AWS Glue, Amazon Kinesis, AWS Step Functions
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia or Aurora or King of Prussia
$82k-$172k/yr OnsiteFull Time
5+ YOE5+ years in data engineering/science with TS/SCI clearance; BS in data science/CS; experience building data pipelines and using Python data libraries; experience with git.
Python, NumPy, Pandas, Polars, Git, Docker, Docker Compose, AWS, Spark, PySpark, Linux, CUDA
2mo
Save
Mark Applied
Hide
AI Lead Developer
Exton, Pennsylvania, United States
OnsiteFull Time
10+ YOE10+ years software engineering (4+ years in AI/GenAI), strong Python with FastAPI/Flask, experience with LangChain/LangGraph/AutoGen/ADK/MCP, RAG and vector DBs, cloud (AWS/Microsoft Azure/GCP), Docker/Kubernetes, Redis, Kafka, and AI productionization.
ADK, AutoGen, Chroma, Claude, Docker, FAISS, FastAPI, Flask, GCP, Gemini, Hugging Face, Kafka, LangChain, LangGraph, MCP (Model Context Protocol), Microsoft Azure, Microsoft Azure AI Search, Microsoft Azure OpenAI, OpenAI, Pinecone, Python, Redis, Spark, Weaviate, CI/CD, AWS
1w
Save
Mark Applied
Hide
Data Engineer | Active Top Secret clearance
Yorktown or Mechanicsburg
$130k-$150k/yr OnsiteFull Time
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
10+ YOERequires active Top Secret clearance, U.S. citizenship, 10+ years of data engineering experience, SQL, PostgreSQL, data modeling, ETL, cloud databases, and 8570/8140 IAT II Security+ certification.
Amazon Relational Database Service (RDS), Java, MySQL, PostgreSQL, Pentaho, GitLab, Liquibase, CI/CD, Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ, Python, Scala, Go, AWS, Azure, GCP, Amazon Aurora, Redshift, MicroStrategy, Erwin Data Modeler, Oracle PL/SQL, SQL, AWS GovCloud, SAFe, EHR
1w
Save
Mark Applied
Hide
Data Engineer | Active Top Secret clearance
Yorktown or Mechanicsburg
$130k-$150k/yr OnsiteFull Time
10+ YOERequires 10+ years of data engineering experience, active Top Secret clearance, U.S. citizenship, SQL, PostgreSQL, data modeling, ETL, cloud databases, and 8570/8140 IAT II Security+ CE certification.
Amazon Relational Database Service (RDS), Java, MySQL, PostgreSQL, Pentaho, SQL, Oracle PL/SQL, GitLab, Liquibase, Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ, AWS, Azure, GCP, Aurora DB, RedShift, MicroStrategy, Erwin Data Modeler, Python, Scala, Go, AWS GovCloud, CI/CD
1w
Save
Mark Applied
Hide
Data Engineer
Mechanicsburg or Yorktown
OnsiteFull Time
10+ YOERequires Secret clearance, U.S. citizenship, Security+ and cloud or database certification, degree or equivalent experience, and 10+ years relevant experience; requires data warehousing, ETL, PostgreSQL, SQL, Oracle migration, modeling, and optimization expertise.
AWS GovCloud, Pentaho, PostgreSQL, SQL, Oracle PL/SQL, Amazon Aurora DB, MySQL, GitLab, Liquibase, CI/CD, Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ, AWS, Azure, GCP, AWS RDS, RedShift, MicroStrategy, Erwin Data Modeler, Python, Java, Scala, Go
2mo
Save
Mark Applied
Hide
Senior Data Engineer
King of Prussia or Aurora
$82k-$172k/yr OnsiteFull Time
5+ YOEActive TS/SCI clearance, B.S. in Data Science/AI/CS or related, 5+ years experience, building data pipelines using Python (NumPy, Pandas, Polars), version control (git/GitLab/Bitbucket), and contributing to AI/ML solutions.
NumPy, Pandas, Polars, Python, git, GitLab, Bitbucket, Docker, Docker Compose, AWS, Spark, PySpark, Gymnasium, OpenEnv, TorchRL, RLlib, Stable Baselines, LangFuse, MLFlow, Arize Phoenix, HuggingFace, LangChain, Linux, EC2, S3, Lambda, Bedrock, Java, C++, Rust, Go, C#, CUDA, Podman, Kubernetes, Rancher
2w
Save
Mark Applied
Hide
Test Developer
Charlotte or Atlanta or Newark or Plano or Dallas or Fort Worth or Jersey City or Jacksonville
$103k-$115k/yr OnsiteFull Time
2+ YOEBachelor's or equivalent, 2+ years relevant experience, strong Python and programming skills, SDLC and test development experience, analytical and problem-solving skills, knowledge of financial services and regulations.
Spark, R, C, JAVA, YAML, Python
3mo
Save
Mark Applied
Hide
Data & AI Senior Engineer - 90405345 - Washington DC, Philadelphia PA, Wilmington DE or Chicago IL (Washington, DC, US, 20001)
Washington or Philadelphia or Wilmington or Chicago
$87k-$112k/yr OnsiteFull Time
4+ YOE4–6 years in data engineering, software development, or data architecture; Bachelor's in CS/Data Engineering or related field; onsite work across multiple cities.
Python, SQL, Spark, Databricks, SAP, Denodo, APIs, MLOps
Explore Jobs