33 spark data engineer jobs at 15 companies in Intercourse, PA
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp or Aberdeen Proving Ground
$78k-$176k/yr OnsiteFull Time
5+ YOE5+ years building enterprise data applications; 3+ years creating ETL/ELT workflows; experience with PySpark, Spark SQL, Palantir Foundry (Ontology, Workshop, Data Pipeline Builder); scripting, log debugging; Secret clearance; Bachelor’s degree.
PySpark, Spark SQL, Palantir Foundry, Foundry Ontology, Foundry Workshop, Palantir Foundry Data Pipeline Builder, Python, SQL, Scala, Java, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
5+ YOE5+ years data engineering experience in large-scale distributed processing; strong Python; experience with Spark/Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka; capital markets domain experience.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteFull Time
5+ YOE5+ years data engineering experience, capital markets domain knowledge, strong Python skills, experience with Spark/Databricks/Trino/Snowflake/Kafka and large-scale batch/stream processing, ability to support off-hours/weekend needs.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp, Maryland, United States
$78k-$176k/yr RemoteFull Time
5+ YOE5+ years application development experience, 3+ years building ETL/ELT workflows, experience with PySpark/Spark SQL and Palantir Foundry, ability to build/operate scalable data platforms, Secret clearance, Bachelor's degree.
PySpark, Spark SQL, Foundry Ontology, Foundry Workshop, Palantir Foundry Data Pipeline Builder, Palantir Foundry, Python, SQL, Scala, Java, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
2w
Save
Mark Applied
Hide
Data Engineer
Lititz, Pennsylvania, United States
OnsiteFull Time
7+ YOE7+ years data engineering experience delivering Databricks on AWS solutions; strong SQL and Python/PySpark; experience with data pipelines, lakehouse patterns, governance, CI/CD, and production support.
Databricks, AWS, S3, IAM, KMS, VPC, Secrets Manager, CloudWatch, Delta Lake, Spark, SQL, Python, PySpark, Git, CI/CD, Power BI, Unity Catalog, MuleSoft, Salesforce, Epicor, Kantata
2w
Save
Mark Applied
Hide
Lead Data Engineer
Wilmington or McLean
$179k-$225k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, 1+ year cloud experience, proficiency in Java/Scala/Python and data engineering tools.
Java, Scala, Python, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, AWS, Microsoft Azure, Google Cloud, SQL
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia or Aurora or King of Prussia
$82k-$172k/yr OnsiteFull Time
5+ YOE5+ years in data engineering/science with TS/SCI clearance; BS in data science/CS; experience building data pipelines and using Python data libraries; experience with git.
Python, NumPy, Pandas, Polars, Git, Docker, Docker Compose, AWS, Spark, PySpark, Linux, CUDA
3w
Save
Mark Applied
Hide
Senior Data Engineer
Newark, Delaware, United States
$140k-$150k/yr RemoteFull Time
8+ YOEBachelor's or master's in CS/statistics/analytics, 8+ years data engineering, 5+ years cloud (preferably AWS), strong SQL, Databricks, Snowflake, Python/PySpark, Kafka experience preferred.
Databricks, Spark, Confluent Kafka, Snowflake, AWS, SQL, Python, PySpark, Microsoft Power BI
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
5+ YOE5+ years in data engineering with strong Python and experience with modern data platforms (Spark, Databricks, Trino, Iceberg, Snowflake, Kafka); capital markets/financial services experience required.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
4d
Save
Mark Applied
Hide
Data Engineer
Mechanicsburg or Yorktown
OnsiteFull Time
10+ YOERequires Secret clearance, U.S. citizenship, Security+ and cloud or database certification, degree or equivalent experience, and 10+ years relevant experience; requires data warehousing, ETL, PostgreSQL, SQL, Oracle migration, modeling, and optimization expertise.
AWS GovCloud, Pentaho, PostgreSQL, SQL, Oracle PL/SQL, Amazon Aurora DB, MySQL, GitLab, Liquibase, CI/CD, Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ, AWS, Azure, GCP, AWS RDS, RedShift, MicroStrategy, Erwin Data Modeler, Python, Java, Scala, Go
2w
Save
Mark Applied
Hide
Hadoop PySpark Data Engineer
Charlotte or Jersey City or Newark or Plano
$82k-$127k/yr OnsiteFull Time
Experience with Hadoop ecosystem (Cloudera), PySpark, Spark, Hive, Python, Unix shell scripting, Autosys/Airflow, SQL; Bachelor\u0002s or equivalent experience; ability to work across SDLC and travel/relocate as needed.
Hadoop, Cloudera, PySpark, Spark, Hive, Python, Unix shell scripting, Autosys, Airflow, SQL, Tableau
2mo
Save
Mark Applied
Hide
Senior Data Engineer
King of Prussia or Aurora
$82k-$172k/yr OnsiteFull Time
5+ YOEActive TS/SCI clearance, B.S. in Data Science/AI/CS or related, 5+ years experience, building data pipelines using Python (NumPy, Pandas, Polars), version control (git/GitLab/Bitbucket), and contributing to AI/ML solutions.
NumPy, Pandas, Polars, Python, git, GitLab, Bitbucket, Docker, Docker Compose, AWS, Spark, PySpark, Gymnasium, OpenEnv, TorchRL, RLlib, Stable Baselines, LangFuse, MLFlow, Arize Phoenix, HuggingFace, LangChain, Linux, EC2, S3, Lambda, Bedrock, Java, C++, Rust, Go, C#, CUDA, Podman, Kubernetes, Rancher
5d
Save
Mark Applied
Hide
Data Engineer | Active Top Secret clearance
Yorktown or Mechanicsburg
$130k-$150k/yr OnsiteFull Time
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
10+ YOERequires active Top Secret clearance, U.S. citizenship, 10+ years of data engineering experience, SQL, PostgreSQL, data modeling, ETL, cloud databases, and 8570/8140 IAT II Security+ certification.
Amazon Relational Database Service (RDS), Java, MySQL, PostgreSQL, Pentaho, GitLab, Liquibase, CI/CD, Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ, Python, Scala, Go, AWS, Azure, GCP, Amazon Aurora, Redshift, MicroStrategy, Erwin Data Modeler, Oracle PL/SQL, SQL, AWS GovCloud, SAFe, EHR
5d
Save
Mark Applied
Hide
Data Engineer | Active Top Secret clearance
Yorktown or Mechanicsburg
$130k-$150k/yr OnsiteFull Time
10+ YOERequires 10+ years of data engineering experience, active Top Secret clearance, U.S. citizenship, SQL, PostgreSQL, data modeling, ETL, cloud databases, and 8570/8140 IAT II Security+ CE certification.
Amazon Relational Database Service (RDS), Java, MySQL, PostgreSQL, Pentaho, SQL, Oracle PL/SQL, GitLab, Liquibase, Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ, AWS, Azure, GCP, Aurora DB, RedShift, MicroStrategy, Erwin Data Modeler, Python, Scala, Go, AWS GovCloud, CI/CD
3mo
Save
Mark Applied
Hide
Data & AI Senior Engineer - 90405345 - Washington DC, Philadelphia PA, Wilmington DE or Chicago IL (Washington, DC, US, 20001)
Washington or Philadelphia or Wilmington or Chicago
$87k-$112k/yr OnsiteFull Time
4+ YOE4–6 years in data engineering, software development, or data architecture; Bachelor's in CS/Data Engineering or related field; onsite work across multiple cities.
Python, SQL, Spark, Databricks, SAP, Denodo, APIs, MLOps
2w
Save
Mark Applied
Hide
Senior Data Scientist
Aberdeen, Maryland, United States
$112k-$196k/yr OnsiteFull Time
8+ YOEMaster's in CS/ECE or 8+ years relevant experience; expertise in data science/engineering, cloud, data mesh, data tagging, and experience supporting mission-critical systems.
Python, R, Scala, Airflow, NiFi, Spark, Flink, Docker, Kubernetes, CI/CD, Grafana, Kibana, Power BI, Tableau
2w
Save
Mark Applied
Hide
Lead Software Engineer - Python, AWS, Big Data
Wilmington, Delaware, United States
OnsiteFull Time
5+ YOE5+ years software engineering experience with Python, Big Data and data pipeline design; hands-on with AWS, Spark, Terraform and delivering production-grade systems; experience with AI-assisted development preferred.
Python, FAST API, Spark, AWS Lambda, AWS Glue, AWS Step Function, ECS, Terraform, Snowflake, AWS Bedrock
3w
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
4d
Save
Mark Applied
Hide
Data Engineering Team Leader
Towson or Harrisburg
OnsiteFull Time
7+ YOEBachelor's degree in computer science, information systems, or related field; 7+ years of systems engineering experience; SQL, programming, databases, cloud, ETL, data modeling, governance, and leadership expertise.
SQL, Oracle, SQL Server, MySQL, Python, Java, Scala, Hadoop, Spark, AWS, Azure, Google Cloud, Snowflake, Redshift, BigQuery, Apache Airflow, Azure Data Factory, Qlik Talend
1w
Save
Mark Applied
Hide
Senior Cloud Ops and Dev Ops Engineer
Cambridge or Plymouth Meeting or United States
OnsiteFull Time
4+ YOE4+ years operating data management solutions on cloud, experience with AWS services, CI/CD, Terraform, database technologies, HIPAA-aware data handling, and onshore/offshore collaboration.
Jenkins, GitHub Actions, Terraform, S3, EFS, EC2, RDS, EKS, Glue, Secrets Manager, AWS Batch, PostgreSQL, MongoDB, Redshift, Elasticsearch, Spark, Bash, Git, LLMOps, GenAI LLM
Explore Jobs