20 pyspark data engineer jobs at 11 companies in Ephrata, PA
3d
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano or Delaware or Florida or New Jersey or North Carolina or Texas or United States
$82k-$127k/yr OnsiteFull Time
Bachelor's degree or equivalent experience; Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, SQL, data warehousing, orchestration tools, Agile, and production Big Data experience required.
Hadoop, PySpark, Cloudera, Hive, Spark, Python, Unix, Autosys, Airflow, SQL, Agile, Tableau, AI, cloud, containerization
3w
Save
Mark Applied
Hide
Hadoop PySpark Data Engineer
Charlotte or Jersey City or Newark or Plano
$82k-$127k/yr OnsiteFull Time
Experience with Hadoop ecosystem (Cloudera), PySpark, Spark, Hive, Python, Unix shell scripting, Autosys/Airflow, SQL; Bachelor\u0002s or equivalent experience; ability to work across SDLC and travel/relocate as needed.
Hadoop, Cloudera, PySpark, Spark, Hive, Python, Unix shell scripting, Autosys, Airflow, SQL, Tableau
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp or Aberdeen Proving Ground
$78k-$176k/yr OnsiteFull Time
5+ YOE5+ years building enterprise data applications; 3+ years creating ETL/ELT workflows; experience with PySpark, Spark SQL, Palantir Foundry (Ontology, Workshop, Data Pipeline Builder); scripting, log debugging; Secret clearance; Bachelor’s degree.
PySpark, Spark SQL, Palantir Foundry, Foundry Ontology, Foundry Workshop, Palantir Foundry Data Pipeline Builder, Python, SQL, Scala, Java, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
1mo
Save
Mark Applied
Hide
Data Engineer
Malvern, Pennsylvania, United States
$120k-$130k/yr OnsiteFull Time
10+ YOE10+ years experience; bachelor of computer science; strong Python, AWS, Glue ETL, PySpark, Attunity; experience with data lakes, ETL pipelines, IAM, Lambda, CloudFormation; CI/CD and stakeholder collaboration.
Python, Glue ETL, Attunity, PySpark, Amazon S3, IAM, AWS Lambda, AWS CloudFormation, CI/CD
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp, Maryland, United States
$78k-$176k/yr RemoteFull Time
5+ YOE5+ years application development experience, 3+ years building ETL/ELT workflows, experience with PySpark/Spark SQL and Palantir Foundry, ability to build/operate scalable data platforms, Secret clearance, Bachelor's degree.
PySpark, Spark SQL, Foundry Ontology, Foundry Workshop, Palantir Foundry Data Pipeline Builder, Palantir Foundry, Python, SQL, Scala, Java, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
1mo
Save
Mark Applied
Hide
Data Engineer (Vantage) - Clearance Required
Crystal City or Aberdeen
$101k-$175k/yr RemoteFull Time
5+ YOE5–8 years data engineering experience with expert Python, SQL, PySpark; experience with Palantir Foundry (Vantage) and Advana; active DoD Secret clearance; familiarity with Army data sources preferred.
Python, SQL, PySpark, Palantir Foundry, Advana, IPPS-A, GCSS-Army, GFEBS
1mo
Save
Mark Applied
Hide
Data Engineer (Vantage) - Clearance Required
United States or Belcamp or Crystal City
$101k-$175k/yr RemoteFull Time
5+ YOEActive DoD Secret clearance,5+ years data engineering experience,expert Python,SQL,PySpark,experience with Palantir Foundry/Advana,ability to scale ETL pipelines and manage ontologies.
Python, SQL, PySpark, Palantir Foundry, Advana
3mo
Save
Mark Applied
Hide
Software Engineer III-ETL/PySpark
Wilmington, Delaware, United States
OnsiteFull Time
3+ YOE3+ years in data engineering with Python, SQL; experience with PySpark, AWS, Snowflake; SDLC, CI/CD, and data tooling expertise.
Python, SQL, PySpark, AWS, Snowflake, Ab Initio, Teradata, Airflow, DBT
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Coopersburg or Philadelphia
OnsiteFull Time
8+ YOERequired bachelor’s or master’s in CS/Data Science/Computer Engineering/Software Engineering, 8+ years related experience, expertise in data modeling, real-time/batch processing, cloud architectures, and SQL.
AWS, S3, Glue, EKS, Lambda, SageMaker, Redshift, Athena, Bedrock, Agentcore, SQL, NoSQL, Microsoft Power BI, Tableau, QuickSight, Python, Pandas, NumPy, PySpark
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia or Aurora or King of Prussia
$82k-$172k/yr OnsiteFull Time
5+ YOE5+ years in data engineering/science with TS/SCI clearance; BS in data science/CS; experience building data pipelines and using Python data libraries; experience with git.
Python, NumPy, Pandas, Polars, Git, Docker, Docker Compose, AWS, Spark, PySpark, Linux, CUDA
2mo
Save
Mark Applied
Hide
Senior Data Engineer
King of Prussia or Aurora
$82k-$172k/yr OnsiteFull Time
5+ YOEActive TS/SCI clearance, B.S. in Data Science/AI/CS or related, 5+ years experience, building data pipelines using Python (NumPy, Pandas, Polars), version control (git/GitLab/Bitbucket), and contributing to AI/ML solutions.
NumPy, Pandas, Polars, Python, git, GitLab, Bitbucket, Docker, Docker Compose, AWS, Spark, PySpark, Gymnasium, OpenEnv, TorchRL, RLlib, Stable Baselines, LangFuse, MLFlow, Arize Phoenix, HuggingFace, LangChain, Linux, EC2, S3, Lambda, Bedrock, Java, C++, Rust, Go, C#, CUDA, Podman, Kubernetes, Rancher
1mo
Save
Mark Applied
Hide
Data Engineer
Aberdeen, Maryland, United States
$112k-$196k/yr OnsiteFull Time
7+ YOEBachelor's in a technical field, 7+ years related experience, ability to develop mathematical algorithms, proficiency with advanced statistical software and MS Office, and U.S. citizenship required.
R, Python, Apache Spark, ElasticSearch, Kibana, SPSS, SAS, MatLab, Microsoft Office, Microsoft Access, Windows
2w
Save
Mark Applied
Hide
Project Data Engineer 2027 - Lehigh Valley, PA
Coopersburg, Pennsylvania, United States
OnsiteFull Time
0+ YOEBachelor's in related field, minimum cumulative GPA 3.0, 0-3 years related experience, U.S. work authorization without sponsorship, willingness to work on-site 5 days/week.
Python, Pandas, NumPy, PySpark, Amazon S3, AWS Glue, Amazon ECS, AWS Lambda, Amazon SageMaker, Amazon Redshift, Amazon Athena
3d
Save
Mark Applied
Hide
Data Architect-68464
Reading, Pennsylvania, United States
OnsiteFull Time
10+ YOE5+ Mgmt10+ years in data architecture, engineering, or enterprise platforms; 5+ years leading data engineering initiatives; bachelor's degree; expertise in cloud data platforms, modeling, ETL/ELT, and distributed systems.
AWS, Amazon S3, Amazon EMR, AWS Glue, Amazon Redshift, Snowflake, Apache Spark, Apache Kafka, Apache Airflow, Talend, dbt, Python, SQL, Microsoft SQL Server, PostgreSQL, Amazon Aurora, Amazon DynamoDB, Kubernetes, Docker, Git, CI/CD, Infrastructure as Code, REST APIs, ETL/ELT
3mo
Save
Mark Applied
Hide
Data Analytics Manager (Clinical)
Chadds Ford or Wilmington
HybridFull Time
10+ YOE10+ years in data engineering/analytics with leadership experience; strong MS Fabric/Power BI; clinical development operations domain knowledge.
Microsoft Fabric, Databricks, PySpark, Power BI, Azure DevOps, GitHub, CI/CD
2mo
Save
Mark Applied
Hide
Machine Learning Engineer, Specialist
Malvern, Pennsylvania, United States
HybridFull Time
5+ YOEUndergraduate degree or equivalent experience and 5+ years relevant experience. Requires 3+ years designing AWS ETL pipelines, Python, machine learning frameworks, cloud technologies, NoSQL, and ML lifecycle knowledge.
Python, PySpark, PySQL, AWS, AWS Glue, Amazon SageMaker, Azure, NoSQL, Feature Store, LLMs, GenAI, RAG, Prompt Engineering, Model Evaluation, API
Explore Jobs