HiringCafe
Join our community

20 pyspark data engineer jobs at 12 companies in Lancaster, PA

1d
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano or Delaware or Florida or New Jersey or North Carolina or Texas or United States
$82k-$127k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Global provider of digital services, consulting, and technology solutions.
Bachelor's degree or equivalent experience; Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, SQL, data warehousing, orchestration tools, Agile, and production Big Data experience required.
Hadoop, PySpark, Cloudera, Hive, Spark, Python, Unix, Autosys, Airflow, SQL, Agile, Tableau, AI, cloud, containerization
Job PostingView all
3w
Save
Mark Applied
Hide
Hadoop PySpark Data Engineer
Charlotte or Jersey City or Newark or Plano
$82k-$127k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Hadoop ecosystem (Cloudera), PySpark, Spark, Hive, Python, Unix shell scripting, Autosys/Airflow, SQL; Bachelor\u0002s or equivalent experience; ability to work across SDLC and travel/relocate as needed.
Hadoop, Cloudera, PySpark, Spark, Hive, Python, Unix shell scripting, Autosys, Airflow, SQL, Tableau
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Newark, Delaware, United States
$140k-$150k/yr RemoteFull Time
Horizon Services
Horizon Services: Provides residential HVAC, plumbing, and electrical repair services.
8+ YOEBachelor's or master's in CS/statistics/analytics, 8+ years data engineering, 5+ years cloud (preferably AWS), strong SQL, Databricks, Snowflake, Python/PySpark, Kafka experience preferred.
Databricks, Spark, Confluent Kafka, Snowflake, AWS, SQL, Python, PySpark, Microsoft Power BI
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp or Aberdeen Proving Ground
$78k-$176k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
5+ YOE5+ years building enterprise data applications; 3+ years creating ETL/ELT workflows; experience with PySpark, Spark SQL, Palantir Foundry (Ontology, Workshop, Data Pipeline Builder); scripting, log debugging; Secret clearance; Bachelor’s degree.
PySpark, Spark SQL, Palantir Foundry, Foundry Ontology, Foundry Workshop, Palantir Foundry Data Pipeline Builder, Python, SQL, Scala, Java, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Malvern, Pennsylvania, United States
$120k-$130k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
10+ YOE10+ years experience; bachelor of computer science; strong Python, AWS, Glue ETL, PySpark, Attunity; experience with data lakes, ETL pipelines, IAM, Lambda, CloudFormation; CI/CD and stakeholder collaboration.
Python, Glue ETL, Attunity, PySpark, Amazon S3, IAM, AWS Lambda, AWS CloudFormation, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp, Maryland, United States
$78k-$176k/yr RemoteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
5+ YOE5+ years application development experience, 3+ years building ETL/ELT workflows, experience with PySpark/Spark SQL and Palantir Foundry, ability to build/operate scalable data platforms, Secret clearance, Bachelor's degree.
PySpark, Spark SQL, Foundry Ontology, Foundry Workshop, Palantir Foundry Data Pipeline Builder, Palantir Foundry, Python, SQL, Scala, Java, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer (Vantage) - Clearance Required
Crystal City or Aberdeen
$101k-$175k/yr RemoteFull Time
LMI
LMI: Provides management consulting and digital solutions to federal government agencies.
5+ YOE5–8 years data engineering experience with expert Python, SQL, PySpark; experience with Palantir Foundry (Vantage) and Advana; active DoD Secret clearance; familiarity with Army data sources preferred.
Python, SQL, PySpark, Palantir Foundry, Advana, IPPS-A, GCSS-Army, GFEBS
Job PostingView all
3mo
Save
Mark Applied
Hide
Software Engineer III-ETL/PySpark
Wilmington, Delaware, United States
OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
3+ YOE3+ years in data engineering with Python, SQL; experience with PySpark, AWS, Snowflake; SDLC, CI/CD, and data tooling expertise.
Python, SQL, PySpark, AWS, Snowflake, Ab Initio, Teradata, Airflow, DBT
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer (Vantage) - Clearance Required
United States or Belcamp or Crystal City
$101k-$175k/yr RemoteFull Time
LMI
LMI: Provides management consulting and digital solutions to government agencies.
5+ YOEActive DoD Secret clearance,5+ years data engineering experience,expert Python,SQL,PySpark,experience with Palantir Foundry/Advana,ability to scale ETL pipelines and manage ontologies.
Python, SQL, PySpark, Palantir Foundry, Advana
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia or Aurora or King of Prussia
$82k-$172k/yr OnsiteFull Time
CACI
CACINYSE: CACI: Provides information technology and professional services to government clients.
5+ YOE5+ years in data engineering/science with TS/SCI clearance; BS in data science/CS; experience building data pipelines and using Python data libraries; experience with git.
Python, NumPy, Pandas, Polars, Git, Docker, Docker Compose, AWS, Spark, PySpark, Linux, CUDA
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
King of Prussia or Aurora
$82k-$172k/yr OnsiteFull Time
CACI International
CACI InternationalNYSE: CACI: Provides information technology and engineering services for government agencies.
5+ YOEActive TS/SCI clearance, B.S. in Data Science/AI/CS or related, 5+ years experience, building data pipelines using Python (NumPy, Pandas, Polars), version control (git/GitLab/Bitbucket), and contributing to AI/ML solutions.
NumPy, Pandas, Polars, Python, git, GitLab, Bitbucket, Docker, Docker Compose, AWS, Spark, PySpark, Gymnasium, OpenEnv, TorchRL, RLlib, Stable Baselines, LangFuse, MLFlow, Arize Phoenix, HuggingFace, LangChain, Linux, EC2, S3, Lambda, Bedrock, Java, C++, Rust, Go, C#, CUDA, Podman, Kubernetes, Rancher
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Aberdeen, Maryland, United States
$112k-$196k/yr OnsiteFull Time
Parsons
ParsonsNYSE: PSN: Provides engineering and technology services for infrastructure and defense.
7+ YOEBachelor's in a technical field, 7+ years related experience, ability to develop mathematical algorithms, proficiency with advanced statistical software and MS Office, and U.S. citizenship required.
R, Python, Apache Spark, ElasticSearch, Kibana, SPSS, SAS, MatLab, Microsoft Office, Microsoft Access, Windows
Job PostingView all
1mo
Save
Mark Applied
Hide
DE II - Databricks Platform
Hartford or St. Paul or Hunt Valley
$127k-$209k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
8+ YOEBachelor's in STEM or equivalent, ~8 years related experience with at least 4 years in data engineering, advanced experience with Databricks, Unity Catalog, PySpark and AWS, strong communication and stakeholder management.
Databricks, AWS, Unity Catalog, PySpark, Genie
Job PostingView all
1d
Save
Mark Applied
Hide
Data Architect-68464
Reading, Pennsylvania, United States
OnsiteFull Time
Hitachi
HitachiTokyo Stock Exchange: 6501: Global provider of digital systems and social infrastructure solutions.
10+ YOE5+ Mgmt10+ years in data architecture, engineering, or enterprise platforms; 5+ years leading data engineering initiatives; bachelor's degree; expertise in cloud data platforms, modeling, ETL/ELT, and distributed systems.
AWS, Amazon S3, Amazon EMR, AWS Glue, Amazon Redshift, Snowflake, Apache Spark, Apache Kafka, Apache Airflow, Talend, dbt, Python, SQL, Microsoft SQL Server, PostgreSQL, Amazon Aurora, Amazon DynamoDB, Kubernetes, Docker, Git, CI/CD, Infrastructure as Code, REST APIs, ETL/ELT
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Analytics Manager (Clinical)
Chadds Ford or Wilmington
HybridFull Time
Incyte
IncyteNasdaq: INCY: Develops and manufactures innovative oncology and inflammation medicines.
10+ YOE10+ years in data engineering/analytics with leadership experience; strong MS Fabric/Power BI; clinical development operations domain knowledge.
Microsoft Fabric, Databricks, PySpark, Power BI, Azure DevOps, GitHub, CI/CD
Job PostingView all
2mo
Save
Mark Applied
Hide
Machine Learning Engineer, Specialist
Malvern, Pennsylvania, United States
HybridFull Time
Vanguard
Vanguard: Global investment management and financial services provider.
5+ YOEUndergraduate degree or equivalent experience and 5+ years relevant experience. Requires 3+ years designing AWS ETL pipelines, Python, machine learning frameworks, cloud technologies, NoSQL, and ML lifecycle knowledge.
Python, PySpark, PySQL, AWS, AWS Glue, Amazon SageMaker, Azure, NoSQL, Feature Store, LLMs, GenAI, RAG, Prompt Engineering, Model Evaluation, API
Job PostingView all

Explore Jobs

Expand Your Job Search