HiringCafe
Join our community

43 pyspark data engineer jobs at 28 companies in Allentown, PA

1d
Save
Mark Applied
Hide
Platform Data Engineer - (DataBricks, PySpark, AWS)
West Chester, Pennsylvania, United States
OnsiteFull Time
Comcast
ComcastNASDAQ: CMCSA: Provides global telecommunications, media content, and entertainment services.
5+ YOEBachelor's degree or equivalent experience; 5+ years in data engineering; hands-on AWS, PySpark, and Databricks; ETL/ELT, distributed systems, Airflow/MWAA, Kubernetes, Python, and production platform support.
Amazon Web Services (AWS), PySpark, Databricks, Kafka, Kubernetes, Apache Airflow, Managed Workflows for Apache Airflow (MWAA), Python, Snowflake, Amazon Elastic Kubernetes Service (EKS)
Job PostingView all
2w
Save
Mark Applied
Hide
Sr. Associate, Date Engineer - PySpark
Atlanta or New York City or Philadelphia or Dallas
OnsiteFull Time
KPMG
KPMG: Global professional services network providing audit, tax, and advisory.
5+ YOE5+ Mgmt5+ years leading data science/engineering teams, Master’s degree in CS/DS/Statistics/Engineering, hands-on Python, PySpark, SQL, Databricks, Snowflake, experience with cloud platforms, ability to travel, U.S. work authorization required.
Python, PySpark, SQL, Databricks, Snowflake, Linux, AWS, GCP, Azure, R
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Warehouse Engineer
Malvern, Pennsylvania, United States
OnsiteFull Time
ifm electronic
ifm electronic: Manufactures sensors and control systems for industrial automation.
5+ YOE5+ years data engineering; bachelor's in Computer Science/Data Science/Engineering; Azure data platform; SQL/Python/PySpark; ETL/ELT; DevOps; AI/advanced analytics exposure.
Azure Synapse Analytics, Azure Data Factory, Microsoft Fabric, Azure Data Lake Storage Gen2, Azure SQL Server, SQL, Python, PySpark
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Data Engineer
Philadelphia, Pennsylvania, United States
HybridFull Time
Medical Guardian
Medical Guardian: Provides medical alert systems and emergency monitoring for seniors.
10+ YOE3+ Mgmt10+ years in data or software engineering, 7+ years building production data pipelines, strong Databricks/Spark/PySpark/SQL experience, Azure and streaming expertise, plus leadership and production operations experience.
Databricks, PySpark, Spark SQL, Spark, Python, SQL, Delta Lake, Databricks Workflows, CI/CD, Azure, Azure Event Hubs, Azure Stream Analytics, Azure Service Bus, Azure Data Factory, Azure Functions, ADLS, Azure Cosmos DB, Event Grid
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer, Technology Services
Raritan, New Jersey, United States
$65k-$105k/yr HybridFull Time
Johnson & Johnson
Johnson & JohnsonNYSE: JNJ: Develops and manufactures pharmaceutical drugs and medical devices.
2+ YOEBachelor's degree in a technical field, 2 years professional experience, hands-on data engineering with Python/PySpark/SQL, cloud and data platform experience, strong communication and problem-solving.
Python, PySpark, SQL, Databricks, Microsoft Fabric, Snowflake, AWS Redshift, AWS, Azure, Kubernetes, GitHub Copilot, Claude Code, Microsoft Copilot, Microsoft Power BI, Tableau, Git
Job PostingView all
2w
Save
Mark Applied
Hide
Azure Databricks Data Engineer
Raritan, New Jersey, United States
$100k-$135k/yr OnsiteFull Time
LTIMindtree
LTIMindtreeNational Stock Exchange of India: LTIM: Global technology consulting and digital solutions.
10+ YOERequires 10–12 years of data engineering experience, strong Databricks, Python, PySpark, SQL, Delta Lake, Unity Catalog, ETL/ELT, CI/CD, data governance, and DevOps expertise.
Databricks, Python, PySpark, SQL, Delta Lake, Delta Sharing, Unity Catalog, Structured Streaming, Git, AWS Glue, S3, IAM, Lambda, Azure Data Factory (ADF), Azure Storage, Azure Databricks, Key Vault
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Malvern, Pennsylvania, United States
$120k-$130k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
10+ YOE10+ years experience; bachelor of computer science; strong Python, AWS, Glue ETL, PySpark, Attunity; experience with data lakes, ETL pipelines, IAM, Lambda, CloudFormation; CI/CD and stakeholder collaboration.
Python, Glue ETL, Attunity, PySpark, Amazon S3, IAM, AWS Lambda, AWS CloudFormation, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNew York Stock Exchange: BMY: Develops and distributes innovative medicines for serious diseases.
5+ YOE5+ years data engineering experience with cloud platforms, Databricks (Delta Lake, Unity Catalog), Python, SQL, Spark/PySpark, GenAI/LLM (RAG, embeddings), and building production-grade ETL/ELT pipelines and data products.
Generative AI (GenAI), Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, LLM
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer, Technology Services
Raritan, New Jersey, United States
$65k-$105k/yr HybridFull Time
Johnson & Johnson
Johnson & JohnsonNYSE: JNJ: Provides pharmaceutical products and medical technology healthcare solutions.
2+ YOEBachelor's degree required, 2+ years professional experience, hands-on experience building data pipelines and managing cloud environments; proficiency with Python, PySpark, SQL and data platforms.
Python, PySpark, SQL, Databricks, MS Fabric, Snowflake, AWS Redshift, AWS, Azure, Kubernetes, Github Copilot, MS Copilot, Claude Code, Power BI, Tableau, Git, CICD
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Coopersburg or Philadelphia
OnsiteFull Time
Lutron Electronics
Lutron Electronics: Designs and manufactures lighting and shading control systems.
8+ YOERequired bachelor’s or master’s in CS/Data Science/Computer Engineering/Software Engineering, 8+ years related experience, expertise in data modeling, real-time/batch processing, cloud architectures, and SQL.
AWS, S3, Glue, EKS, Lambda, SageMaker, Redshift, Athena, Bedrock, Agentcore, SQL, NoSQL, Microsoft Power BI, Tableau, QuickSight, Python, Pandas, NumPy, PySpark
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
NBME
NBME: Develops and manages medical licensing and healthcare professional assessments.
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
AWS, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS step functions, Luigi, Pinecone, Milvus, pgvector, Git, CI/CD, Feature Stores, Vector Databases, APIs, MLOps
Job PostingView all
2mo
Save
Mark Applied
Hide
AWS Data Migration Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
Algonomy
Algonomy: AI-powered algorithmic customer engagement platform for retailers.
8+ YOE8+ years software development; experience with Big Data technologies; Scala, PySpark, Python; data pipeline migration, automation, and monitoring; AWS services and Databricks.
Databricks, AWS Glue, EMR, Step Functions, AWS Lambda, PySpark, Hadoop, Scala, Python
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia or Aurora or King of Prussia
$82k-$172k/yr OnsiteFull Time
CACI
CACINYSE: CACI: Provides information technology and professional services to government clients.
5+ YOE5+ years in data engineering/science with TS/SCI clearance; BS in data science/CS; experience building data pipelines and using Python data libraries; experience with git.
Python, NumPy, Pandas, Polars, Git, Docker, Docker Compose, AWS, Spark, PySpark, Linux, CUDA
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Cary or Bridgewater or New York
$120k-$176k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
8+ YOE8+ years data solutions experience with 4+ years in Azure/Databricks; strong SQL, Spark, Scala/Python, Big Data (Hive/HBase), Azure services, ETL/warehousing, CI/CD, data governance, and leadership/mentoring experience.
Microsoft Azure, Microsoft Azure Databricks, Databricks, Apache Spark, SQL, Scala, Python, Hive, HBase, Microsoft Azure Functions, Microsoft Cosmos DB, Microsoft Azure Data Factory, Delta Lake, Shell, Bash, Microsoft PowerShell, Microsoft Event Hub, Oracle, Microsoft SQL Server, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Camden, New Jersey, United States
$105k-$140k/yr OnsiteFull Time
NFI Industries
NFI Industries: A logistics and supply chain providing transportation, warehousing, and fulfillment services.
5+ YOE5+ years data engineering experience, advanced T-SQL, PySpark/Python proficiency, Azure Synapse/ADLS/DevOps experience, ETL/ELT pipeline development, and ability to refactor legacy SQL into modern notebook-based pipelines.
T-SQL, PySpark, Python, Azure Synapse Analytics, Azure Pipeline, Azure Data Lake Storage (ADLS Gen2), Microsoft Fabric, OneLake, Lakehouse, Warehouse, Git, CI/CD, GitHub Copilot, Google Gemini
Job PostingView all
2w
Save
Mark Applied
Hide
Data Solutions Engineer
Cleveland or Cincinnati or Columbus or Philadelphia or Washington or Orlando or Atlanta or Austin or Dallas or Houston or Los Angeles or Seattle
$120k-$165k/yr OnsiteFull Time
BakerHostetler
BakerHostetler: Provides legal counsel and litigation services for corporate clients.
5+ YOEBachelor's in CS/IT,5+ years building data solutions; expertise with Azure data platform, Microsoft Fabric, Power Platform, data modeling, medallion architecture, MDM, DevOps, and strong communication skills.
Azure Data Factory, Azure Data Lake, Azure Data Lake Storage, Azure Synapse Analytics, Azure SQL Database, PostgreSQL, Azure Blob Storage, Azure Databricks, Apache Spark, Apache Airflow, Azure Logic Apps, Azure DevOps, Power Automate, REST API, Azure OpenAI, Document Intelligence, Delta Lake, Microsoft Fabric, Lakehouse, Power Apps, Power BI, Git
Job PostingView all
2mo
Save
Mark Applied
Hide
Manager, Data Engineer (Remote)
Raleigh or Jersey City or New York or White Plains or Washington D.C. or Home Base, PA or Home Base, NY or Raleigh or Home Base, DC or Home Base, NJ or Home Base, VA or Home Base, FL or Home Base, NC
$101k-$174k/yr RemoteFull Time
Arch Capital Group
Arch Capital GroupNASDAQ: ACGL: Global provider of specialty insurance, reinsurance and mortgage insurance.
6+ YOE3+ Mgmt6+ years Python and distributed processing; 2-3+ years technical leadership; Databricks; college degree in CS/Engineering/Math/Data analytics
Python, SQL, PySpark, Apache Spark, Databricks, Snowflake, Azure, Data warehousing, ETL, CI/CD
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Engineer (Philadelphia, PA, US, 19103)
Philadelphia, Pennsylvania, United States
$120k-$150k/yr HybridFull Time
Aramark
AramarkNYSE: ARMK: Provides food and facility management services to diverse organizations.
7+ YOE7+ years in data domain with Python, SQL, Azure/AWS, ETL/ELT, data modeling, Spark, real-time streaming, CI/CD; BS/MS in CS or equivalent experience.
Python, SQL, Azure, AWS, ETL/ELT, Data modeling, Apache Spark, Real-time streaming, CI/CD
Job PostingView all
2w
Save
Mark Applied
Hide
Project Data Engineer 2027 - Lehigh Valley, PA
Coopersburg, Pennsylvania, United States
OnsiteFull Time
Lutron Electronics
Lutron Electronics: A worldwide leader in innovative lighting control and shading solutions investing in technology and employee growth.
0+ YOEBachelor's in related field, minimum cumulative GPA 3.0, 0-3 years related experience, U.S. work authorization without sponsorship, willingness to work on-site 5 days/week.
Python, Pandas, NumPy, PySpark, Amazon S3, AWS Glue, Amazon ECS, AWS Lambda, Amazon SageMaker, Amazon Redshift, Amazon Athena
Job PostingView all

Explore Jobs

Expand Your Job Search