HiringCafe
Join our community

51 spark data engineer jobs at 35 companies in Bethlehem, PA

1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or Foster City or Orange County or Morristown
RemoteFull Time
Bridgepointe Technologies
Bridgepointe Technologies: Vendor-agnostic IT strategy and technology procurement services.
5+ YOERequires 5+ years in data engineering, advanced SQL, Python, Spark/PySpark, Microsoft Fabric, Azure data services, APIs, data modeling, CI/CD, Git, and Azure DevOps; bachelor's degree or equivalent experience.
Microsoft Fabric, Lakehouse, Warehouse, Data Pipelines, Notebooks, OneLake, Git, Azure DevOps, Spark, PySpark, SQL, Python, Azure, Delta Lake, Parquet, REST APIs, JSON, Power BI, DP-600, DP-700
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNYSE: BMY: Develops and manufactures innovative prescription biopharmaceutical medicines.
5+ YOE5+ years data engineering experience with Databricks, cloud-native data platforms, Python/SQL/Spark, GenAI/LLM experience, data pipeline and governance expertise for clinical/cross-study data.
Generative AI, Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, vector embeddings
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Data Engineer
Philadelphia, Pennsylvania, United States
HybridFull Time
Medical Guardian
Medical Guardian: Provides medical alert systems and emergency monitoring for seniors.
10+ YOE3+ Mgmt10+ years in data or software engineering, 7+ years building production data pipelines, strong Databricks/Spark/PySpark/SQL experience, Azure and streaming expertise, plus leadership and production operations experience.
Databricks, PySpark, Spark SQL, Spark, Python, SQL, Delta Lake, Databricks Workflows, CI/CD, Azure, Azure Event Hubs, Azure Stream Analytics, Azure Service Bus, Azure Data Factory, Azure Functions, ADLS, Azure Cosmos DB, Event Grid
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
Susquehanna International Group
Susquehanna International Group: Global quantitative trading firm providing proprietary financial market liquidity.
5+ YOE5+ years data engineering experience in large-scale distributed processing; strong Python; experience with Spark/Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka; capital markets domain experience.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteFull Time
Susquehanna International Group
Susquehanna International Group: Global quantitative trading firm specializing in proprietary financial markets.
5+ YOE5+ years data engineering experience, capital markets domain knowledge, strong Python skills, experience with Spark/Databricks/Trino/Snowflake/Kafka and large-scale batch/stream processing, ability to support off-hours/weekend needs.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNew York Stock Exchange: BMY: Develops and distributes innovative medicines for serious diseases.
5+ YOE5+ years data engineering experience with cloud platforms, Databricks (Delta Lake, Unity Catalog), Python, SQL, Spark/PySpark, GenAI/LLM (RAG, embeddings), and building production-grade ETL/ELT pipelines and data products.
Generative AI (GenAI), Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, LLM
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
Perpay
Perpay: Financial platform offering interest-free shopping and credit building via payroll.
2+ YOEMinimum 2 years of production data engineering experience; proficient in Python and SQL; experience with AWS, Redshift, ETL tools; able to design data pipelines and collaborate across teams.
AWS, Redshift, Glue, Fivetran, Airflow, ECS, DMS, DataHub, Terraform, Python, SQL, Spark
Job PostingView all
3d
Save
Mark Applied
Hide
Security Data Solutions Engineer
Quincy or Princeton or Irvine or Boston or Austin or Sacramento
$120k-$203k/yr HybridFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
8+ YOEDesign and implement enterprise security telemetry and data products; 8+ years in cybersecurity/data engineering; strong Python, SQL, Spark, Databricks, Snowflake, SIEM experience; product management skills.
Splunk, Microsoft Sentinel, QRadar, Elastic, Chronicle, Databricks, Snowflake, Kafka, Spark, Cribl, OpenTelemetry, FluentBit, Python, SQL, AWS, Azure, Google Cloud
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia, Pennsylvania, United States
$68k-$153k/yr OnsiteFull Time
Universal Music Group
Universal Music GroupEuronext Amsterdam: UMG: Global music recording, publishing, merchandising, and content production.
5+ YOE5+ years data engineering experience building scalable pipelines, ecommerce/Shopify data expertise, strong SQL and Python, cloud and modern data platform experience, semantic layer and AI/ML data readiness skills.
Shopify, dbt, LookML, Spark, Snowflake, Databricks, BigQuery, Redshift, Parquet, SQL, Python, AWS, Azure, GCP
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer
Princeton, New Jersey, United States
$100k-$120k/yr HybridFull Time
CURE Auto Insurance
CURE Auto Insurance: Provides automobile insurance based primarily on individual driving records.
3+ YOEDesign, build, and maintain data pipelines; integrate core insurance data; ensure data quality and governance; develop data lake/warehouse.
Python, SQL, Snowflake, BigQuery, Redshift, Databricks, Spark, dbt, Great Expectations, Kafka, Kinesis, Debezium, Fivetran, HVR
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Cary or Bridgewater or New York
$120k-$176k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
8+ YOE8+ years data solutions experience with 4+ years in Azure/Databricks; strong SQL, Spark, Scala/Python, Big Data (Hive/HBase), Azure services, ETL/warehousing, CI/CD, data governance, and leadership/mentoring experience.
Microsoft Azure, Microsoft Azure Databricks, Databricks, Apache Spark, SQL, Scala, Python, Hive, HBase, Microsoft Azure Functions, Microsoft Cosmos DB, Microsoft Azure Data Factory, Delta Lake, Shell, Bash, Microsoft PowerShell, Microsoft Event Hub, Oracle, Microsoft SQL Server, CI/CD
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
Austin or Chicago or New Hartford or Philadelphia
$130k-$144k/yr RemoteFull Time
PAR Technology
PAR TechnologyNYSE: PAR: Provides unified software and hardware for restaurant operations.
5+ YOE5+ years data engineering; project leadership; strong problem-solving; excellent communication; continuous learning; experience with AI/LLM tooling.
Python, SQL, Terraform, Spark, Databricks, Structured Streaming, Postgres, DynamoDB, CircleCI, DroneCI, Github Actions, Spacelift, DataDog, AWS, Azure, data governance, AI/ML integration, Claude Code, Cursor, Copilot, MCP, Agent Orchestrators, Git, Github
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia or Aurora or King of Prussia
$82k-$172k/yr OnsiteFull Time
CACI
CACINYSE: CACI: Provides information technology and professional services to government clients.
5+ YOE5+ years in data engineering/science with TS/SCI clearance; BS in data science/CS; experience building data pipelines and using Python data libraries; experience with git.
Python, NumPy, Pandas, Polars, Git, Docker, Docker Compose, AWS, Spark, PySpark, Linux, CUDA
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
Susquehanna International Group
Susquehanna International Group: Global quantitative trading and market making firm.
5+ YOE5+ years in data engineering with strong Python and experience with modern data platforms (Spark, Databricks, Trino, Iceberg, Snowflake, Kafka); capital markets/financial services experience required.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
Job PostingView all
1mo
Save
Mark Applied
Hide
AVP, Lead Data Engineer
Philadelphia or Jersey City or Simsbury
$153k-$221k/yr OnsiteFull Time
Chubb
ChubbNYSE: CB: Provides property, casualty, and life insurance and reinsurance services globally.
12+ YOEBachelor's degree required; 12+ years data engineering with ETL/ELT, data warehouse design, and automated pipelines. Expertise in Informatica/IICS, Azure (Synapse, ADF, Databricks), Snowflake, Databricks, Autosys, Python/Shell. Must be based in NJ or Greater Philadelphia.
Informatica, IICS, Azure, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks, Delta Lake, Spark, Snowflake, Snowpark, Autosys, Python, Shell
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
King of Prussia or Aurora
$82k-$172k/yr OnsiteFull Time
CACI International
CACI InternationalNYSE: CACI: Provides information technology and engineering services for government agencies.
5+ YOEActive TS/SCI clearance, B.S. in Data Science/AI/CS or related, 5+ years experience, building data pipelines using Python (NumPy, Pandas, Polars), version control (git/GitLab/Bitbucket), and contributing to AI/ML solutions.
NumPy, Pandas, Polars, Python, git, GitLab, Bitbucket, Docker, Docker Compose, AWS, Spark, PySpark, Gymnasium, OpenEnv, TorchRL, RLlib, Stable Baselines, LangFuse, MLFlow, Arize Phoenix, HuggingFace, LangChain, Linux, EC2, S3, Lambda, Bedrock, Java, C++, Rust, Go, C#, CUDA, Podman, Kubernetes, Rancher
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Engineer (Philadelphia, PA, US, 19103)
Philadelphia, Pennsylvania, United States
$120k-$150k/yr HybridFull Time
Aramark
AramarkNYSE: ARMK: Provides food and facility management services to diverse organizations.
7+ YOE7+ years in data domain with Python, SQL, Azure/AWS, ETL/ELT, data modeling, Spark, real-time streaming, CI/CD; BS/MS in CS or equivalent experience.
Python, SQL, Azure, AWS, ETL/ELT, Data modeling, Apache Spark, Real-time streaming, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
NBME
NBME: Develops and manages medical licensing and healthcare professional assessments.
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
AWS, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS step functions, Luigi, Pinecone, Milvus, pgvector, Git, CI/CD, Feature Stores, Vector Databases, APIs, MLOps
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Management Professional - Data Engineering - Entities
Princeton, New Jersey, United States
$110k-$190k/yr OnsiteFull Time
Bloomberg
Bloomberg: Delivers financial data, news, and software to global markets.
4+ YOEBachelor's or Master's (or equivalent),4+ years in data engineering/automation or document processing, experience with entity/reference financial data, strong SQL, Python/Java/Scala, Spark/Airflow/Kafka, data governance and lineage.
Python, Java, Scala, Spark, Airflow, Kafka, SQL, LLM, OCR, NLP, AWS, Azure, Git, CI/CD, S3, EMR, Glue, ADLS, Data Factory, Databricks, Monte Carlo, OpenLineage, DCAM, DAMA-DMBOK
Job PostingView all
2mo
Save
Mark Applied
Hide
Analytics Engineer, Data Science
Chicago or Austin or Baltimore or Denver or Boulder or Hartford or New Haven or Philadelphia or Providence or Miami
$118k-$173k/yr HybridFull Time
DoorDash
DoorDashNASDAQ: DASH: On-demand delivery platform connecting consumers with local merchants.
2+ YOE2-6+ years in BI/analytics/data engineering; SQL; Python/Scala; Looker/Tableau/Sigma; database fundamentals; data quality checks; strong communication; fast-paced; self-starter.
SQL, Python, Scala, Looker, Tableau, Sigma, S3, Hive, Spark, Pydeequ, Great Expectations
Job PostingView all

Explore Jobs

Expand Your Job Search