HiringCafe
Join our community

69 spark data engineer jobs at 51 companies in Pennsylvania

2mo
Save
Mark Applied
Hide
Kafka/Spark Developer
Pittsburgh, Pennsylvania, United States
$71k-$157k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years in big data development with hands-on Kafka, Spark, Hadoop, Impala, strong Java/Scala/Python skills, SQL proficiency, and experience in Agile teams.
Apache Kafka, Apache Spark, Hadoop Ecosystem (HDFS), Impala, PySpark, Scala, Java, Kafka Connect, Schema Registry, Hive, Oracle, PostgreSQL, Python, SQL, Neo4j
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Data Engineer
Philadelphia, Pennsylvania, United States
HybridFull Time
Medical Guardian
Medical Guardian: Provides medical alert systems and emergency monitoring for seniors.
10+ YOE3+ Mgmt10+ years in data or software engineering, 7+ years building production data pipelines, strong Databricks/Spark/PySpark/SQL experience, Azure and streaming expertise, plus leadership and production operations experience.
Databricks, PySpark, Spark SQL, Spark, Python, SQL, Delta Lake, Databricks Workflows, CI/CD, Azure, Azure Event Hubs, Azure Stream Analytics, Azure Service Bus, Azure Data Factory, Azure Functions, ADLS, Azure Cosmos DB, Event Grid
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
Susquehanna International Group
Susquehanna International Group: Global quantitative trading firm providing proprietary financial market liquidity.
5+ YOE5+ years data engineering experience in large-scale distributed processing; strong Python; experience with Spark/Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka; capital markets domain experience.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteFull Time
Susquehanna International Group
Susquehanna International Group: Global quantitative trading firm specializing in proprietary financial markets.
5+ YOE5+ years data engineering experience, capital markets domain knowledge, strong Python skills, experience with Spark/Databricks/Trino/Snowflake/Kafka and large-scale batch/stream processing, ability to support off-hours/weekend needs.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
Job PostingView all
2d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
Marsh McLennan
Marsh McLennanNYSE: MRSH: Global professional services firm providing risk, strategy, and people solutions.
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
K&L Gates
K&L Gates: Global law firm providing comprehensive legal and regulatory counsel.
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Arizona or California or Colorado or Connecticut or District of Columbia or Delaware or Florida or Georgia or Illinois or Indiana or Kentucky or Louisiana or Massachusetts or Maine or Maryland or Michigan or Minnesota or Missouri or North Carolina or New Jersey or New York or Oregon or Pennsylvania or South Carolina or Tennessee or Texas or Virginia or Wisconsin
$130k-$150k/yr RemoteFull Time
MissionWired
MissionWired: Providing digital fundraising and data-driven marketing for nonprofit organizations.
5+ YOE5+ years professional software engineering experience; hands-on Apache Spark and distributed data pipelines; experience managing data warehouses or lakes; mentoring and guiding technical decisions; strong data modeling and production skills.
Apache Spark, AWS, GitHub Actions, Terraform, Docker
Job PostingView all
5d
Save
Mark Applied
Hide
Data Engineer, (Consultant, Data & Analytics)
Baltimore or Alabama or California or Delaware or District of Columbia or Florida or Georgia or Maryland or New Jersey or New York or North Carolina or Pennsylvania or South Carolina or Tennessee or Texas or Virginia or West Virginia
$96k-$162k/yr RemoteFull Time
Fearless
Fearless: Digital services firm delivering IT solutions for government agencies.
4+ YOERequires 4+ years in data engineering or related roles, bachelor's degree or equivalent, Python, SQL, Spark, ETL/ELT, data modeling, cloud ecosystems, databases, Agile experience, and ability to obtain Public Trust clearance.
Python, SQL, PySpark, Databricks, Azure, AWS, GCP, NLP, Postgres, MySQL, MongoDB, Cassandra, LangChain, Electronic Medical Records (EMR)
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
Perpay
Perpay: Financial platform offering interest-free shopping and credit building via payroll.
2+ YOEMinimum 2 years of production data engineering experience; proficient in Python and SQL; experience with AWS, Redshift, ETL tools; able to design data pipelines and collaborate across teams.
AWS, Redshift, Glue, Fivetran, Airflow, ECS, DMS, DataHub, Terraform, Python, SQL, Spark
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer
Lititz, Pennsylvania, United States
OnsiteFull Time
TAIT
TAIT: Designs and manufactures staging, automation, and show control systems.
7+ YOE7+ years data engineering experience delivering Databricks on AWS solutions; strong SQL and Python/PySpark; experience with data pipelines, lakehouse patterns, governance, CI/CD, and production support.
Databricks, AWS, S3, IAM, KMS, VPC, Secrets Manager, CloudWatch, Delta Lake, Spark, SQL, Python, PySpark, Git, CI/CD, Power BI, Unity Catalog, MuleSoft, Salesforce, Epicor, Kantata
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
Plano or Scottsdale or Wilkes Barre or New York City
$100k-$140k/yr HybridFull Time
Berkshire Hathaway GUARD Insurance Companies
Berkshire Hathaway GUARD Insurance Companies: Provides property and casualty insurance products to small businesses.
5+ YOE5+ years data engineering experience, degree in CS/IT, strong SQL and Python, data modeling, lakehouse and cloud experience (Azure/MS Fabric preferred), Power BI and Azure DevOps familiarity.
Power BI, Microsoft Fabric, Azure DevOps (ADO), SQL, Python, Databricks, Snowflake, AWS, Azure, Tableau, Spark, Scala
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Florida or Montana or Michigan or Massachusetts or Rhode Island or West Virginia or Oregon or Oklahoma or Minnesota or New York or South Carolina or Kentucky or Virginia or Colorado or New Jersey or Wisconsin or Utah or Pennsylvania or Ohio or North Carolina or Nebraska or Mississippi or South Dakota or Maryland or Louisiana or Kansas or Iowa or Illinois or Tennessee or Delaware or Connecticut or California or Hawaii or Arkansas or District of Columbia or Georgia or Missouri or Arizona or Alabama or New Hampshire or Texas or Vermont or Indiana or Washington or Nevada or Idaho or New Mexico or Maine
$143k-$160k/yr RemoteFull Time
AmeriLife
AmeriLife: Distributes insurance, annuities, and retirement solutions for retirees.
7+ YOE7+ years data engineering experience with 3+ years Databricks; strong Spark/PySpark, Delta Lake, SQL, Azure, Git and CI/CD skills; Bachelor's degree required.
Databricks, Apache Spark, Delta Lake, Unity Catalog, Workflows, SQL Warehouses, Delta Live Tables, PySpark, SQL, Azure, Git, dbt, Terraform, Azure DevOps
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia, Pennsylvania, United States
$68k-$153k/yr OnsiteFull Time
Universal Music Group
Universal Music GroupEuronext Amsterdam: UMG: Global music recording, publishing, merchandising, and content production.
5+ YOE5+ years data engineering experience building scalable pipelines, ecommerce/Shopify data expertise, strong SQL and Python, cloud and modern data platform experience, semantic layer and AI/ML data readiness skills.
Shopify, dbt, LookML, Spark, Snowflake, Databricks, BigQuery, Redshift, Parquet, SQL, Python, AWS, Azure, GCP
Job PostingView all
4d
Save
Mark Applied
Hide
Data Engineer, Senior
Pittsburgh, Pennsylvania, United States
$54-$88/hr HybridFull Time
UPMC
UPMC: Integrated health system providing clinical care and medical insurance.
7+ YOERequires 7+ years of relevant experience, healthcare IT data proficiency, advanced analytics, technical writing, and expertise with Java, Python, Spark, Kubernetes, ETL, AWS, and healthcare data standards.
Java, Python, Apache Spark, Kubernetes, OMOP CDM, Microsoft Fabric, AWS Lambda, Amazon S3, AWS Glue, HL7, CDA, CCDA, FHIR, ETL, SDLC, Scrum
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
Austin or Chicago or New Hartford or Philadelphia
$130k-$144k/yr RemoteFull Time
PAR Technology
PAR TechnologyNYSE: PAR: Provides unified software and hardware for restaurant operations.
5+ YOE5+ years data engineering; project leadership; strong problem-solving; excellent communication; continuous learning; experience with AI/LLM tooling.
Python, SQL, Terraform, Spark, Databricks, Structured Streaming, Postgres, DynamoDB, CircleCI, DroneCI, Github Actions, Spacelift, DataDog, AWS, Azure, data governance, AI/ML integration, Claude Code, Cursor, Copilot, MCP, Agent Orchestrators, Git, Github
Job PostingView all
5d
Save
Mark Applied
Hide
Big Data Engineer
Pittsburgh or Cleveland or Dallas
$100k-$130k/yr HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
7+ YOERequires 7–10 years of data engineering experience, strong Python and Apache Spark skills, Hadoop ecosystem expertise, CA7 or Control-M experience, SQL knowledge, and technical leadership and mentoring experience.
Python, Hadoop, Hive, Impala, HDFS, Apache Spark, CA7, Control-M, SQL, Shell Scripting
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia or Aurora or King of Prussia
$82k-$172k/yr OnsiteFull Time
CACI
CACINYSE: CACI: Provides information technology and professional services to government clients.
5+ YOE5+ years in data engineering/science with TS/SCI clearance; BS in data science/CS; experience building data pipelines and using Python data libraries; experience with git.
Python, NumPy, Pandas, Polars, Git, Docker, Docker Compose, AWS, Spark, PySpark, Linux, CUDA
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Bala Cynwyd, Pennsylvania, United States
OnsiteContract
Susquehanna International Group
Susquehanna International Group: Global quantitative trading and market making firm.
5+ YOE5+ years in data engineering with strong Python and experience with modern data platforms (Spark, Databricks, Trino, Iceberg, Snowflake, Kafka); capital markets/financial services experience required.
Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Vice President, Data Pipeline Engineer – Ontology & Investment Data Standard (IDS)
Pittsburgh or Lake Mary
$104k-$200k/yr OnsiteFull Time
BNY
BNYNYSE: BK: Global institution managing and servicing financial assets worldwide.
6+ YOEBachelor's degree or equivalent; 6+ years data engineering/BI experience; Python, Spark, SQL; ETL/ELT; cloud (Snowflake/AWS/Databricks); knowledge graph/ontology experience preferred; strong data modeling and lineage; financial data domain familiarity.
Python, Spark, SQL, ETL/ELT, Snowflake, AWS, Databricks
Job PostingView all
6d
Save
Mark Applied
Hide
Data Engineer
Mechanicsburg or Yorktown
OnsiteFull Time
Entarian
Entarian: Provides mission-critical engineering and technology solutions for government agencies.
10+ YOERequires Secret clearance, U.S. citizenship, Security+ and cloud or database certification, degree or equivalent experience, and 10+ years relevant experience; requires data warehousing, ETL, PostgreSQL, SQL, Oracle migration, modeling, and optimization expertise.
AWS GovCloud, Pentaho, PostgreSQL, SQL, Oracle PL/SQL, Amazon Aurora DB, MySQL, GitLab, Liquibase, CI/CD, Apache Hadoop, Spark, Kafka, Debezium, RabbitMQ, AWS, Azure, GCP, AWS RDS, RedShift, MicroStrategy, Erwin Data Modeler, Python, Java, Scala, Go
Job PostingView all

Explore Jobs

Expand Your Job Search