118 spark data engineer jobs at 61 companies in Berkeley, IL

3w
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$100k-$115k/yr HybridFull Time
HAVI
HAVI: Optimizing global supply chains for leading foodservice and retail brands.
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Unity Catalog, Databricks Jobs, Delta Live Tables, Azure Data Factory, ADLS Gen2, Key Vault, SQL, Great Expectations, Deequ, Git, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Log Analytics, Photon
1w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$110k-$125k/yr OnsiteFull Time
fairlife
fairlifeNYSE: KO: Produces nutrient-dense and ultra-filtered dairy products and shakes.
5+ YOEBachelor's degree and 5+ years data engineering experience, expert SQL and strong Python, Spark/PySpark, Azure data services, Azure DevOps, dimensional modeling, and manufacturing data experience preferred.
SQL, Python, Spark, PySpark, Azure SQL databases, Event Hubs, Functions, Data Factory, Key Vault, Microsoft Entra, Azure DevOps, Git, YAML, Delta Lake, Fabric, Databricks, KQL, Eventhouse, Application Insights, MCP, IIoT, MES
4w
Save
Mark Applied
Hide
Data Engineer Lead
Lake Elmo or Chicago or Evansville
$98k-$199k/yr OnsiteFull Time
Old National Bank
Old National BankNASDAQ: ONB: Regional financial services provider offering banking and wealth solutions.
7+ YOE7+ years data engineering experience, strong AWS/cloud and data warehouse background, expertise in SQL, Python, Spark/Databricks, leadership experience, BS in related field preferred.
AWS, S3, Glue, Lambda, Databricks, SQL, Python, Bash, Spark, GitOps
3w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr OnsiteFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
5+ YOE5+ years data engineering experience with ETL/ELT, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and experience with terabyte-to-petabyte datasets.
Apache Spark, Databricks, Airflow, SQL, Python, Git, PostgreSQL, SparkSQL, Hive, AWS Glue, Terraform
3w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
5+ YOE5–8 years data engineering experience with ETL/ELT design, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and Git, experience with PostgreSQL/SparkSQL/Hive/AWS Glue, and ability to mentor engineers.
Apache Spark, Databricks, SQL, Python, Git, Airflow, PostgreSQL, SparkSQL, Hive, AWS Glue, Terraform
1mo
Save
Mark Applied
Hide
Data Engineer
Charlotte or Chicago or Hartford or Columbus
$101k-$151k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
2+ YOE2+ years relevant experience; Bachelor’s in CS/Engineering/IT/MIS required; experience with R/Python/SQL, Hadoop/Spark, ETL, Linux, Git; familiarity with automation tools and AWS services; strong communication skills.
R, Python, SQL, Hadoop, Spark, XML, JSON, ETL, Linux, Git, GitHub, Autosys, Cron, Airflow, Amazon S3, Amazon EMR, MLOps, Agile
3w
Save
Mark Applied
Hide
Lead Data Engineer
Chicago, Illinois, United States
$179k-$205k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree and minimum 4 years application development, 2+ years big data, 1+ year cloud; experience with Python/Java/Scala, Spark, data warehouses and distributed systems; strong communication and mentoring skills.
Python, Spark, AWS, Databricks, Snowflake, Airflow, Java, Scala, Redshift, MapReduce, Hadoop, Hive, EMR, Kafka, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, SQL, Microsoft Azure, Google Cloud
3mo
Save
Mark Applied
Hide
Senior Data Engineer, Data Foundations
San Francisco or New York City or Chicago
$153k-$180k/yr HybridFull Time
Komodo Health
Komodo Health: Provides AI-driven healthcare data and patient journey analytics software.
Design, implement and scale data pipelines and foundational data systems; experience with Spark, Python, Rust, SQL; leadership experience; healthcare data knowledge beneficial.
Apache Spark, Python, Rust, SQL, Cloud computing, CI/CD
6d
Save
Mark Applied
Hide
Senior Data Engineer
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
3mo
Save
Mark Applied
Hide
Senior Data Engineer / Analyst - USA
New York City or Miami or Mountain View or Los Angeles or Chicago or Seattle or Dallas or United States
$122k-$162k/yr HybridFull Time
Cognify Analytics
Cognify Analytics: Independent analytics firm focused on data-driven solutions.
5+ YOE5–8+ years data engineering/analytics delivery; SQL, Snowflake/Databricks, dbt, Python, Spark; data governance; client collaboration.
Snowflake, Databricks, dbt, Python, Pandas, PySpark, Spark, Airflow, Dagster, Kafka, Kinesis, Tableau, Looker, Power BI, Sigma Computing, SQL, Data Governance, Alation, Atlan, DataHub, Unity Catalog
3w
Save
Mark Applied
Hide
Senior Data Engineer (P1692)
Cincinnati or Chicago
$98k-$169k/yr OnsiteFull Time
84.51°
84.51°NYSE: KR: Provides retail data analytics and targeted advertising services.
3+ YOE3+ years data development experience with Databricks, PySpark/Spark, Python or Java, SQL/JSON, ETL and data warehousing knowledge; experience with CI/CD, pipeline orchestration, version control, and Agile.
Python, Databricks, Spark, JSON, SQL, PySpark, Java, Azure, Databricks Delta Tables, Delta Lake, Delta Live Tables, FastAPI, Flask, AKS, Kubernetes, Helm, Kafka, Azure Event Hub, Github SaaS, Github Actions, Terraform, Tableau, Power BI, Cognos
1w
Save
Mark Applied
Hide
Principal Data Engineer, People Data
Bellevue or Chicago or San Francisco or Washington
$197k-$271k/yr HybridFull Time
Okta
OktaNASDAQ: OKTA: Provide secure identity management and authentication for enterprises.
10+ YOE10+ years data engineering experience; expert SQL, ETL/ELT, MPP databases, AWS services; HR/People data experience; experience with batch and realtime pipelines, lakehouse architectures, and data quality frameworks.
SQL, Airflow, dbt, Snowflake, Redshift, Amazon S3, AWS Lambda, EMR, ECR, EKS, Workday, Spark, Kafka, Databricks, Iceberg, Delta
3w
Save
Mark Applied
Hide
Data Engineer III
Chicago, Illinois, United States
$138k-$173k/yr OnsiteFull Time
McDonald's
McDonald'sNYSE: MCD: Operate and franchise a global chain of quick-service restaurants.
5+ YOE5+ years data engineering experience, Bachelor’s/Master’s in Computer Science or related, strong Python and SQL skills, experience with cloud data platforms, clean room and privacy-safe data practices.
Python, SQL, Apache Airflow, dbt, Spark, NoSQL, BigQuery, Snowflake, Databricks, GCP, AWS S3, LiveRamp, Habu, LiveRamp Connect, AWS Clean Rooms, Snowflake Clean Rooms, Google Ads Data Hub, Amazon Marketing Cloud
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Seattle or Chicago or Los Angeles or New York
$160k-$220k/yr OnsiteFull Time
Metropolis
Metropolis: Computer vision technology for checkout-free parking and retail payments.
5+ YOEBachelor's in CS/Engineering; 5+ years in data engineering; Python; SQL; Snowflake/dbt; AWS; ETL/ELT; on-site 4 days/week.
Python, SQL, Snowflake, dbt, Airflow, MWAA, DMS, EKS, SNS, Glue, AWS, MySQL, MS SQL Server, Postgres, Spark, PySpark, Automic, CI/CD, ETL/ELT
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
Austin or Chicago or New Hartford or Philadelphia
$130k-$144k/yr RemoteFull Time
PAR Technology
PAR TechnologyNYSE: PAR: Provides unified software and hardware for restaurant operations.
5+ YOE5+ years data engineering; project leadership; strong problem-solving; excellent communication; continuous learning; experience with AI/LLM tooling.
Python, SQL, Terraform, Spark, Databricks, Structured Streaming, Postgres, DynamoDB, CircleCI, DroneCI, Github Actions, Spacelift, DataDog, AWS, Azure, data governance, AI/ML integration, Claude Code, Cursor, Copilot, MCP, Agent Orchestrators, Git, Github
3mo
Save
Mark Applied
Hide
Data Engineer Lead - Contract
Rolling Meadows, Illinois, United States
$99k-$192k/yr RemoteContract
Arthur J. Gallagher & Co.
Arthur J. Gallagher & Co.NYSE: AJG: Global insurance brokerage and risk management services provider.
7+ YOE3+ MgmtLead data engineering teams; 7+ yrs data engineering; 3+ yrs leading teams; BS in Information Technology; Snowflake, Azure Data Factory, ADLS Gen2, Databricks, Spark, Synapse, SQL Server; scripting (PowerShell, Python, Scala, Java, XML); Data Lake/ETL; CI/CD; agile; strong communication.
Snowflake, Azure Data Factory, ADLS Gen 2, Logic Apps, Azure Functions, Databricks, Apache Spark, Scala, Synapse, SQL Server, PowerShell, Python, Java, XML, Data Lake, Azure Data Lake Storage, CI/CD, Infrastructure as Code
3mo
Save
Mark Applied
Hide
Senior Data Engineer (Chicago- Hybrid)
Chicago, Illinois, United States
$135k-$170k/yr RemoteFull Time
Hyatt
HyattNYSE: H: Global hospitality providing luxury hotel and resort accommodations.
8+ YOE8+ years data engineering; building scalable data pipelines; ETL/ELT; data warehousing; AWS; SQL/NoSQL; BI tools.
AWS, Spark, Airflow, SQL, NoSQL, ETL/ELT, Redshift, S3, Glue, Kinesis, Lake Formation, CloudWatch, CloudTrail, Tableau, BI tools, Informatica IICS, Snowflake, Kafka
1mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Chicago or Edina
$102k-$179k/yr OnsiteFull Time
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Azure Databricks, PySpark, Spark, Spark SQL, Delta Lake, Delta Live Tables, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Databricks notebooks, Azure DevOps, Git, CI/CD, Pulumi, Apache Iceberg, AKS, Kubernetes, SQL
2d
Save
Mark Applied
Hide
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yr RemoteFull Time
SentiLink
SentiLink: Provides identity verification and fraud prevention for financial institutions.
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Python, Golang, PostgreSQL (RDS), OpenSearch, Redshift, EMR, Spark, Docker, Lambda, AWS, EKS, SQS, SNS, S3, Kubernetes, Hadoop, Kafka, Microsoft Azure, GCP
3w
Save
Mark Applied
Hide
Data Quality Engineer
Alpharetta or Birmingham or Chicago or Downers Grove or Jacksonville or Connecticut or New Jersey or Ohio or Pennsylvania or Rhode Island or Virginia
$99k-$165k/yr HybridFull Time
Kemper
KemperNYSE: KMPR: Provides specialized auto, life, and health insurance services.
6+ YOE6+ years data engineering/testing experience; Bachelor's in CS/Info Systems or equivalent; expertise with SQL, Informatica/IICS/IDMC, Snowflake, Oracle, AWS, Python; strong data validation, reconciliation, and test automation skills.
SQL, Informatica, IICS, IDMC, Snowflake, Python, Oracle, AWS, XML, JSON, Power BI, PowerShell, Git, Spark, Kafka, Airflow, DBT, CI/CD, Infrastructure as Code