HiringCafe
Join our community

121 spark data engineer jobs at 60 companies in Wheaton, IL

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
1w
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$100k-$115k/yr HybridFull Time
HAVI
HAVI: Optimizing global supply chains for leading foodservice and retail brands.
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Unity Catalog, Databricks Jobs, Delta Live Tables, Azure Data Factory, ADLS Gen2, Key Vault, SQL, Great Expectations, Deequ, Git, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Log Analytics, Photon
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer Lead
Lake Elmo or Chicago or Evansville
$98k-$199k/yr OnsiteFull Time
Old National Bank
Old National BankNASDAQ: ONB: Regional financial services provider offering banking and wealth solutions.
7+ YOE7+ years data engineering experience, strong AWS/cloud and data warehouse background, expertise in SQL, Python, Spark/Databricks, leadership experience, BS in related field preferred.
AWS, S3, Glue, Lambda, Databricks, SQL, Python, Bash, Spark, GitOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer III
Lake Forest or Chicago
$105k-$174k/yr HybridFull Time
Grainger
GraingerNYSE: GWW: Distributes maintenance, repair, and operating supplies to businesses.
3+ YOEBachelor's degree or equivalent, 3+ years data engineering experience with Airflow, Kafka, Spark, Python; experience building scalable data pipelines, Snowflake models, SQL, and cloud tooling (AWS).
AWS, SQL, Python, Docker, Kubernetes, CI/CD, Git, Snowflake, dbt, Apache Airflow, Kafka, Spark, Scala
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr OnsiteFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
5+ YOE5+ years data engineering experience with ETL/ELT, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and experience with terabyte-to-petabyte datasets.
Apache Spark, Databricks, Airflow, SQL, Python, Git, PostgreSQL, SparkSQL, Hive, AWS Glue, Terraform
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
5+ YOE5–8 years data engineering experience with ETL/ELT design, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and Git, experience with PostgreSQL/SparkSQL/Hive/AWS Glue, and ability to mentor engineers.
Apache Spark, Databricks, SQL, Python, Git, Airflow, PostgreSQL, SparkSQL, Hive, AWS Glue, Terraform
Job PostingView all
2w
Save
Mark Applied
Hide
Principal Data Engineer
Chicago or Downers Grove or Alabama or Connecticut or Florida or Georgia or Ohio or Pennsylvania
$112k-$187k/yr HybridFull Time
Kemper
KemperNYSE: KMPR: Provides specialized auto, life, and health insurance services.
10+ YOE10+ years in data engineering/architecture; expert SQL, Python, Snowflake; experience with ETL/ELT, Spark, Kafka, Airflow, DBT, and cloud-native tools (AWS/Azure); proven technical leadership and mentoring; experience with data governance, security, and regulated industries; bachelor’s or master’s in related field preferred.
SQL, Python, Snowflake, Spark, Kafka, Airflow, AWS Glue, S3, AWS, Azure, Informatica, IICS, DBT, IDMC, Git, Guidewire, Life/400, Data Vault 2.0, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Charlotte or Chicago or Hartford or Columbus
$101k-$151k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
2+ YOE2+ years relevant experience; Bachelor’s in CS/Engineering/IT/MIS required; experience with R/Python/SQL, Hadoop/Spark, ETL, Linux, Git; familiarity with automation tools and AWS services; strong communication skills.
R, Python, SQL, Hadoop, Spark, XML, JSON, ETL, Linux, Git, GitHub, Autosys, Cron, Airflow, Amazon S3, Amazon EMR, MLOps, Agile
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$148k-$164k/yr HybridFull Time
Sidley Austin
Sidley Austin: Global law firm providing comprehensive legal and regulatory counsel.
5+ YOE5+ years data engineering experience building scalable ETL/ELT and streaming pipelines; strong Python, SQL, Apache Spark; experience with cloud data platforms and Databricks; bachelor's in CS/Engineering/Data Science or related.
Azure Databricks, Apache Spark, Delta Lake, Azure Data Lake Storage (ADLS Gen2), Python, SQL, Scala, Databricks SQL, Unity Catalog, Databricks Workflows (Jobs), Databricks Notebooks, Azure DevOps, Azure Blob Storage, Azure Key Vault, Azure Data Factory, ERwin Data Modeler, AWS, GCP, PySpark, Spark SQL, CI/CD
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Data Engineer
Chicago, Illinois, United States
$179k-$205k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree and minimum 4 years application development, 2+ years big data, 1+ year cloud; experience with Python/Java/Scala, Spark, data warehouses and distributed systems; strong communication and mentoring skills.
Python, Spark, AWS, Databricks, Snowflake, Airflow, Java, Scala, Redshift, MapReduce, Hadoop, Hive, EMR, Kafka, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, SQL, Microsoft Azure, Google Cloud
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer, Data Foundations
San Francisco or New York City or Chicago
$153k-$180k/yr HybridFull Time
Komodo Health
Komodo Health: Provides AI-driven healthcare data and patient journey analytics software.
Design, implement and scale data pipelines and foundational data systems; experience with Spark, Python, Rust, SQL; leadership experience; healthcare data knowledge beneficial.
Apache Spark, Python, Rust, SQL, Cloud computing, CI/CD
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer / Analyst - USA
New York City or Miami or Mountain View or Los Angeles or Chicago or Seattle or Dallas or United States
$122k-$162k/yr HybridFull Time
Cognify Analytics
Cognify Analytics: Independent analytics firm focused on data-driven solutions.
5+ YOE5–8+ years data engineering/analytics delivery; SQL, Snowflake/Databricks, dbt, Python, Spark; data governance; client collaboration.
Snowflake, Databricks, dbt, Python, Pandas, PySpark, Spark, Airflow, Dagster, Kafka, Kinesis, Tableau, Looker, Power BI, Sigma Computing, SQL, Data Governance, Alation, Atlan, DataHub, Unity Catalog
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Data Engineer (P4519)
Cincinnati or Chicago
$125k-$207k/yr OnsiteFull Time
84.51°
84.51°NYSE: KR: Provides retail data analytics and targeted advertising services.
5+ YOEBachelor's degree, 5+ years professional data development experience, Databricks/Spark and Python experience, ETL and data warehousing knowledge, Kubernetes and REST API development experience, Agile/Scrum familiarity.
Azure, Databricks, Spark, SQL, PySpark, Databricks Workflows, Python, JSON, Kubernetes, REST APIs
Job PostingView all
1d
Save
Mark Applied
Hide
Principal Data Engineer, People Data
Bellevue or Chicago or San Francisco or Washington
$197k-$271k/yr HybridFull Time
Okta
OktaNASDAQ: OKTA: Provide secure identity management and authentication for enterprises.
10+ YOE10+ years data engineering experience; expert SQL, ETL/ELT, MPP databases, AWS services; HR/People data experience; experience with batch and realtime pipelines, lakehouse architectures, and data quality frameworks.
SQL, Airflow, dbt, Snowflake, Redshift, Amazon S3, AWS Lambda, EMR, ECR, EKS, Workday, Spark, Kafka, Databricks, Iceberg, Delta
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer III
Chicago, Illinois, United States
$138k-$173k/yr OnsiteFull Time
McDonald's
McDonald'sNYSE: MCD: Operate and franchise a global chain of quick-service restaurants.
5+ YOE5+ years data engineering experience, Bachelor’s/Master’s in Computer Science or related, strong Python and SQL skills, experience with cloud data platforms, clean room and privacy-safe data practices.
Python, SQL, Apache Airflow, dbt, Spark, NoSQL, BigQuery, Snowflake, Databricks, GCP, AWS S3, LiveRamp, Habu, LiveRamp Connect, AWS Clean Rooms, Snowflake Clean Rooms, Google Ads Data Hub, Amazon Marketing Cloud
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Seattle or Chicago or Los Angeles or New York
$160k-$220k/yr OnsiteFull Time
Metropolis
Metropolis: Computer vision technology for checkout-free parking and retail payments.
5+ YOEBachelor's in CS/Engineering; 5+ years in data engineering; Python; SQL; Snowflake/dbt; AWS; ETL/ELT; on-site 4 days/week.
Python, SQL, Snowflake, dbt, Airflow, MWAA, DMS, EKS, SNS, Glue, AWS, MySQL, MS SQL Server, Postgres, Spark, PySpark, Automic, CI/CD, ETL/ELT
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
Austin or Chicago or New Hartford or Philadelphia
$130k-$144k/yr RemoteFull Time
PAR Technology
PAR TechnologyNYSE: PAR: Provides unified software and hardware for restaurant operations.
5+ YOE5+ years data engineering; project leadership; strong problem-solving; excellent communication; continuous learning; experience with AI/LLM tooling.
Python, SQL, Terraform, Spark, Databricks, Structured Streaming, Postgres, DynamoDB, CircleCI, DroneCI, Github Actions, Spacelift, DataDog, AWS, Azure, data governance, AI/ML integration, Claude Code, Cursor, Copilot, MCP, Agent Orchestrators, Git, Github
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Engineer Lead - Contract
Rolling Meadows, Illinois, United States
$99k-$192k/yr RemoteContract
Arthur J. Gallagher & Co.
Arthur J. Gallagher & Co.NYSE: AJG: Global insurance brokerage and risk management services provider.
7+ YOE3+ MgmtLead data engineering teams; 7+ yrs data engineering; 3+ yrs leading teams; BS in Information Technology; Snowflake, Azure Data Factory, ADLS Gen2, Databricks, Spark, Synapse, SQL Server; scripting (PowerShell, Python, Scala, Java, XML); Data Lake/ETL; CI/CD; agile; strong communication.
Snowflake, Azure Data Factory, ADLS Gen 2, Logic Apps, Azure Functions, Databricks, Apache Spark, Scala, Synapse, SQL Server, PowerShell, Python, Java, XML, Data Lake, Azure Data Lake Storage, CI/CD, Infrastructure as Code
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Chicago or Edina
$102k-$179k/yr OnsiteFull Time
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Azure Databricks, PySpark, Spark, Spark SQL, Delta Lake, Delta Live Tables, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Databricks notebooks, Azure DevOps, Git, CI/CD, Pulumi, Apache Iceberg, AKS, Kubernetes, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Edina or Chicago
$102k-$179k/yr OnsiteFull Time
Vizient
Vizient: Healthcare performance improvement and group purchasing organization.
5+ YOE5+ years data engineering experience; strong experience with Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Azure DevOps/Git and CI/CD; experience with metadata, governance, and enterprise-scale analytical platforms; US work authorization required.
Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Delta Live Tables, Spark, Databricks notebooks, Azure DevOps, Git, CI/CD, Infrastructure as Code (IaC), Pulumi, Apache Iceberg, AKS/Kubernetes, SQL
Job PostingView all
4d
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$145k-$223k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
8+ YOEBachelor's degree in CS or related,8+ years relevant experience building data platforms,experience with data warehouse, big data, ETL, cloud, AI/ML lifecycle, and delivering production systems.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, HDFS, Elastic Search, Oracle, SQL Server, IBM Infosphere, AppDynamics, Kubernetes
Job PostingView all

Explore Jobs

Expand Your Job Search