121 spark data engineer jobs at 60 companies in Wheeling, IL
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
HAVI: Optimizing global supply chains for leading foodservice and retail brands.
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Old National BankNASDAQ: ONB: Regional financial services provider offering banking and wealth solutions.
7+ YOE7+ years data engineering experience, strong AWS/cloud and data warehouse background, expertise in SQL, Python, Spark/Databricks, leadership experience, BS in related field preferred.
GraingerNYSE: GWW: Distributes maintenance, repair, and operating supplies to businesses.
3+ YOEBachelor's degree or equivalent, 3+ years data engineering experience with Airflow, Kafka, Spark, Python; experience building scalable data pipelines, Snowflake models, SQL, and cloud tooling (AWS).
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
5+ YOE5+ years data engineering experience with ETL/ELT, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and experience with terabyte-to-petabyte datasets.
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
5+ YOE5–8 years data engineering experience with ETL/ELT design, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and Git, experience with PostgreSQL/SparkSQL/Hive/AWS Glue, and ability to mentor engineers.
Chicago or Downers Grove or Alabama or Connecticut or Florida or Georgia or Ohio or Pennsylvania
$112k-$187k/yrHybridFull Time
KemperNYSE: KMPR: Provides specialized auto, life, and health insurance services.
10+ YOE10+ years in data engineering/architecture; expert SQL, Python, Snowflake; experience with ETL/ELT, Spark, Kafka, Airflow, DBT, and cloud-native tools (AWS/Azure); proven technical leadership and mentoring; experience with data governance, security, and regulated industries; bachelor’s or master’s in related field preferred.
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
2+ YOE2+ years relevant experience; Bachelor’s in CS/Engineering/IT/MIS required; experience with R/Python/SQL, Hadoop/Spark, ETL, Linux, Git; familiarity with automation tools and AWS services; strong communication skills.
Sidley Austin: Global law firm providing comprehensive legal and regulatory counsel.
5+ YOE5+ years data engineering experience building scalable ETL/ELT and streaming pipelines; strong Python, SQL, Apache Spark; experience with cloud data platforms and Databricks; bachelor's in CS/Engineering/Data Science or related.
Azure Databricks, Apache Spark, Delta Lake, Azure Data Lake Storage (ADLS Gen2), Python, SQL, Scala, Databricks SQL, Unity Catalog, Databricks Workflows (Jobs), Databricks Notebooks, Azure DevOps, Azure Blob Storage, Azure Key Vault, Azure Data Factory, ERwin Data Modeler, AWS, GCP, PySpark, Spark SQL, CI/CD
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree and minimum 4 years application development, 2+ years big data, 1+ year cloud; experience with Python/Java/Scala, Spark, data warehouses and distributed systems; strong communication and mentoring skills.
Komodo Health: Provides AI-driven healthcare data and patient journey analytics software.
Design, implement and scale data pipelines and foundational data systems; experience with Spark, Python, Rust, SQL; leadership experience; healthcare data knowledge beneficial.
84.51°NYSE: KR: Provides retail data analytics and targeted advertising services.
5+ YOEBachelor's degree, 5+ years professional data development experience, Databricks/Spark and Python experience, ETL and data warehousing knowledge, Kubernetes and REST API development experience, Agile/Scrum familiarity.
Bellevue or Chicago or San Francisco or Washington
$197k-$271k/yrHybridFull Time
OktaNASDAQ: OKTA: Provide secure identity management and authentication for enterprises.
10+ YOE10+ years data engineering experience; expert SQL, ETL/ELT, MPP databases, AWS services; HR/People data experience; experience with batch and realtime pipelines, lakehouse architectures, and data quality frameworks.
McDonald'sNYSE: MCD: Operate and franchise a global chain of quick-service restaurants.
5+ YOE5+ years data engineering experience, Bachelor’s/Master’s in Computer Science or related, strong Python and SQL skills, experience with cloud data platforms, clean room and privacy-safe data practices.
Arthur J. Gallagher & Co.NYSE: AJG: Global insurance brokerage and risk management services provider.
7+ YOE3+ MgmtLead data engineering teams; 7+ yrs data engineering; 3+ yrs leading teams; BS in Information Technology; Snowflake, Azure Data Factory, ADLS Gen2, Databricks, Spark, Synapse, SQL Server; scripting (PowerShell, Python, Scala, Java, XML); Data Lake/ETL; CI/CD; agile; strong communication.
Snowflake, Azure Data Factory, ADLS Gen 2, Logic Apps, Azure Functions, Databricks, Apache Spark, Scala, Synapse, SQL Server, PowerShell, Python, Java, XML, Data Lake, Azure Data Lake Storage, CI/CD, Infrastructure as Code
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Vizient: Healthcare performance improvement and group purchasing organization.
5+ YOE5+ years data engineering experience; strong experience with Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Azure DevOps/Git and CI/CD; experience with metadata, governance, and enterprise-scale analytical platforms; US work authorization required.
Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Delta Live Tables, Spark, Databricks notebooks, Azure DevOps, Git, CI/CD, Infrastructure as Code (IaC), Pulumi, Apache Iceberg, AKS/Kubernetes, SQL
Chicago or Scottsdale or San Francisco or New York City
$145k-$223k/yrHybridFull Time
Early Warning Services: Operates payment and risk solutions for the financial industry.
8+ YOEBachelor's degree in CS or related,8+ years relevant experience building data platforms,experience with data warehouse, big data, ETL, cloud, AI/ML lifecycle, and delivering production systems.