HiringCafe
Join our community

153 spark data engineer jobs at 81 companies in Illinois

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
2mo
Save
Mark Applied
Hide
MID-LEVEL DATA ENGINEER-Python, AWS, Spark (Hybrid)
Bloomington or Richardson or Tempe or Dunwoody
HybridFull Time
State Farm
State Farm: Provider of auto, home, life, and health insurance.
2+ YOE2-4 years as a Data Engineer; proficiency in Python, Spark SQL/PySpark, R, Java, Bash; hands-on AWS (ETL tools, Lambda, Step Functions, S3, DynamoDB, Kinesis, Redshift, SageMaker); Spark/Databricks; IaC (OpenTofu); CI/CD with Airflow.
Python, Apache Spark, PySpark, R, Java, Bash, AWS, Glue, EMR Serverless, Lambda, Step Functions, EventBridge, S3, DynamoDB, Kinesis Firehose, Redshift, Iceberg, SageMaker, Databricks, OpenTofu, Terraform, Airflow, SQL, Athena
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$100k-$115k/yr HybridFull Time
HAVI
HAVI: Optimizing global supply chains for leading foodservice and retail brands.
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Unity Catalog, Databricks Jobs, Delta Live Tables, Azure Data Factory, ADLS Gen2, Key Vault, SQL, Great Expectations, Deequ, Git, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Log Analytics, Photon
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer Lead
Lake Elmo or Chicago or Evansville
$98k-$199k/yr OnsiteFull Time
Old National Bank
Old National BankNASDAQ: ONB: Regional financial services provider offering banking and wealth solutions.
7+ YOE7+ years data engineering experience, strong AWS/cloud and data warehouse background, expertise in SQL, Python, Spark/Databricks, leadership experience, BS in related field preferred.
AWS, S3, Glue, Lambda, Databricks, SQL, Python, Bash, Spark, GitOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer III
Lake Forest or Chicago
$105k-$174k/yr HybridFull Time
Grainger
GraingerNYSE: GWW: Distributes maintenance, repair, and operating supplies to businesses.
3+ YOEBachelor's degree or equivalent, 3+ years data engineering experience with Airflow, Kafka, Spark, Python; experience building scalable data pipelines, Snowflake models, SQL, and cloud tooling (AWS).
AWS, SQL, Python, Docker, Kubernetes, CI/CD, Git, Snowflake, dbt, Apache Airflow, Kafka, Spark, Scala
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr OnsiteFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
5+ YOE5+ years data engineering experience with ETL/ELT, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and experience with terabyte-to-petabyte datasets.
Apache Spark, Databricks, Airflow, SQL, Python, Git, PostgreSQL, SparkSQL, Hive, AWS Glue, Terraform
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
5+ YOE5–8 years data engineering experience with ETL/ELT design, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and Git, experience with PostgreSQL/SparkSQL/Hive/AWS Glue, and ability to mentor engineers.
Apache Spark, Databricks, SQL, Python, Git, Airflow, PostgreSQL, SparkSQL, Hive, AWS Glue, Terraform
Job PostingView all
3w
Save
Mark Applied
Hide
Forward Data Engineer
McLean or California or Colorado or Hawaii or Illinois or Maine or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or Virginia or Washington or District of Columbia or Cleveland
$130k-$265k/yr OnsiteFull Time
Accenture Federal Services
Accenture Federal ServicesNYSE: ACN: Provides technology and consulting services to U.S. federal agencies.
4+ YOE4+ years data lifecycle and ETL engineering experience; cloud and on-prem storage; Python, SQL, Spark; experience with ElasticSearch, NiFi, Palantir Foundry; Agile/Scrum experience; active TS/SCI with poly required.
Spark, Apache Iceberg, EMR, Kubernetes, Python, SQL, ElasticSearch, NiFi, Palantir Foundry, Agile, Scrum
Job PostingView all
2w
Save
Mark Applied
Hide
Principal Data Engineer
Chicago or Downers Grove or Alabama or Connecticut or Florida or Georgia or Ohio or Pennsylvania
$112k-$187k/yr HybridFull Time
Kemper
KemperNYSE: KMPR: Provides specialized auto, life, and health insurance services.
10+ YOE10+ years in data engineering/architecture; expert SQL, Python, Snowflake; experience with ETL/ELT, Spark, Kafka, Airflow, DBT, and cloud-native tools (AWS/Azure); proven technical leadership and mentoring; experience with data governance, security, and regulated industries; bachelor’s or master’s in related field preferred.
SQL, Python, Snowflake, Spark, Kafka, Airflow, AWS Glue, S3, AWS, Azure, Informatica, IICS, DBT, IDMC, Git, Guidewire, Life/400, Data Vault 2.0, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Charlotte or Chicago or Hartford or Columbus
$101k-$151k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
2+ YOE2+ years relevant experience; Bachelor’s in CS/Engineering/IT/MIS required; experience with R/Python/SQL, Hadoop/Spark, ETL, Linux, Git; familiarity with automation tools and AWS services; strong communication skills.
R, Python, SQL, Hadoop, Spark, XML, JSON, ETL, Linux, Git, GitHub, Autosys, Cron, Airflow, Amazon S3, Amazon EMR, MLOps, Agile
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$148k-$164k/yr HybridFull Time
Sidley Austin
Sidley Austin: Global law firm providing comprehensive legal and regulatory counsel.
5+ YOE5+ years data engineering experience building scalable ETL/ELT and streaming pipelines; strong Python, SQL, Apache Spark; experience with cloud data platforms and Databricks; bachelor's in CS/Engineering/Data Science or related.
Azure Databricks, Apache Spark, Delta Lake, Azure Data Lake Storage (ADLS Gen2), Python, SQL, Scala, Databricks SQL, Unity Catalog, Databricks Workflows (Jobs), Databricks Notebooks, Azure DevOps, Azure Blob Storage, Azure Key Vault, Azure Data Factory, ERwin Data Modeler, AWS, GCP, PySpark, Spark SQL, CI/CD
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Data Engineer
Chicago, Illinois, United States
$179k-$205k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree and minimum 4 years application development, 2+ years big data, 1+ year cloud; experience with Python/Java/Scala, Spark, data warehouses and distributed systems; strong communication and mentoring skills.
Python, Spark, AWS, Databricks, Snowflake, Airflow, Java, Scala, Redshift, MapReduce, Hadoop, Hive, EMR, Kafka, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, SQL, Microsoft Azure, Google Cloud
Job PostingView all
3w
Save
Mark Applied
Hide
Staff Data Engineer
Arizona or California or Colorado or Connecticut or District of Columbia or Delaware or Florida or Georgia or Illinois or Indiana or Kentucky or Louisiana or Massachusetts or Maine or Maryland or Michigan or Minnesota or Missouri or North Carolina or New Jersey or New York or Oregon or Pennsylvania or South Carolina or Tennessee or Texas or Virginia or Wisconsin
$130k-$150k/yr RemoteFull Time
MissionWired
MissionWired: Providing digital fundraising and data-driven marketing for nonprofit organizations.
5+ YOE5+ years professional software engineering experience; hands-on Apache Spark and distributed data pipelines; experience managing data warehouses or lakes; mentoring and guiding technical decisions; strong data modeling and production skills.
Apache Spark, AWS, GitHub Actions, Terraform, Docker
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer, Data Foundations
San Francisco or New York City or Chicago
$153k-$180k/yr HybridFull Time
Komodo Health
Komodo Health: Provides AI-driven healthcare data and patient journey analytics software.
Design, implement and scale data pipelines and foundational data systems; experience with Spark, Python, Rust, SQL; leadership experience; healthcare data knowledge beneficial.
Apache Spark, Python, Rust, SQL, Cloud computing, CI/CD
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer / Analyst - USA
New York City or Miami or Mountain View or Los Angeles or Chicago or Seattle or Dallas or United States
$122k-$162k/yr HybridFull Time
Cognify Analytics
Cognify Analytics: Independent analytics firm focused on data-driven solutions.
5+ YOE5–8+ years data engineering/analytics delivery; SQL, Snowflake/Databricks, dbt, Python, Spark; data governance; client collaboration.
Snowflake, Databricks, dbt, Python, Pandas, PySpark, Spark, Airflow, Dagster, Kafka, Kinesis, Tableau, Looker, Power BI, Sigma Computing, SQL, Data Governance, Alation, Atlan, DataHub, Unity Catalog
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Data Engineer (P4519)
Cincinnati or Chicago
$125k-$207k/yr OnsiteFull Time
84.51°
84.51°NYSE: KR: Provides retail data analytics and targeted advertising services.
5+ YOEBachelor's degree, 5+ years professional data development experience, Databricks/Spark and Python experience, ETL and data warehousing knowledge, Kubernetes and REST API development experience, Agile/Scrum familiarity.
Azure, Databricks, Spark, SQL, PySpark, Databricks Workflows, Python, JSON, Kubernetes, REST APIs
Job PostingView all
1d
Save
Mark Applied
Hide
Principal Data Engineer, People Data
Bellevue or Chicago or San Francisco or Washington
$197k-$271k/yr HybridFull Time
Okta
OktaNASDAQ: OKTA: Provide secure identity management and authentication for enterprises.
10+ YOE10+ years data engineering experience; expert SQL, ETL/ELT, MPP databases, AWS services; HR/People data experience; experience with batch and realtime pipelines, lakehouse architectures, and data quality frameworks.
SQL, Airflow, dbt, Snowflake, Redshift, Amazon S3, AWS Lambda, EMR, ECR, EKS, Workday, Spark, Kafka, Databricks, Iceberg, Delta
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer III
Chicago, Illinois, United States
$138k-$173k/yr OnsiteFull Time
McDonald's
McDonald'sNYSE: MCD: Operate and franchise a global chain of quick-service restaurants.
5+ YOE5+ years data engineering experience, Bachelor’s/Master’s in Computer Science or related, strong Python and SQL skills, experience with cloud data platforms, clean room and privacy-safe data practices.
Python, SQL, Apache Airflow, dbt, Spark, NoSQL, BigQuery, Snowflake, Databricks, GCP, AWS S3, LiveRamp, Habu, LiveRamp Connect, AWS Clean Rooms, Snowflake Clean Rooms, Google Ads Data Hub, Amazon Marketing Cloud
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Seattle or Chicago or Los Angeles or New York
$160k-$220k/yr OnsiteFull Time
Metropolis
Metropolis: Computer vision technology for checkout-free parking and retail payments.
5+ YOEBachelor's in CS/Engineering; 5+ years in data engineering; Python; SQL; Snowflake/dbt; AWS; ETL/ELT; on-site 4 days/week.
Python, SQL, Snowflake, dbt, Airflow, MWAA, DMS, EKS, SNS, Glue, AWS, MySQL, MS SQL Server, Postgres, Spark, PySpark, Automic, CI/CD, ETL/ELT
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
Austin or Chicago or New Hartford or Philadelphia
$130k-$144k/yr RemoteFull Time
PAR Technology
PAR TechnologyNYSE: PAR: Provides unified software and hardware for restaurant operations.
5+ YOE5+ years data engineering; project leadership; strong problem-solving; excellent communication; continuous learning; experience with AI/LLM tooling.
Python, SQL, Terraform, Spark, Databricks, Structured Streaming, Postgres, DynamoDB, CircleCI, DroneCI, Github Actions, Spacelift, DataDog, AWS, Azure, data governance, AI/ML integration, Claude Code, Cursor, Copilot, MCP, Agent Orchestrators, Git, Github
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer
O'Fallon, Illinois, United States
OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
2+ YOE2+ years in programming (C++, Java, Python); experience with scalable data stores, ETL/ELT, and processing structured/unstructured data; secret clearance; bachelor’s degree.
C++, Java, Python, SQL, Scala, Spark, Databricks, Hadoop, Kafka, Unix/Linux, AWS, Azure, Snowflake, MongoDB, Cassandra
Job PostingView all

Explore Jobs

Expand Your Job Search