HiringCafe
Join our community

143 spark engineer jobs at 73 companies in Aurora, IL

1mo
Save
Mark Applied
Hide
Lead Software Engineer (Python, Scala, Spark, AWS)
Richmond or McLean or Chicago
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years professional software engineering, 1+ year cloud experience (AWS/Azure/GCP). Experience with Java/Scala/Python/Spark, containerization, distributed microservices, and mentoring/leading teams.
Python, Scala, Spark, AWS, Java, SQL, Node, Go, Docker, Kubernetes
Job PostingView all
4w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr OnsiteFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
5+ YOE5+ years data engineering experience with ETL/ELT, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and experience with terabyte-to-petabyte datasets.
Apache Spark, Databricks, Airflow, SQL, Python, Git, PostgreSQL, SparkSQL, Hive, AWS Glue, Terraform
Job PostingView all
4w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
5+ YOE5–8 years data engineering experience with ETL/ELT design, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and Git, experience with PostgreSQL/SparkSQL/Hive/AWS Glue, and ability to mentor engineers.
Apache Spark, Databricks, SQL, Python, Git, Airflow, PostgreSQL, SparkSQL, Hive, AWS Glue, Terraform
Job PostingView all
3w
Save
Mark Applied
Hide
Engineer, Technology I
Mettawa, Illinois, United States
$133k-$162k/yr HybridFull Time
AbbVie
AbbVieNYSE: ABBV: Develops and sells innovative pharmaceutical and biopharmaceutical medicines.
4+ YOEBSc in a quantitative field and 4 years data engineering experience; expertise with AWS data services, Spark, Python, CI/CD, data modeling, BI tools, and generative AI frameworks.
EMR Hadoop, Spark, Python, GitHub, Azure DevOps, Airflow, Autosys, S3, Glue, Athena, Lake Formation, API Gateway, Lambda, RDS, IAM, Redshift, Snowflake, Qlik, Tableau, Power BI, Langchain, Llama Index, GraphRAG
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yr RemoteFull Time
SentiLink
SentiLink: Provides identity verification and fraud prevention for financial institutions.
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Python, Golang, PostgreSQL (RDS), OpenSearch, Redshift, EMR, Spark, Docker, Lambda, AWS, EKS, SQS, SNS, S3, Kubernetes, Hadoop, Kafka, Microsoft Azure, GCP
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Data Engineer (P4519)
Cincinnati or Chicago
$125k-$207k/yr OnsiteFull Time
84.51°
84.51°NYSE: KR: Provides retail data analytics and targeted advertising services.
5+ YOEBachelor's degree, 5+ years professional data development experience, Databricks/Spark and Python experience, ETL and data warehousing knowledge, Kubernetes and REST API development experience, Agile/Scrum familiarity.
Azure, Databricks, Spark, SQL, PySpark, Databricks Workflows, Python, JSON, Kubernetes, REST APIs
Job PostingView all
2w
Save
Mark Applied
Hide
Sr. Forward Deployed Engineer (FDE) - Retail
Chicago or California
$182k-$250k/yr FieldFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
6+ YOE6+ years in data engineering or software engineering, proficiency in Python/Scala/JavaScript/TypeScript, Spark, cloud platforms, CI/CD and MLOps experience, strong customer-facing and architecture skills.
Python, Scala, JavaScript/TypeScript, AWS, Azure, GCP, Apache Spark, Delta Lake, MLflow
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$100k-$115k/yr HybridFull Time
HAVI
HAVI: Optimizing global supply chains for leading foodservice and retail brands.
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Unity Catalog, Databricks Jobs, Delta Live Tables, Azure Data Factory, ADLS Gen2, Key Vault, SQL, Great Expectations, Deequ, Git, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Log Analytics, Photon
Job PostingView all
3d
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$46-$69/hr OnsiteFull Time
Rush University Medical Center
Rush University Medical Center: Academic medical center providing patient care and medical education.
5+ YOEBachelor's degree and 5+ years experience; strong cloud, software engineering and data processing background; ETL, RDBMS, Python, SQL, NoSQL, Spark experience; strong analytical and communication skills.
Pentaho, Talend, Informatica, Azure Data Factory, Apache Kafka, Apache Camel, Cloudera Hadoop, Hortonworks Data Platform, Databricks, Oracle, SQL Server, DB2, MySQL, Python, SQL, NoSQL, Spark
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer III
Chicago, Illinois, United States
$138k-$173k/yr OnsiteFull Time
McDonald's
McDonald'sNYSE: MCD: Operate and franchise a global chain of quick-service restaurants.
5+ YOEBachelor's or Master's in CS or related,5+ years data engineering,proficient in Python and SQL,experience with data orchestration,cloud platforms,and clean room/privacy-safe data collaboration.
Python, SQL, Apache Airflow, dbt, Spark, NoSQL, BigQuery, Snowflake, Databricks, LiveRamp, LiveRamp Connect, Habu, Google Ads Data Hub, Amazon Marketing Cloud, GCP, AWS S3
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer Lead
Lake Elmo or Chicago or Evansville or Milwaukee
$98k-$199k/yr OnsiteFull Time
Old National Bank
Old National Bank: Provides personal and business banking and wealth management services.
7+ YOEBachelor's or equivalent with 7+ years data engineering experience, 5+ years AWS, expertise with data warehouses, SQL, Python, Bash, Spark, Databricks, and experience leading teams.
AWS, S3, Glue, Lambda, Databricks, SQL, Python, Bash, Spark, GitOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Charlotte or Chicago or Hartford or Columbus
$101k-$151k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
2+ YOE2+ years relevant experience; Bachelor’s in CS/Engineering/IT/MIS required; experience with R/Python/SQL, Hadoop/Spark, ETL, Linux, Git; familiarity with automation tools and AWS services; strong communication skills.
R, Python, SQL, Hadoop, Spark, XML, JSON, ETL, Linux, Git, GitHub, Autosys, Cron, Airflow, Amazon S3, Amazon EMR, MLOps, Agile
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$110k-$125k/yr OnsiteFull Time
fairlife
fairlifeNYSE: KO: Produces nutrient-dense and ultra-filtered dairy products and shakes.
5+ YOEBachelor's degree and 5+ years data engineering experience, expert SQL and strong Python, Spark/PySpark, Azure data services, Azure DevOps, dimensional modeling, and manufacturing data experience preferred.
SQL, Python, Spark, PySpark, Azure SQL databases, Event Hubs, Functions, Data Factory, Key Vault, Microsoft Entra, Azure DevOps, Git, YAML, Delta Lake, Fabric, Databricks, KQL, Eventhouse, Application Insights, MCP, IIoT, MES
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer III
Lake Forest or Chicago
$105k-$174k/yr HybridFull Time
Grainger
GraingerNYSE: GWW: Distributes maintenance, repair, and operating supplies to businesses.
3+ YOEBachelor's degree or equivalent; 3+ years data engineering experience with Airflow, Kafka, Spark, Python/Scala; strong cloud and analytics tooling experience (AWS, Snowflake, dbt); mentoring and building scalable data pipelines.
AWS, SQL, Python, Docker, Kubernetes, CI/CD, Git, Snowflake, dbt, Airflow, Kafka, Spark, Scala
Job PostingView all
1w
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
Guidehouse
Guidehouse: Provides management and technology consulting services to diverse organizations.
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer II - Zelle
Scottsdale or Chicago or San Francisco or New York City
$97k-$149k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
2+ YOEBachelor's degree typical; 2+ years experience building data engineering tools with Spark and Python, experience with ML toolkits, Hadoop or AWS/S3, and relational databases; strong communication and background/drug screen required.
Spark, Python, R, Hadoop, AWS/S3, Scala, Java
Job PostingView all
1mo
Save
Mark Applied
Hide
Platform Engineer
Chicago or Sydney or Shanghai or London or Singapore
$145k/yr OnsiteFull Time
Akuna Capital
Akuna Capital: Proprietary trading firm providing liquidity in global options markets.
3+ YOE3+ years in platform/cloud/SRE/DevOps roles, strong AWS and Kubernetes (EKS) experience, Terraform/IaC, Python/Bash scripting, Linux administration, CI/CD and observability expertise; Bachelor’s degree preferred.
AWS, Azure, Google Cloud, Kubernetes, EKS, Spark, Kafka, Terraform, Ansible, Jenkins, GitLab, Python, Bash, Amazon RDS, Aurora, Redshift, DynamoDB
Job PostingView all
1w
Save
Mark Applied
Hide
Backend Engineer, Credit Decisions
Chicago, Illinois, United States
$173k-$260k/yr HybridFull Time
Stripe
Stripe: Provides online payment processing and financial infrastructure for businesses.
6+ YOEBachelor's degree and 6+ years software development experience; proficiency across stack with 2+ of Java, Ruby, Scala, Python, SQL; experience with Spark, IDEs, AWS, distributed systems, cloud services (gRPC, GraphQL, Docker, Kubernetes); strong engineering and collaboration skills.
Java, Ruby, Scala, Python, SQL, Spark, IDE, AWS, gRPC, GraphQL, Docker, Kubernetes
Job PostingView all
1d
Save
Mark Applied
Hide
Solution Architect/Data Engineer
Wood Dale, Illinois, United States
$150k-$170k/yr OnsiteFull Time
AAR
AARNYSE: AIR: Provides aftermarket products and services to global aviation customers.
7+ YOE7+ years in data engineering or solution architecture; strong cloud data analytics experience; hands-on with SQL, PySpark/Python, Java Spring Boot, Spark/Databricks, Snowflake, and Kafka; strong stakeholder and communication skills.
Advanced Analytical SQL, PySpark, Python, Java Spring Boot, Spark, Databricks, Snowflake, Kafka, Azure
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Software Engineer - Machine Learning
San Francisco or Chicago or Frisco
$183k-$223k/yr HybridFull Time
Uber Freight
Uber Freight: Digital marketplace connecting shippers with trucking carriers.
5+ YOE5+ years ML engineering experience; deploy ML models at scale; experience with PyTorch/TensorFlow/Scikit-Learn/Spark MLlib; Python, Go, or Java; strong ML theory and production experience.
PyTorch, TensorFlow, Scikit-Learn, Spark MLlib, Python, Go, Java, Storm, Spark, Flink
Job PostingView all

Explore Jobs

Expand Your Job Search