HiringCafe
Join our community

28 spark airflow jobs at 20 companies in Joliet, IL

3w
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Chicago
$170k-$230k/yr HybridFull Time
Komodo Health
Komodo Health: Privately held healthcare AI and real-world data analytics serving Life Sciences and healthcare organizations.
Experience building production data pipelines at scale with advanced Python, SQL, Airflow, Spark, and AWS; healthcare data expertise and strong data quality, reliability, troubleshooting, and collaboration skills required.
Python, SQL, Airflow, AWS, Spark, ChatGPT, Gemini, Claude, ICD-10, CPT, NDC, NPI
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer III
Lake Forest or Chicago
$105k-$174k/yr HybridFull Time
Grainger
GraingerNYSE: GWW: Broad line distributor of maintenance, repair, and operating products.
3+ YOEBachelor's degree or equivalent; 3+ years data engineering experience with Airflow, Kafka, Spark, Python/Scala; strong cloud and analytics tooling experience (AWS, Snowflake, dbt); mentoring and building scalable data pipelines.
AWS, SQL, Python, Docker, Kubernetes, CI/CD, Git, Snowflake, dbt, Airflow, Kafka, Spark, Scala
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr HybridFull Time
Epsilon
Epsilon: Epsilon is a global marketing-data, consumer-analytics, and marketing-technology serving brands.
6+ YOEBA/BS in Computer Science or related, 6+ years data engineering experience. Strong experience with Databricks, Spark, SQL, Python, AWS, Linux; familiarity with Kafka, Airflow, Docker, Kubernetes; strong communication and problem-solving skills.
Databricks, Spark, SQL, Python, AWS, Linux, Kafka, Airflow, Docker, Kubernetes
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior AI/ML Engineer
Chicago or New York City or San Francisco or Seattle
$172k-$238k/yr HybridFull Time
Chime
ChimeNasdaq: CHYM: A U.S. financial technology offering low-cost banking, payments, lending, and investing products to everyday Americans.
Deep expertise in sequential and deep learning, end-to-end ML lifecycle, experience with large-scale financial/behavioral data, MLOps, and tools like AWS, SageMaker, Kafka, Airflow, Redis, Snowflake, Spark; strong Python and SQL skills.
AWS, SageMaker, Kafka, Airflow, Redis, Snowflake, Spark, Python, SQL, PyTorch, PySpark
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago or United States
RemoteFull Time
Tiger Analytics
Tiger Analytics: We provide certainty by solving your toughest challenges.
8+ YOERequires 8+ years in data engineering, strong AWS, Databricks, Spark, SQL, ETL/ELT, and Airflow experience, plus pharmaceutical data, modeling, lakehouse, analytics, and troubleshooting expertise.
Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, Databricks, Apache Spark, SQL, Apache Airflow, ETL, ELT, LLM, RAG
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Software Engineer
Chicago or United States
RemoteFull Time
DomainTools
DomainTools: DNS threat-intelligence helping enterprises, governments, and security platforms detect and investigate online threats.
5+ YOE5+ years professional development with Python/Rust/Go, 3+ years with AWS/Docker/Kubernetes, Kafka, OpenSearch/Postgres/CockroachDB/Spark, Linux/Unix; strong communication and cross-team coordination.
Python, GoLang, Rust, AWS, Docker, Kubernetes, OpenSearch, Postgres, CockroachDB, Spark, Kafka, Linux, ElasticSearch, NATS, Apache Airflow, Bash, Scala, C, Hive
Job PostingView all
2w
Save
Mark Applied
Hide
Associate Data Engineer 2027
Chicago, Illinois, United States
$71k-$107k/yr OnsiteFull Time
IBM
IBMNYSE: IBM: Global technology and consulting focusing on cloud and AI.
High school diploma/GED required; bachelor's preferred. Requires Python, Java, Scala, SQL, Linux, Spark, Hadoop, ETL/ELT, cloud basics, statistical and machine learning techniques, and up to 100% travel.
AWS, Microsoft Azure, Java, Python, Scala, Extract, Transform, and Load (ETL), SQL, Linux, Spark, Hadoop, dbt, Snowflake, BigQuery, Airflow, CI/CD, RAG
Job PostingView all
2w
Save
Mark Applied
Hide
Sr. Director, Data Engineering
Chicago or Dallas
$229k-$309k/yr OnsiteFull Time
JLL Technologies
JLL TechnologiesNYSE: JLL: 's commercial real estate technology division provides software, consulting, and managed services to property owners and occupiers.
10+ YOE5+ MgmtRequires 10+ years of data engineering, 5+ years of people management, 1–2 years managing managers or leads, expert Python and SQL, Spark, cloud platforms, data modeling, governance, and executive communication.
Python, SQL, PySpark, Spark, Azure, AWS, Databricks, Azure Data Factory, Synapse, AWS Glue, Redshift, CosmosDB, MongoDB, PostgreSQL, MRI, Yardi, IBM Maximo, ServiceNow FM, Airflow, Prefect, dbt, Docker, Kubernetes, Terraform, CloudFormation, GDPR, CCPA, AI, RAG, MCP
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Chicago, Illinois, United States
$179k-$205k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
4+ YOEBachelor's degree and minimum 4 years application development, 2+ years big data, 1+ year cloud; experience with Python/Java/Scala, Spark, data warehouses and distributed systems; strong communication and mentoring skills.
Python, Spark, AWS, Databricks, Snowflake, Airflow, Java, Scala, Redshift, MapReduce, Hadoop, Hive, EMR, Kafka, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, SQL, Microsoft Azure, Google Cloud
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Quality Engineer
Alpharetta or Birmingham or Chicago or Downers Grove or Jacksonville or Connecticut or New Jersey or Ohio or Pennsylvania or Rhode Island or Virginia
$99k-$165k/yr HybridFull Time
Kemper
KemperNYSE: KMPR: Specialized insurance provider for individuals and businesses.
6+ YOE6+ years data engineering/testing experience; Bachelor's in CS/Info Systems or equivalent; expertise with SQL, Informatica/IICS/IDMC, Snowflake, Oracle, AWS, Python; strong data validation, reconciliation, and test automation skills.
SQL, Informatica, IICS, IDMC, Snowflake, Python, Oracle, AWS, XML, JSON, Power BI, PowerShell, Git, Spark, Kafka, Airflow, DBT, CI/CD, Infrastructure as Code
Job PostingView all
1mo
Save
Mark Applied
Hide
Artificial Intelligence Architect
New York or Wisconsin or Georgia or New Jersey or Highland Park or Punta Gorda or Tennessee or Pennsylvania or Kentucky or Ohio or Indiana or Keswick
OnsiteFull Time
M2S Group
M2S Group: Private North American materials-science platform manufacturing engineered coatings, films, labels, and specialty print media for business customers.
8+ YOE8+ years in software/data architecture (4+ years on ML), deep cloud (AWS/Azure/GCP) and production ML pipeline experience, MLOps, model monitoring, LLM/GenAI familiarity, and mentoring skills.
Python, SQL, Scala, PyTorch, TensorFlow, scikit-learn, Hugging Face, Docker, Kubernetes, CI/CD, MLflow, AWS, Azure, GCP, Spark, Airflow, feature stores, RAG, vector databases
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer III
Chicago, Illinois, United States
$138k-$173k/yr OnsiteFull Time
McDonald's
McDonald'sNYSE: MCD: Global leader in fast food and quick service restaurants.
5+ YOEBachelor's or Master's in CS or related,5+ years data engineering,proficient in Python and SQL,experience with data orchestration,cloud platforms,and clean room/privacy-safe data collaboration.
Python, SQL, Apache Airflow, dbt, Spark, NoSQL, BigQuery, Snowflake, Databricks, LiveRamp, LiveRamp Connect, Habu, Google Ads Data Hub, Amazon Marketing Cloud, GCP, AWS S3
Job PostingView all
4w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$135k-$160k/yr RemoteFull Time
Benchmark Analytics
Benchmark Analytics: SaaS police workforce-management serving law-enforcement, corrections, and risk-insurer organizations with data-driven personnel analytics.
8+ YOEBachelor's in STEM or equivalent,8+ years building production data systems,advanced Python and SQL,ETL/ELT design,cloud (AWS) production experience,Docker/Kubernetes,CI/CD,production troubleshooting and modernization experience.
Python, Kubernetes, AWS, SQL, PostgreSQL, Spark, EMR, Git, Docker, Airflow, Django, DynamoDB, S3, Lambda, SQS, SNS, IAM
Job PostingView all
3w
Save
Mark Applied
Hide
Manager II, Technical Support Engineer
New York City or Chicago
$146k-$300k/yr HybridFull Time
Pinterest
PinterestNYSE: PINS: A visual discovery engine for finding inspiration.
5+ YOE2+ MgmtRequires 2+ years managing client-focused technical teams, 5+ years in support, solution, or partner engineering, AdTech/MarTech/eCommerce experience, scripting, SQL, data analysis, API integration, debugging, and strong communication.
Python, SQL, Presto, Spark, Tableau, Superset, Postman, Bruno, Kibana, GitHub, Sourcegraph, Airflow, MCPs
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Architect, Clinical
Chicago, Illinois, United States
$148k/yr OnsiteFull Time
Prolaio
Prolaio: Private cardiovascular clinical-intelligence providing continuous heart data and analytics to researchers, providers, and patients.
10+ YOEBachelor's degree, 10+ years in healthcare or related data environments (5+ years in clinical/patient data platforms). Deep experience with healthcare data standards, cloud platforms, modern data stacks, SQL and Python, data modeling, governance, and interoperability (HL7/FHIR).
HL7, FHIR, ICD, SNOMED CT, LOINC, RxNorm, OMOP, CDISC, GCP, AWS, Microsoft Azure, Snowflake, Databricks, BigQuery, Redshift, Microsoft Synapse, dbt, Airflow, Dagster, Spark, Kafka, Fivetran, Informatica, Talend, SQL, Python, EHR, APIs
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Software Engineer I, Data & ML Platform
Chicago, Illinois, United States
$105k-$175k/yr HybridFull Time
Zoro
Zoro: Private B2B e-commerce distributor supplying businesses with tools, parts, equipment, and industrial supplies.
5+ YOE5+ years platform engineering experience; proficiency in Python; experience with cloud platforms (GCP preferred), containerization, CI/CD, orchestration, mentoring, and platform reliability.
Python, AWS, Azure, GCP, Docker, Kubernetes, Jenkins, CircleCI, Airflow, Argo, Flyte, Kubeflow, Terraform, Ansible, Helm, DataDog, Prometheus, Grafana, Spark, Hadoop, Kafka, Pub/Sub
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
Romeoville, Illinois, United States
$96k-$134k/yr OnsiteFull Time
Magid Glove & Safety
Magid Glove & Safety: Family-owned manufacturer and distributor of gloves, personal protective equipment, and workplace safety products for employers.
5+ YOEBachelor's degree or equivalent experience; 5+ years in data or software engineering; strong SQL, Python, Git, data modeling, production transformations, and collaboration skills.
SQL, Python, Microsoft Power BI, Fabric Data Lake, KQL, Git, Airflow, dbt, Spark, Microsoft Fabric OneLake, Snowflake, BigQuery, Databricks
Job PostingView all
1mo
Save
Mark Applied
Hide
Artificial Intelligence Architect
New York or Wisconsin or Georgia or New Jersey or Highland Park or Punta Gorda or Tennessee or Pennsylvania or Kentucky or Ohio or Indiana or Keswick
RemoteFull Time
M2S Group
M2S Group: Private North American materials-science platform manufacturing engineered coatings, films, labels, and specialty print media for business customers.
8+ YOE8+ years in software or data architecture with 4+ years focused on ML systems; deep cloud platform expertise; experience designing production ML pipelines, MLOps, model monitoring, and LLM/GenAI architectures.
Python, SQL, Scala, PyTorch, TensorFlow, scikit-learn, Hugging Face, Docker, Kubernetes, CI/CD, MLflow, AWS, Azure, GCP, Spark, Airflow
Job PostingView all
3mo
Save
Mark Applied
Hide
Principal Software Engineer, Semantic Data Services
Portland or San Francisco or Chicago or Boston
$201k-$250k/yr OnsiteFull Time
WEX
WEXNYSE: WEX: Public fintech and payments helping businesses manage fleet fuel, employee benefits, and corporate payments.
12+ YOE12+ years building and scaling large data platforms; expertise in distributed systems, data acquisition, semantic modeling, data lifecycle, and cross-domain architecture; strong leadership and communication.
Spark, Iceberg, Kafka, Delta, DBT, Ray, Airflow, Dagster, Flink
Job PostingView all
3w
Save
Mark Applied
Hide
Manager II, Technical Support Engineer
New York City or Chicago or United States
$146k-$300k/yr HybridFull Time
Pinterest
PinterestNYSE: PINS: A visual discovery engine for finding inspiration.
5+ YOE2+ MgmtRequires 2+ years managing client-focused technical teams, 5+ years in support, solutions, or partner engineering, Ad Tech/MarTech/eCommerce experience, scripting, SQL, data analysis, API integration, debugging, and strong communication.
Python, SQL, Presto, Spark, Tableau, Superset, Postman, Bruno, Kibana, GitHub, Sourcegraph, Airflow
Job PostingView all

Explore Jobs

Expand Your Job Search