48 spark airflow jobs at 27 companies in Chicago, IL
1w
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Chicago
$170k-$230k/yr HybridFull Time
Experience building production data pipelines at scale with advanced Python, SQL, Airflow, Spark, and AWS; healthcare data expertise and strong data quality, reliability, troubleshooting, and collaboration skills required.
Python, SQL, Airflow, AWS, Spark, ChatGPT, Gemini, Claude, ICD-10, CPT, NDC, NPI
1mo
Save
Mark Applied
Hide
Data Engineer III
Lake Forest or Chicago
$105k-$174k/yr HybridFull Time
3+ YOEBachelor's degree or equivalent; 3+ years data engineering experience with Airflow, Kafka, Spark, Python/Scala; strong cloud and analytics tooling experience (AWS, Snowflake, dbt); mentoring and building scalable data pipelines.
AWS, SQL, Python, Docker, Kubernetes, CI/CD, Git, Snowflake, dbt, Airflow, Kafka, Spark, Scala
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr OnsiteFull Time
6+ YOEBA/BS in CS or related; 6+ years data engineering experience; strong Databricks, AWS, Spark, SQL, Python, Linux, and cloud-native ETL/ELT skills; experience with Kafka, Airflow, Docker, and Kubernetes preferred.
Databricks, AWS, Spark, SQL, Python, Linux, Kafka, Airflow, Docker, Kubernetes
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr HybridFull Time
6+ YOEBA/BS in Computer Science or related, 6+ years data engineering experience. Strong experience with Databricks, Spark, SQL, Python, AWS, Linux; familiarity with Kafka, Airflow, Docker, Kubernetes; strong communication and problem-solving skills.
Databricks, Spark, SQL, Python, AWS, Linux, Kafka, Airflow, Docker, Kubernetes
2mo
Save
Mark Applied
Hide
Senior AI/ML Engineer
Chicago or New York City or San Francisco or Seattle
$172k-$238k/yr HybridFull Time
Deep expertise in sequential and deep learning, end-to-end ML lifecycle, experience with large-scale financial/behavioral data, MLOps, and tools like AWS, SageMaker, Kafka, Airflow, Redis, Snowflake, Spark; strong Python and SQL skills.
AWS, SageMaker, Kafka, Airflow, Redis, Snowflake, Spark, Python, SQL, PyTorch, PySpark
2w
Save
Mark Applied
Hide
Tech Lead, Data Engineering
Chicago, Illinois, United States
$145k-$165k/yr HybridFull Time
6+ YOE6+ years data engineering experience, deep AWS data ecosystem experience, strong Python and SQL, Airflow, Terraform/AWS CDK, experience building data lakes/lakehouses and leading engineering standards.
S3, Glue, Spark, Athena, Redshift, Python, SQL, Airflow, Terraform, AWS CDK, Snowflake, Databricks, Kafka, Kinesis, dbt
1mo
Save
Mark Applied
Hide
Engineer, Technology I
Mettawa, Illinois, United States
$133k-$162k/yr HybridFull Time
4+ YOEBSc in a quantitative field and 4 years data engineering experience; expertise with AWS data services, Spark, Python, CI/CD, data modeling, BI tools, and generative AI frameworks.
EMR Hadoop, Spark, Python, GitHub, Azure DevOps, Airflow, Autosys, S3, Glue, Athena, Lake Formation, API Gateway, Lambda, RDS, IAM, Redshift, Snowflake, Qlik, Tableau, Power BI, Langchain, Llama Index, GraphRAG
1mo
Save
Mark Applied
Hide
Managing Solution Architect
Chicago or Atlanta or New York City or Dallas or San Francisco
$150k-$210k/yr OnsiteFull Time
14+ YOE14+ years IT experience with 6+ years in architecture, degree in CS/IS, hands-on Spark/Scala/Java in cloud, deep AI/GenAI and data engineering experience, strong DevOps and delivery automation skills.
Spark, Scala, Java, AWS, Azure, Google Cloud, AWS Bedrock, AWS SageMaker, Google Vertex AI, Azure ML, OpenAI, Claude Code, Open AI Codex, Cursor, LangChain, LlamaIndex, PineCone, Milvus, PyTorch, Tensor Flow, Big Query, Redshift, Synapse, Databricks, Snowflake, Glue, Data Factory, DataFlow, Composer, Airflow, Kafka, Flink, Informatica, Alation, Collibra, Reltio, GitHub Actions, Jenkins, Terraform, git
1mo
Save
Mark Applied
Hide
Senior Software Engineer
Chicago or United States
RemoteFull Time
5+ YOE5+ years professional development with Python/Rust/Go, 3+ years with AWS/Docker/Kubernetes, Kafka, OpenSearch/Postgres/CockroachDB/Spark, Linux/Unix; strong communication and cross-team coordination.
Python, GoLang, Rust, AWS, Docker, Kubernetes, OpenSearch, Postgres, CockroachDB, Spark, Kafka, Linux, ElasticSearch, NATS, Apache Airflow, Bash, Scala, C, Hive
5d
Save
Mark Applied
Hide
Sr. Director, Data Engineering
Chicago or Dallas
$229k-$309k/yr OnsiteFull Time
10+ YOE5+ MgmtRequires 10+ years of data engineering, 5+ years of people management, 1–2 years managing managers or leads, expert Python and SQL, Spark, cloud platforms, data modeling, governance, and executive communication.
Python, SQL, PySpark, Spark, Azure, AWS, Databricks, Azure Data Factory, Synapse, AWS Glue, Redshift, CosmosDB, MongoDB, PostgreSQL, MRI, Yardi, IBM Maximo, ServiceNow FM, Airflow, Prefect, dbt, Docker, Kubernetes, Terraform, CloudFormation, GDPR, CCPA, AI, RAG, MCP
2mo
Save
Mark Applied
Hide
Data Engineer
Charlotte or Chicago or Hartford or Columbus
$101k-$151k/yr HybridFull Time
2+ YOE2+ years relevant experience; Bachelor’s in CS/Engineering/IT/MIS required; experience with R/Python/SQL, Hadoop/Spark, ETL, Linux, Git; familiarity with automation tools and AWS services; strong communication skills.
R, Python, SQL, Hadoop, Spark, XML, JSON, ETL, Linux, Git, GitHub, Autosys, Cron, Airflow, Amazon S3, Amazon EMR, MLOps, Agile
4d
Save
Mark Applied
Hide
Associate Data Engineer 2027
Chicago, Illinois, United States
$71k-$107k/yr OnsiteFull Time
High school diploma/GED required; bachelor's preferred. Requires Python, Java, Scala, SQL, Linux, Spark, Hadoop, ETL/ELT, cloud basics, statistical and machine learning techniques, and up to 100% travel.
AWS, Microsoft Azure, Java, Python, Scala, Extract, Transform, and Load (ETL), SQL, Linux, Spark, Hadoop, dbt, Snowflake, BigQuery, Airflow, CI/CD, RAG
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Chicago, Illinois, United States
$179k-$205k/yr OnsiteFull Time
4+ YOEBachelor's degree and minimum 4 years application development, 2+ years big data, 1+ year cloud; experience with Python/Java/Scala, Spark, data warehouses and distributed systems; strong communication and mentoring skills.
Python, Spark, AWS, Databricks, Snowflake, Airflow, Java, Scala, Redshift, MapReduce, Hadoop, Hive, EMR, Kafka, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, SQL, Microsoft Azure, Google Cloud
5d
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Seattle or Toronto or Santa Barbara or San Diego
$127k-$190k/yr RemoteFull Time
5+ YOE5+ years in data or software engineering; advanced Python, SQL, Databricks, Spark, and data modeling; experience with orchestration, streaming, cloud infrastructure, data quality, ML datasets, and privacy; bachelor's degree or equivalent.
Python, PySpark, Pandas, Polars, PyArrow, SQL, MySQL, PostgreSQL, Databricks, Delta Lake, Unity Catalog, Workflows, Jobs/Compute, Snowflake, BigQuery, Apache Spark, Airflow, Dagster, Kafka, Kinesis, Spark Structured Streaming, AWS, S3, IAM, FastAPI, Databricks Model Serving, SageMaker endpoints
6d
Save
Mark Applied
Hide
Data Engineer - Databricks
Chicago or Indianapolis or Fort Wayne or Columbus or Lansing or Denver or Dallas or Atlanta
RemoteFull Time
2+ YOEBachelor's degree or equivalent, 2+ years of production data engineering experience, Databricks, PySpark, Spark SQL, Delta Lake, SQL, cloud data services, data modeling, and strong client communication skills.
Databricks, PySpark, Spark SQL, Delta Lake, Delta Live Tables (DLT), Auto Loader, Structured Streaming, Databricks Workflows, Airflow, Azure Data Factory, Unity Catalog, MLflow, Photon, Git, Azure DevOps, GitHub Actions, GitLab, Terraform, dbt, Kafka, Event Hubs, Power BI, Tableau, Docker, Kubernetes, SQL Server, Postgres, Oracle, Snowflake, Azure, AWS, GCP
2mo
Save
Mark Applied
Hide
Data Architect, Clinical
Chicago, Illinois, United States
$148k/yr OnsiteFull Time
10+ YOEBachelor's degree, 10+ years in healthcare or related data environments (5+ years in clinical/patient data platforms). Deep experience with healthcare data standards, cloud platforms, modern data stacks, SQL and Python, data modeling, governance, and interoperability (HL7/FHIR).
HL7, FHIR, ICD, SNOMED CT, LOINC, RxNorm, OMOP, CDISC, GCP, AWS, Microsoft Azure, Snowflake, Databricks, BigQuery, Redshift, Microsoft Synapse, dbt, Airflow, Dagster, Spark, Kafka, Fivetran, Informatica, Talend, SQL, Python, EHR, APIs
1mo
Save
Mark Applied
Hide
Data Engineer III
Chicago, Illinois, United States
$138k-$173k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience, Bachelor’s/Master’s in Computer Science or related, strong Python and SQL skills, experience with cloud data platforms, clean room and privacy-safe data practices.
Python, SQL, Apache Airflow, dbt, Spark, NoSQL, BigQuery, Snowflake, Databricks, GCP, AWS S3, LiveRamp, Habu, LiveRamp Connect, AWS Clean Rooms, Snowflake Clean Rooms, Google Ads Data Hub, Amazon Marketing Cloud
3w
Save
Mark Applied
Hide
Artificial Intelligence Architect
New York or Wisconsin or Georgia or New Jersey or Highland Park or Punta Gorda or Tennessee or Pennsylvania or Kentucky or Ohio or Indiana or Keswick
OnsiteFull Time
8+ YOE8+ years software/data architecture experience with 4+ years on ML systems; deep cloud (AWS/Azure/GCP) expertise; production ML pipelines, MLOps, model monitoring, and LLM/GenAI experience.
Python, SQL, Scala, PyTorch, TensorFlow, scikit-learn, Hugging Face, Docker, Kubernetes, CI/CD, MLflow, AWS, Azure, GCP, Spark, Airflow, vector databases
3w
Save
Mark Applied
Hide
Artificial Intelligence Architect
New York or Wisconsin or Georgia or New Jersey or Highland Park or Punta Gorda or Tennessee or Pennsylvania or Kentucky or Ohio or Indiana or Keswick
OnsiteFull Time
8+ YOE8+ years in software/data architecture (4+ years on ML), deep cloud (AWS/Azure/GCP) and production ML pipeline experience, MLOps, model monitoring, LLM/GenAI familiarity, and mentoring skills.
Python, SQL, Scala, PyTorch, TensorFlow, scikit-learn, Hugging Face, Docker, Kubernetes, CI/CD, MLflow, AWS, Azure, GCP, Spark, Airflow, feature stores, RAG, vector databases
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Bolingbrook, Illinois, United States
$103k-$140k/yr OnsiteFull Time
5+ YOEBachelor's degree in computer science or related field; 5 years in development with GCP, Databricks; experience with data pipelines, SQL/NoSQL, Java/Python; strong data warehousing and ETL skills.
BigQuery, Databricks, Spark, Kafka Streams, Jenkins, Docker, GitHub, Bitbucket, Unix/Linux, SQL, NoSQL, GCS, Dataflow, Airflow, Cloud Composer, Python, Java
Explore Jobs
Expand Your Job Search
Top Cities Near Chicago for Spark Airflow
- Spark Airflow jobs in Aurora, IL
- Spark Airflow jobs in Joliet, IL
- Spark Airflow jobs in Naperville, IL
- Spark Airflow jobs in Elgin, IL
- Spark Airflow jobs in Waukegan, IL
- Spark Airflow jobs in Cicero, IL
- Spark Airflow jobs in Hammond, IN
- Spark Airflow jobs in Gary, IN
- Spark Airflow jobs in Arlington Heights, IL
- Spark Airflow jobs in Evanston, IL
- Spark Airflow jobs in Schaumburg, IL
- Spark Airflow jobs in Bolingbrook, IL
- Spark Airflow jobs in Palatine, IL
- Spark Airflow jobs in Skokie, IL
- Spark Airflow jobs in Des Plaines, IL
- Spark Airflow jobs in Orland Park, IL
- Spark Airflow jobs in Tinley Park, IL
- Spark Airflow jobs in Oak Lawn, IL
- Spark Airflow jobs in Berwyn, IL
- Spark Airflow jobs in Mount Prospect, IL