159 spark data engineer jobs at 70 companies in Lake Zurich, IL
1mo
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$100k-$115k/yr HybridFull Time
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Unity Catalog, Databricks Jobs, Delta Live Tables, Azure Data Factory, ADLS Gen2, Key Vault, SQL, Great Expectations, Deequ, Git, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Log Analytics, Photon
3w
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$46-$69/hr OnsiteFull Time
5+ YOEBachelor's degree and 5+ years experience; strong cloud, software engineering and data processing background; ETL, RDBMS, Python, SQL, NoSQL, Spark experience; strong analytical and communication skills.
Pentaho, Talend, Informatica, Azure Data Factory, Apache Kafka, Apache Camel, Cloudera Hadoop, Hortonworks Data Platform, Databricks, Oracle, SQL Server, DB2, MySQL, Python, SQL, NoSQL, Spark
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$110k-$125k/yr OnsiteFull Time
5+ YOEBachelor's degree and 5+ years data engineering experience, expert SQL and strong Python, Spark/PySpark, Azure data services, Azure DevOps, dimensional modeling, and manufacturing data experience preferred.
SQL, Python, Spark, PySpark, Azure SQL databases, Event Hubs, Functions, Data Factory, Key Vault, Microsoft Entra, Azure DevOps, Git, YAML, Delta Lake, Fabric, Databricks, KQL, Eventhouse, Application Insights, MCP, IIoT, MES
1mo
Save
Mark Applied
Hide
Data Engineer III
Lake Forest or Chicago
$105k-$174k/yr HybridFull Time
3+ YOEBachelor's degree or equivalent; 3+ years data engineering experience with Airflow, Kafka, Spark, Python/Scala; strong cloud and analytics tooling experience (AWS, Snowflake, dbt); mentoring and building scalable data pipelines.
AWS, SQL, Python, Docker, Kubernetes, CI/CD, Git, Snowflake, dbt, Airflow, Kafka, Spark, Scala
2w
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$175k-$225k/yr OnsiteFull Time
5+ YOERequires 5+ years in data engineering, Kafka streaming and Big Data pipeline experience, Java, Python, SQL, Spark or Flink, Kubernetes, Docker, monitoring tools, statistics, and Unix scripting.
Kafka, Hadoop, Dremio, Java, Python, Apache Spark, Apache Flink, SQL, S3, HDFS, Databricks, Iceberg, Kubernetes, Docker, Prometheus, Grafana, Alert Manager, Alerta, OpsGenie, Unix, Bash
1mo
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP
1w
Save
Mark Applied
Hide
Data Engineer
Detroit or Chicago
$130k-$150k/yr HybridFull Time
6+ YOEBachelor’s degree in computer science or related field, 6+ years in data engineering, 3+ years with Azure Databricks or Spark, and expertise in Azure data services, Databricks architecture, DevOps, and client communication.
Microsoft Azure, Microsoft Fabric, Power BI, Databricks, PySpark, Apache Spark, Spark SQL, SQL, Python, Delta Lake, Azure Data Factory, Synapse Data Analytics, Azure SQL, Azure Cosmos DB, Azure Database for PostgreSQL, Unity Catalog, Mosaic AI, GitHub, AKS, Docker, Databricks Genie, Fabric Data Agents
3w
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Chicago
$170k-$230k/yr HybridFull Time
Experience building production data pipelines at scale with advanced Python, SQL, Airflow, Spark, and AWS; healthcare data expertise and strong data quality, reliability, troubleshooting, and collaboration skills required.
Python, SQL, Airflow, AWS, Spark, ChatGPT, Gemini, Claude, ICD-10, CPT, NDC, NPI
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Chicago, Illinois, United States
$179k-$205k/yr OnsiteFull Time
4+ YOEBachelor's degree and minimum 4 years application development, 2+ years big data, 1+ year cloud; experience with Python/Java/Scala, Spark, data warehouses and distributed systems; strong communication and mentoring skills.
Python, Spark, AWS, Databricks, Snowflake, Airflow, Java, Scala, Redshift, MapReduce, Hadoop, Hive, EMR, Kafka, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, SQL, Microsoft Azure, Google Cloud
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr HybridFull Time
6+ YOEBA/BS in Computer Science or related, 6+ years data engineering experience. Strong experience with Databricks, Spark, SQL, Python, AWS, Linux; familiarity with Kafka, Airflow, Docker, Kubernetes; strong communication and problem-solving skills.
Databricks, Spark, SQL, Python, AWS, Linux, Kafka, Airflow, Docker, Kubernetes
3w
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
1w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago or United States
RemoteFull Time
8+ YOERequires 8+ years in data engineering, strong AWS, Databricks, Spark, SQL, ETL/ELT, and Airflow experience, plus pharmaceutical data, modeling, lakehouse, analytics, and troubleshooting expertise.
Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, Databricks, Apache Spark, SQL, Apache Airflow, ETL, ELT, LLM, RAG
2w
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Seattle or Toronto or Santa Barbara or San Diego
$127k-$190k/yr RemoteFull Time
5+ YOE5+ years in data or software engineering; advanced Python, SQL, Databricks, Spark, and data modeling; experience with orchestration, streaming, cloud infrastructure, data quality, ML datasets, and privacy; bachelor's degree or equivalent.
Python, PySpark, Pandas, Polars, PyArrow, SQL, MySQL, PostgreSQL, Databricks, Delta Lake, Unity Catalog, Workflows, Jobs/Compute, Snowflake, BigQuery, Apache Spark, Airflow, Dagster, Kafka, Kinesis, Spark Structured Streaming, AWS, S3, IAM, FastAPI, Databricks Model Serving, SageMaker endpoints
3w
Save
Mark Applied
Hide
Data Engineer
Romeoville, Illinois, United States
$96k-$134k/yr OnsiteFull Time
5+ YOEBachelor's degree or equivalent experience; 5+ years in data or software engineering; strong SQL, Python, Git, data modeling, production transformations, and collaboration skills.
SQL, Python, Microsoft Power BI, Fabric Data Lake, KQL, Git, Airflow, dbt, Spark, Microsoft Fabric OneLake, Snowflake, BigQuery, Databricks
2w
Save
Mark Applied
Hide
Senior Data Engineer (P1129)
Chicago or Cincinnati or United States
$98k-$169k/yr OnsiteFull Time
3+ YOERequires 3+ years in data development, Databricks, PySpark/Spark, and Python or Java; ETL, data warehousing, orchestration, CI/CD, version control, Agile, AI concepts, and a relevant bachelor's degree.
PySpark, Python, Databricks, FastAPI, Helm, Azure Kubernetes Service (AKS), Spark, Java, Azure, Databricks Delta Tables, Delta Lake, Delta Live Tables, Flask, Kubernetes, Structured Streaming, Kafka, Azure Event Hubs, GitHub, GitHub Actions, Terraform, Tableau, Microsoft Power BI, Cognos
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yr HybridFull Time
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
2w
Save
Mark Applied
Hide
Data Engineer III
Newport Beach or Chicago
$120k-$150k/yr HybridFull Time
5+ YOERequires 5+ years in data engineering or a related field, a bachelor's degree or equivalent experience, SQL, Python, ETL, Azure or cloud data platforms, Git, data modeling, and strong analytical and communication skills.
SQL, Python, Spark, Azure Data Factory, Microsoft Fabric, REST, SOAP, dbt, Microsoft Azure, Git
2mo
Save
Mark Applied
Hide
Lead Data Engineer
McLean or Plano or Chicago or Richmond
$179k-$225k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data technologies, and 1+ year of cloud computing experience; proficiency in data engineering technologies and programming languages.
Java, Scala, Python, SQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, AWS, Microsoft Azure, Google Cloud, RDBMS, NoSQL, Agile, machine learning, distributed microservices, shell scripting
1mo
Save
Mark Applied
Hide
Data Engineer III
Chicago, Illinois, United States
$138k-$173k/yr OnsiteFull Time
5+ YOEBachelor's degree in CS or related,5+ years data engineering experience,proficiency in Python and SQL,cloud and clean-room experience,knowledge of data quality,MarTech and privacy-safe collaboration.
Python, SQL, Apache Airflow, dbt, Spark, NoSQL, BigQuery, Snowflake, Databricks, LiveRamp, Habu, Google Ads Data Hub, Amazon Marketing Cloud, AWS S3, GCP
3mo
Save
Mark Applied
Hide
Sr. Data Engineer
Austin or Chicago or New Hartford or Philadelphia
$130k-$144k/yr RemoteFull Time
5+ YOE5+ years data engineering; project leadership; strong problem-solving; excellent communication; continuous learning; experience with AI/LLM tooling.
Python, SQL, Terraform, Spark, Databricks, Structured Streaming, Postgres, DynamoDB, CircleCI, DroneCI, Github Actions, Spacelift, DataDog, AWS, Azure, data governance, AI/ML integration, Claude Code, Cursor, Copilot, MCP, Agent Orchestrators, Git, Github
Explore Jobs