110 spark data engineer jobs at 60 companies in Lyons, IL
1mo
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$100k-$115k/yr HybridFull Time
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Unity Catalog, Databricks Jobs, Delta Live Tables, Azure Data Factory, ADLS Gen2, Key Vault, SQL, Great Expectations, Deequ, Git, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Log Analytics, Photon
5d
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$46-$69/hr OnsiteFull Time
5+ YOEBachelor's degree and 5+ years experience; strong cloud, software engineering and data processing background; ETL, RDBMS, Python, SQL, NoSQL, Spark experience; strong analytical and communication skills.
Pentaho, Talend, Informatica, Azure Data Factory, Apache Kafka, Apache Camel, Cloudera Hadoop, Hortonworks Data Platform, Databricks, Oracle, SQL Server, DB2, MySQL, Python, SQL, NoSQL, Spark
2w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$110k-$125k/yr OnsiteFull Time
5+ YOEBachelor's degree and 5+ years data engineering experience, expert SQL and strong Python, Spark/PySpark, Azure data services, Azure DevOps, dimensional modeling, and manufacturing data experience preferred.
SQL, Python, Spark, PySpark, Azure SQL databases, Event Hubs, Functions, Data Factory, Key Vault, Microsoft Entra, Azure DevOps, Git, YAML, Delta Lake, Fabric, Databricks, KQL, Eventhouse, Application Insights, MCP, IIoT, MES
1mo
Save
Mark Applied
Hide
Data Engineer III
Lake Forest or Chicago
$105k-$174k/yr HybridFull Time
3+ YOEBachelor's degree or equivalent; 3+ years data engineering experience with Airflow, Kafka, Spark, Python/Scala; strong cloud and analytics tooling experience (AWS, Snowflake, dbt); mentoring and building scalable data pipelines.
AWS, SQL, Python, Docker, Kubernetes, CI/CD, Git, Snowflake, dbt, Airflow, Kafka, Spark, Scala
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr OnsiteFull Time
6+ YOEBA/BS in CS or related; 6+ years data engineering experience; strong Databricks, AWS, Spark, SQL, Python, Linux, and cloud-native ETL/ELT skills; experience with Kafka, Airflow, Docker, and Kubernetes preferred.
Databricks, AWS, Spark, SQL, Python, Linux, Kafka, Airflow, Docker, Kubernetes
2d
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Chicago
$170k-$230k/yr HybridFull Time
Experience building production data pipelines at scale with advanced Python, SQL, Airflow, Spark, and AWS; healthcare data expertise and strong data quality, reliability, troubleshooting, and collaboration skills required.
Python, SQL, Airflow, AWS, Spark, ChatGPT, Gemini, Claude, ICD-10, CPT, NDC, NPI
1mo
Save
Mark Applied
Hide
Data Engineer
Charlotte or Chicago or Hartford or Columbus
$101k-$151k/yr HybridFull Time
2+ YOE2+ years relevant experience; Bachelor’s in CS/Engineering/IT/MIS required; experience with R/Python/SQL, Hadoop/Spark, ETL, Linux, Git; familiarity with automation tools and AWS services; strong communication skills.
R, Python, SQL, Hadoop, Spark, XML, JSON, ETL, Linux, Git, GitHub, Autosys, Cron, Airflow, Amazon S3, Amazon EMR, MLOps, Agile
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr HybridFull Time
6+ YOEBA/BS in Computer Science or related, 6+ years data engineering experience. Strong experience with Databricks, Spark, SQL, Python, AWS, Linux; familiarity with Kafka, Airflow, Docker, Kubernetes; strong communication and problem-solving skills.
Databricks, Spark, SQL, Python, AWS, Linux, Kafka, Airflow, Docker, Kubernetes
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Chicago, Illinois, United States
$179k-$205k/yr OnsiteFull Time
4+ YOEBachelor's degree and minimum 4 years application development, 2+ years big data, 1+ year cloud; experience with Python/Java/Scala, Spark, data warehouses and distributed systems; strong communication and mentoring skills.
Python, Spark, AWS, Databricks, Snowflake, Airflow, Java, Scala, Redshift, MapReduce, Hadoop, Hive, EMR, Kafka, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, SQL, Microsoft Azure, Google Cloud
1w
Save
Mark Applied
Hide
Data Engineer II - Zelle
Scottsdale or Chicago or San Francisco or New York City
$97k-$149k/yr HybridFull Time
2+ YOEBachelor's degree typical; 2+ years experience building data engineering tools with Spark and Python, experience with ML toolkits, Hadoop or AWS/S3, and relational databases; strong communication and background/drug screen required.
Spark, Python, R, Hadoop, AWS/S3, Scala, Java
1d
Save
Mark Applied
Hide
Data Engineer
Romeoville, Illinois, United States
$96k-$134k/yr OnsiteFull Time
5+ YOEBachelor's degree or equivalent experience; 5+ years in data or software engineering; strong SQL, Python, Git, data modeling, production transformations, and collaboration skills.
SQL, Python, Microsoft Power BI, Fabric Data Lake, KQL, Git, Airflow, dbt, Spark, Microsoft Fabric OneLake, Snowflake, BigQuery, Databricks
3w
Save
Mark Applied
Hide
Data Engineer
Charlotte or Chicago or Columbus or Hartford
$101k-$151k/yr HybridFull Time
2+ YOE2+ years data engineering experience, 2+ years Python and SQL, experience building cloud data pipelines, familiarity with AWS/GCP, CI/CD, IaC, data warehouse platforms, and ML workflows.
SQL, Python, AWS, GCP, GitHub, GitHub Actions, Jenkins, Terraform, CloudFormation, Apache Airflow, Cloud Composer, Snowflake, Redshift, BigQuery, Docker, Kubernetes, dbt, Spark, Hadoop
2w
Save
Mark Applied
Hide
Senior Data Engineer
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yr HybridFull Time
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
1mo
Save
Mark Applied
Hide
Lead Data Engineer (P4519)
Cincinnati or Chicago
$125k-$207k/yr OnsiteFull Time
5+ YOEBachelor's degree, 5+ years professional data development experience, Databricks/Spark and Python experience, ETL and data warehousing knowledge, Kubernetes and REST API development experience, Agile/Scrum familiarity.
Azure, Databricks, Spark, SQL, PySpark, Databricks Workflows, Python, JSON, Kubernetes, REST APIs
3w
Save
Mark Applied
Hide
Principal Data Engineer, People Data
Bellevue or Chicago or San Francisco or Washington
$197k-$271k/yr HybridFull Time
10+ YOE10+ years data engineering experience; expert SQL, ETL/ELT, MPP databases, AWS services; HR/People data experience; experience with batch and realtime pipelines, lakehouse architectures, and data quality frameworks.
SQL, Airflow, dbt, Snowflake, Redshift, Amazon S3, AWS Lambda, EMR, ECR, EKS, Workday, Spark, Kafka, Databricks, Iceberg, Delta
1mo
Save
Mark Applied
Hide
Data Engineer III
Chicago, Illinois, United States
$138k-$173k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience, Bachelor’s/Master’s in Computer Science or related, strong Python and SQL skills, experience with cloud data platforms, clean room and privacy-safe data practices.
Python, SQL, Apache Airflow, dbt, Spark, NoSQL, BigQuery, Snowflake, Databricks, GCP, AWS S3, LiveRamp, Habu, LiveRamp Connect, AWS Clean Rooms, Snowflake Clean Rooms, Google Ads Data Hub, Amazon Marketing Cloud
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
Austin or Chicago or New Hartford or Philadelphia
$130k-$144k/yr RemoteFull Time
5+ YOE5+ years data engineering; project leadership; strong problem-solving; excellent communication; continuous learning; experience with AI/LLM tooling.
Python, SQL, Terraform, Spark, Databricks, Structured Streaming, Postgres, DynamoDB, CircleCI, DroneCI, Github Actions, Spacelift, DataDog, AWS, Azure, data governance, AI/ML integration, Claude Code, Cursor, Copilot, MCP, Agent Orchestrators, Git, Github
1mo
Save
Mark Applied
Hide
Data Engineer Lead
Lake Elmo or Chicago or Evansville or Milwaukee
$98k-$199k/yr OnsiteFull Time
7+ YOEBachelor's or equivalent with 7+ years data engineering experience, 5+ years AWS, expertise with data warehouses, SQL, Python, Bash, Spark, Databricks, and experience leading teams.
AWS, S3, Glue, Lambda, Databricks, SQL, Python, Bash, Spark, GitOps
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Chicago or Edina
$102k-$179k/yr OnsiteFull Time
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Azure Databricks, PySpark, Spark, Spark SQL, Delta Lake, Delta Live Tables, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Databricks notebooks, Azure DevOps, Git, CI/CD, Pulumi, Apache Iceberg, AKS, Kubernetes, SQL
1mo
Save
Mark Applied
Hide
Data Quality Engineer
Alpharetta or Birmingham or Chicago or Downers Grove or Jacksonville or Connecticut or New Jersey or Ohio or Pennsylvania or Rhode Island or Virginia
$99k-$165k/yr HybridFull Time
6+ YOE6+ years data engineering/testing experience; Bachelor's in CS/Info Systems or equivalent; expertise with SQL, Informatica/IICS/IDMC, Snowflake, Oracle, AWS, Python; strong data validation, reconciliation, and test automation skills.
SQL, Informatica, IICS, IDMC, Snowflake, Python, Oracle, AWS, XML, JSON, Power BI, PowerShell, Git, Spark, Kafka, Airflow, DBT, CI/CD, Infrastructure as Code
Explore Jobs