85 pyspark data engineer jobs at 58 companies in Yorkville, IL
1mo
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$100k-$115k/yr HybridFull Time
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Unity Catalog, Databricks Jobs, Delta Live Tables, Azure Data Factory, ADLS Gen2, Key Vault, SQL, Great Expectations, Deequ, Git, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Log Analytics, Photon
5d
Save
Mark Applied
Hide
Senior Data Engineer
Chicago or Austin or Dallas or New York City or San Francisco or Seattle
$147k-$181k/yr RemoteFull Time
5+ YOERequires 5+ years of data engineering experience, Python, SQL, PySpark, cloud data pipelines, data contracts or quality governance, Delta Lake or sharing technologies, API services, and mentoring experience.
Python, SQL, Azure, Delta Lake, Delta Sharing, PySpark, Spark UI, Databricks, Unity Catalog, Azure Data Factory, Event Hubs, CI/CD
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$110k-$125k/yr OnsiteFull Time
5+ YOEBachelor's degree and 5+ years data engineering experience, expert SQL and strong Python, Spark/PySpark, Azure data services, Azure DevOps, dimensional modeling, and manufacturing data experience preferred.
SQL, Python, Spark, PySpark, Azure SQL databases, Event Hubs, Functions, Data Factory, Key Vault, Microsoft Entra, Azure DevOps, Git, YAML, Delta Lake, Fabric, Databricks, KQL, Eventhouse, Application Insights, MCP, IIoT, MES
1w
Save
Mark Applied
Hide
Data Engineer
Atlanta or Chicago or Fairview Heights or Houston or Arlington
$89k-$148k/yr OnsiteFull Time
5+ YOEBachelor's degree and 5 years of data engineering or software development experience. Requires U.S. citizenship or green card, ability to obtain Public Trust, Java, Python, SQL, PySpark, ETL, databases, Databricks, APIs, and CI/CD experience.
SQL, R, Python, Git, Docker, Kubernetes, Java, PySpark, RESTful, SOAP, Co-Pilot, CodeX, MySQL, PostgreSQL, SQL Server, MongoDB, Databricks, GitHub, Jira, Confluence, Kibana, Tableau, Spring Boot
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$82k-$120k/yr HybridFull Time
3+ YOEBachelor's degree and 3+ years building data pipelines with Databricks (SQL and pyspark) and Snowflake; experience with relational/cloud DBs, data lake/warehouse concepts, Microsoft Azure components, and self-service analytics.
Databricks, SQL, pyspark, Snowflake, SQL Server, Oracle ADW, Redshift, Microsoft Azure, ADLS, Microsoft Azure Key Vault, Microsoft Azure Dev Ops, Power BI, Sigma, Microsoft Azure Data Factory, Informatica
2mo
Save
Mark Applied
Hide
Data Engineer (f/m/x)
Munich or New York City or Denver or Chicago or London or Heidelberg or Singapore
OnsiteFull Time
2+ YOE2+ years data engineering experience; strong Python, Pyspark and SQL skills; ETL/ELT and data pipeline architecture; exposure to cloud (AWS/Azure/GCP), Git and CI/CD; good communication and problem-solving.
Python, Pyspark, SQL, Databricks, Snowflake, SQL Server, AWS, Redshift, S3, Glue, Lambda, Azure DevOps, Azure Repo, Power BI, Docker, Jenkins, Octopus, Git, CI/CD, NoSQL
2w
Save
Mark Applied
Hide
Senior Data Engineer (P1129)
Chicago or Cincinnati or United States
$98k-$169k/yr OnsiteFull Time
3+ YOERequires 3+ years in data development, Databricks, PySpark/Spark, and Python or Java; ETL, data warehousing, orchestration, CI/CD, version control, Agile, AI concepts, and a relevant bachelor's degree.
PySpark, Python, Databricks, FastAPI, Helm, Azure Kubernetes Service (AKS), Spark, Java, Azure, Databricks Delta Tables, Delta Lake, Delta Live Tables, Flask, Kubernetes, Structured Streaming, Kafka, Azure Event Hubs, GitHub, GitHub Actions, Terraform, Tableau, Microsoft Power BI, Cognos
2w
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$175k-$225k/yr OnsiteFull Time
5+ YOERequires 5+ years in data engineering, Kafka streaming and Big Data pipeline experience, Java, Python, SQL, Spark or Flink, Kubernetes, Docker, monitoring tools, statistics, and Unix scripting.
Kafka, Hadoop, Dremio, Java, Python, Apache Spark, Apache Flink, SQL, S3, HDFS, Databricks, Iceberg, Kubernetes, Docker, Prometheus, Grafana, Alert Manager, Alerta, OpsGenie, Unix, Bash
1w
Save
Mark Applied
Hide
Data Engineer
Detroit or Chicago
$130k-$150k/yr HybridFull Time
6+ YOEBachelor’s degree in computer science or related field, 6+ years in data engineering, 3+ years with Azure Databricks or Spark, and expertise in Azure data services, Databricks architecture, DevOps, and client communication.
Microsoft Azure, Microsoft Fabric, Power BI, Databricks, PySpark, Apache Spark, Spark SQL, SQL, Python, Delta Lake, Azure Data Factory, Synapse Data Analytics, Azure SQL, Azure Cosmos DB, Azure Database for PostgreSQL, Unity Catalog, Mosaic AI, GitHub, AKS, Docker, Databricks Genie, Fabric Data Agents
2w
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Seattle or Toronto or Santa Barbara or San Diego
$127k-$190k/yr RemoteFull Time
5+ YOE5+ years in data or software engineering; advanced Python, SQL, Databricks, Spark, and data modeling; experience with orchestration, streaming, cloud infrastructure, data quality, ML datasets, and privacy; bachelor's degree or equivalent.
Python, PySpark, Pandas, Polars, PyArrow, SQL, MySQL, PostgreSQL, Databricks, Delta Lake, Unity Catalog, Workflows, Jobs/Compute, Snowflake, BigQuery, Apache Spark, Airflow, Dagster, Kafka, Kinesis, Spark Structured Streaming, AWS, S3, IAM, FastAPI, Databricks Model Serving, SageMaker endpoints
1w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago or United States
RemoteFull Time
8+ YOERequires 8+ years in data engineering, strong AWS, Databricks, Spark, SQL, ETL/ELT, and Airflow experience, plus pharmaceutical data, modeling, lakehouse, analytics, and troubleshooting expertise.
Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, Databricks, Apache Spark, SQL, Apache Airflow, ETL, ELT, LLM, RAG
5d
Save
Mark Applied
Hide
Data Engineer III
Chicago, Illinois, United States
$138k-$173k/yr OnsiteFull Time
5+ YOERequires 5–8+ years of data engineering experience, 3+ years with cloud-native platforms, expert SQL, ETL/ELT, programming, streaming, DevOps, and customer data platform experience.
Kafka, Spark Structured Streaming, Flink, Dataflow, Confluent, Python, SQL, JavaScript, Node.js, CI/CD, Git, PySpark, Apache Beam, mParticle, Segment, Adobe RTCDP, Braze, Tealium, GCP, BigQuery, Pub/Sub, Cloud Run, Cloud Storage, AWS, Azure
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Chicago or Edina
$102k-$179k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Azure Databricks, PySpark, Spark, Spark SQL, Delta Lake, Delta Live Tables, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Databricks notebooks, Azure DevOps, Git, CI/CD, Pulumi, Apache Iceberg, AKS, Kubernetes, SQL
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Edina or Chicago
$102k-$179k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; strong experience with Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Azure DevOps/Git and CI/CD; experience with metadata, governance, and enterprise-scale analytical platforms; US work authorization required.
Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Delta Live Tables, Spark, Databricks notebooks, Azure DevOps, Git, CI/CD, Infrastructure as Code (IaC), Pulumi, Apache Iceberg, AKS/Kubernetes, SQL
3w
Save
Mark Applied
Hide
Data Engineer - Materials Discovery Research Institute
Skokie, Illinois, United States
$81k-$112k/yr OnsiteFull Time
4+ YOEBachelor’s degree or equivalent experience, 4+ years in data engineering or analytics engineering, strong SQL and Python, cloud platforms, data pipelines, machine learning, and data governance experience.
SQL, Python, pandas, NumPy, scikit-learn, PyTorch, TensorFlow, Microsoft Azure, Amazon Web Services (AWS), Google Cloud, Terraform, Docker, Kubernetes, Apache Spark, Azure Databricks, Azure Data Factory
3d
Save
Mark Applied
Hide
Senior Data Infrastructure Engineer
United States or Chicago
$202k-$238k/yr RemoteFull Time
7+ YOE7+ years in data, infrastructure, or backend engineering; strong distributed-systems, data architecture, SQL, Python, data modeling, and production infrastructure experience; bachelor's degree or equivalent practical experience.
AWS Glue, Apache Spark, Amazon Redshift, Databricks, Tableau, SQL, Python, Apache Airflow, Dagster
6d
Save
Mark Applied
Hide
Lead Data Engineer - Tax Product Development
New York City or Washington or Houston or Chicago or Grand Rapids or Richmond or Raleigh or Boston or Denver or Atlanta or Orlando or Dallas or Milwaukee or Miami or Philadelphia or Charlotte or Seattle or United States
$140k-$210k/yr HybridFull Time
6+ YOEBachelor's degree required and 6+ years of data engineering experience. Requires programming experience and expertise in databases, SQL, ETL/ELT pipelines, data modeling, and distributed data environments.
SQL Server, PostgreSQL, Oracle, CosmosDB, MongoDB, Cassandra, DynamoDB, SQL, Apache Spark, Databricks, Airflow, Talend, Informatica, Python, Java, C#, C++, Scala, Microsoft Office Suite, Microsoft Azure DevOps, GitHub, Microsoft SQL Server, Azure SQL DB
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$120k-$130k/yr OnsiteFull Time
8+ YOE8+ years experience building ETL/ELT pipelines with advanced SQL, Python, PySpark, Azure Data Factory and Databricks; bachelor in computer science required.
SQL, Python, PySpark, Azure Data Factory, Databricks, Azure, ADLS Gen2, Azure SQL, Pulumi, Azure API Services, Azure Function Apps, Delta Lake
1mo
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$175k-$270k/yr HybridFull Time
8+ YOE8+ years building large-scale data platforms, distributed systems, cloud-native data pipelines, EM/ML operationalization, and data warehouse/Big Data solutions; Bachelor's in CS or related.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, Aerospike, Elastic Search, IBM Infosphere, Oracle, SQL Server, AppDynamics, Kubernetes
3w
Save
Mark Applied
Hide
Data Engineer - Materials Discovery Research Institute
Skokie, Illinois, United States
$100k/yr OnsiteFull Time
4+ YOEBachelor's degree in a relevant field or equivalent experience, 4+ years in data engineering, strong SQL and Python skills, and experience with cloud platforms, data pipelines, machine learning, and infrastructure tools.
SQL, Python, pandas, NumPy, scikit-learn, PyTorch, TensorFlow, Azure, AWS, Google Cloud, Terraform, Docker, Kubernetes, Apache Spark, Azure Databricks, Azure Data Factory
Explore Jobs