79 pyspark data engineer jobs at 53 companies in Justice, IL
1mo
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$100k-$115k/yr HybridFull Time
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Unity Catalog, Databricks Jobs, Delta Live Tables, Azure Data Factory, ADLS Gen2, Key Vault, SQL, Great Expectations, Deequ, Git, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Log Analytics, Photon
3w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$110k-$125k/yr OnsiteFull Time
5+ YOEBachelor's degree and 5+ years data engineering experience, expert SQL and strong Python, Spark/PySpark, Azure data services, Azure DevOps, dimensional modeling, and manufacturing data experience preferred.
SQL, Python, Spark, PySpark, Azure SQL databases, Event Hubs, Functions, Data Factory, Key Vault, Microsoft Entra, Azure DevOps, Git, YAML, Delta Lake, Fabric, Databricks, KQL, Eventhouse, Application Insights, MCP, IIoT, MES
4d
Save
Mark Applied
Hide
Data Engineer - Databricks
Chicago or Indianapolis or Fort Wayne or Columbus or Lansing or Denver or Dallas or Atlanta
RemoteFull Time
2+ YOEBachelor's degree or equivalent, 2+ years of production data engineering experience, Databricks, PySpark, Spark SQL, Delta Lake, SQL, cloud data services, data modeling, and strong client communication skills.
Databricks, PySpark, Spark SQL, Delta Lake, Delta Live Tables (DLT), Auto Loader, Structured Streaming, Databricks Workflows, Airflow, Azure Data Factory, Unity Catalog, MLflow, Photon, Git, Azure DevOps, GitHub Actions, GitLab, Terraform, dbt, Kafka, Event Hubs, Power BI, Tableau, Docker, Kubernetes, SQL Server, Postgres, Oracle, Snowflake, Azure, AWS, GCP
17h
Save
Mark Applied
Hide
Senior Data Engineer
Salt Lake City or Marietta or Carol Stream or Phoenix or Cypress or DFW Airport
$118k/yr OnsiteFull Time
3+ YOERequires 3+ years in data or analytics engineering, bachelor's degree in computer science or computer engineering, Azure Synapse and Azure SQL experience, SQL, Python or PySpark, ETL/ELT, dimensional modeling, and Power BI.
Azure Synapse Analytics, Azure Logic Apps, Microsoft Graph, Python, PySpark, SQL, Azure SQL Database, Power BI, Microsoft SQL Server
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$120k-$160k/yr HybridFull Time
5+ YOEBachelor's degree in CS or equivalent, 5+ years data engineering, hands-on Databricks/Delta Lake/PySpark, Terraform, CI/CD (GitHub Actions, DABs), data modeling, mentoring experience, and experience migrating platforms preferred.
PySpark, Databricks, Azure Databricks, Delta Lake, Databricks Asset Bundles (DABs), Databricks MCP connector, Terraform, GitHub Actions, Microsoft Synapse, Microsoft Power BI, Salesforce, Zendesk, Microsoft Event Hub, Apache Kafka, Informatica, Collibra
2w
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$82k-$120k/yr HybridFull Time
3+ YOEBachelor's degree and 3+ years building data pipelines with Databricks (SQL and pyspark) and Snowflake; experience with relational/cloud DBs, data lake/warehouse concepts, Microsoft Azure components, and self-service analytics.
Databricks, SQL, pyspark, Snowflake, SQL Server, Oracle ADW, Redshift, Microsoft Azure, ADLS, Microsoft Azure Key Vault, Microsoft Azure Dev Ops, Power BI, Sigma, Microsoft Azure Data Factory, Informatica
2mo
Save
Mark Applied
Hide
Data Engineer (AI/ML)
Chicago, Illinois, United States
$101k-$139k/yr HybridFull Time
5+ YOE5+ years data engineering experience building cloud-based pipelines for ML/GenAI; Bachelor's/Master's in Computer Science/Engineering; proficiency with PySpark, Databricks, AWS Glue, EMR, Snowflake, Airflow, Kubernetes, Python, and SQL; HIPAA/SOC2/GDPR compliance familiarity.
PySpark, Databricks, AWS Glue, EMR, Snowflake, Airflow, Kubernetes, Amazon Bedrock, Bedrock Agent Core, SageMaker, Python, SQL, AWS, Microsoft Azure, HL7, FHIR
1mo
Save
Mark Applied
Hide
Data Engineer (f/m/x)
Munich or New York City or Denver or Chicago or London or Heidelberg or Singapore
OnsiteFull Time
2+ YOE2+ years data engineering experience; strong Python, Pyspark and SQL skills; ETL/ELT and data pipeline architecture; exposure to cloud (AWS/Azure/GCP), Git and CI/CD; good communication and problem-solving.
Python, Pyspark, SQL, Databricks, Snowflake, SQL Server, AWS, Redshift, S3, Glue, Lambda, Azure DevOps, Azure Repo, Power BI, Docker, Jenkins, Octopus, Git, CI/CD, NoSQL
1d
Save
Mark Applied
Hide
Senior Data Engineer (P1129)
Chicago or Cincinnati or United States
$98k-$169k/yr OnsiteFull Time
3+ YOERequires 3+ years in data development, Databricks, PySpark/Spark, and Python or Java; ETL, data warehousing, orchestration, CI/CD, version control, Agile, AI concepts, and a relevant bachelor's degree.
PySpark, Python, Databricks, FastAPI, Helm, Azure Kubernetes Service (AKS), Spark, Java, Azure, Databricks Delta Tables, Delta Lake, Delta Live Tables, Flask, Kubernetes, Structured Streaming, Kafka, Azure Event Hubs, GitHub, GitHub Actions, Terraform, Tableau, Microsoft Power BI, Cognos
5d
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$175k-$225k/yr OnsiteFull Time
5+ YOERequires 5+ years in data engineering, Kafka streaming and Big Data pipeline experience, Java, Python, SQL, Spark or Flink, Kubernetes, Docker, monitoring tools, statistics, and Unix scripting.
Kafka, Hadoop, Dremio, Java, Python, Apache Spark, Apache Flink, SQL, S3, HDFS, Databricks, Iceberg, Kubernetes, Docker, Prometheus, Grafana, Alert Manager, Alerta, OpsGenie, Unix, Bash
3d
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Seattle or Toronto or Santa Barbara or San Diego
$127k-$190k/yr RemoteFull Time
5+ YOE5+ years in data or software engineering; advanced Python, SQL, Databricks, Spark, and data modeling; experience with orchestration, streaming, cloud infrastructure, data quality, ML datasets, and privacy; bachelor's degree or equivalent.
Python, PySpark, Pandas, Polars, PyArrow, SQL, MySQL, PostgreSQL, Databricks, Delta Lake, Unity Catalog, Workflows, Jobs/Compute, Snowflake, BigQuery, Apache Spark, Airflow, Dagster, Kafka, Kinesis, Spark Structured Streaming, AWS, S3, IAM, FastAPI, Databricks Model Serving, SageMaker endpoints
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Chicago or Edina
$102k-$179k/yr OnsiteFull Time
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Azure Databricks, PySpark, Spark, Spark SQL, Delta Lake, Delta Live Tables, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Databricks notebooks, Azure DevOps, Git, CI/CD, Pulumi, Apache Iceberg, AKS, Kubernetes, SQL
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Edina or Chicago
$102k-$179k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; strong experience with Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Azure DevOps/Git and CI/CD; experience with metadata, governance, and enterprise-scale analytical platforms; US work authorization required.
Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Delta Live Tables, Spark, Databricks notebooks, Azure DevOps, Git, CI/CD, Infrastructure as Code (IaC), Pulumi, Apache Iceberg, AKS/Kubernetes, SQL
1w
Save
Mark Applied
Hide
Data Engineer - Materials Discovery Research Institute
Skokie, Illinois, United States
$81k-$112k/yr OnsiteFull Time
4+ YOEBachelor’s degree or equivalent experience, 4+ years in data engineering or analytics engineering, strong SQL and Python, cloud platforms, data pipelines, machine learning, and data governance experience.
SQL, Python, pandas, NumPy, scikit-learn, PyTorch, TensorFlow, Microsoft Azure, Amazon Web Services (AWS), Google Cloud, Terraform, Docker, Kubernetes, Apache Spark, Azure Databricks, Azure Data Factory
5d
Save
Mark Applied
Hide
Lead Data Engineer (Sr. Palantir Engineer)
Chicago, Illinois, United States
$150k-$180k/yr OnsiteFull Time
8+ YOERequires 8+ years in data engineering, strong PySpark, Spark SQL, and Python skills, and deep Palantir Foundry experience. Requires data modeling, governance, access control, troubleshooting, and performance optimization expertise.
PySpark, Spark SQL, Python, Palantir Foundry, Pipeline Builder, Contour, Workshop, Quiver, Azure, Snowflake, Generative AI (GenAI)
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$100k-$120k/yr OnsiteFull Time
8+ YOE8+ years experience building ETL/ELT pipelines with SQL, Python, PySpark, Azure Data Factory, Databricks and Pulumi; Bachelor of Computer Science required.
ETL/ELT, SQL, Python, PySpark, Azure Data Factory, Databricks, Delta Lake, Azure, ADLS Gen2, Azure SQL, Pulumi, Azure API Services, Azure Function Apps, CI/CD
2w
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$175k-$270k/yr HybridFull Time
8+ YOE8+ years building large-scale data platforms, distributed systems, cloud-native data pipelines, EM/ML operationalization, and data warehouse/Big Data solutions; Bachelor's in CS or related.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, Aerospike, Elastic Search, IBM Infosphere, Oracle, SQL Server, AppDynamics, Kubernetes
1w
Save
Mark Applied
Hide
Data Engineer - Materials Discovery Research Institute
Skokie, Illinois, United States
$100k/yr OnsiteFull Time
4+ YOEBachelor's degree in a relevant field or equivalent experience, 4+ years in data engineering, strong SQL and Python skills, and experience with cloud platforms, data pipelines, machine learning, and infrastructure tools.
SQL, Python, pandas, NumPy, scikit-learn, PyTorch, TensorFlow, Azure, AWS, Google Cloud, Terraform, Docker, Kubernetes, Apache Spark, Azure Databricks, Azure Data Factory
13h
Save
Mark Applied
Hide
Sr Data Platform Engineer
Chicago, Illinois, United States
$122k-$183k/yr RemoteFull Time
4+ YOERequires 4–6 years in data platform engineering or data architecture, AWS, Databricks or Snowflake, Terraform, Python, and SQL; migration and technical leadership experience preferred.
Snowflake, Apache Iceberg, Python, Apache Spark, Databricks, Amazon S3, AWS IAM, AWS CloudTrail, Amazon VPC, Amazon Route 53, Delta Lake, Photon, Snowpark, Terraform, SQL, Unity Catalog, ETL, ELT, Hadoop?
Explore Jobs