71 pyspark data engineer jobs at 48 companies in Lyons, IL
1w
Save
Mark Applied
Hide
Data Engineer
Durham or Boston or Princeton or Emeryville or Evanston or Evanston or New York City or Rockville
$85k-$105k/yr HybridFull Time
3+ YOEBachelor's degree,3+ years data engineering experience,proficient with Python/PySpark,Databricks,AWS/Azure,relational databases,Git,CI/CD,and cloud security/IAM.
Databricks, Python, PySpark, AWS, Azure, PostgreSQL, Oracle, MySQL, Amazon Redshift, Snowflake, Git, Azure AD, Okta, OAuth, SAML, Azure Data Factory, Informatica, SnapLogic, Boomi, Docker, Kubernetes, AWS ECS, Flask, Django, JavaScript, HTML, CSS, Ajax
1mo
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$100k-$115k/yr HybridFull Time
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Unity Catalog, Databricks Jobs, Delta Live Tables, Azure Data Factory, ADLS Gen2, Key Vault, SQL, Great Expectations, Deequ, Git, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Log Analytics, Photon
3w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$110k-$125k/yr OnsiteFull Time
5+ YOEBachelor's degree and 5+ years data engineering experience, expert SQL and strong Python, Spark/PySpark, Azure data services, Azure DevOps, dimensional modeling, and manufacturing data experience preferred.
SQL, Python, Spark, PySpark, Azure SQL databases, Event Hubs, Functions, Data Factory, Key Vault, Microsoft Entra, Azure DevOps, Git, YAML, Delta Lake, Fabric, Databricks, KQL, Eventhouse, Application Insights, MCP, IIoT, MES
20h
Save
Mark Applied
Hide
Data Engineer - Databricks
Chicago or Indianapolis or Fort Wayne or Columbus or Lansing or Denver or Dallas or Atlanta
RemoteFull Time
2+ YOEBachelor's degree or equivalent, 2+ years of production data engineering experience, Databricks, PySpark, Spark SQL, Delta Lake, SQL, cloud data services, data modeling, and strong client communication skills.
Databricks, PySpark, Spark SQL, Delta Lake, Delta Live Tables (DLT), Auto Loader, Structured Streaming, Databricks Workflows, Airflow, Azure Data Factory, Unity Catalog, MLflow, Photon, Git, Azure DevOps, GitHub Actions, GitLab, Terraform, dbt, Kafka, Event Hubs, Power BI, Tableau, Docker, Kubernetes, SQL Server, Postgres, Oracle, Snowflake, Azure, AWS, GCP
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$120k-$160k/yr HybridFull Time
5+ YOEBachelor's degree in CS or equivalent, 5+ years data engineering, hands-on Databricks/Delta Lake/PySpark, Terraform, CI/CD (GitHub Actions, DABs), data modeling, mentoring experience, and experience migrating platforms preferred.
PySpark, Databricks, Azure Databricks, Delta Lake, Databricks Asset Bundles (DABs), Databricks MCP connector, Terraform, GitHub Actions, Microsoft Synapse, Microsoft Power BI, Salesforce, Zendesk, Microsoft Event Hub, Apache Kafka, Informatica, Collibra
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$82k-$120k/yr HybridFull Time
3+ YOEBachelor's degree and 3+ years building data pipelines with Databricks (SQL and pyspark) and Snowflake; experience with relational/cloud DBs, data lake/warehouse concepts, Microsoft Azure components, and self-service analytics.
Databricks, SQL, pyspark, Snowflake, SQL Server, Oracle ADW, Redshift, Microsoft Azure, ADLS, Microsoft Azure Key Vault, Microsoft Azure Dev Ops, Power BI, Sigma, Microsoft Azure Data Factory, Informatica
1mo
Save
Mark Applied
Hide
Data Engineer (AI/ML)
Chicago, Illinois, United States
$101k-$139k/yr HybridFull Time
5+ YOE5+ years data engineering experience building cloud-based pipelines for ML/GenAI; Bachelor's/Master's in Computer Science/Engineering; proficiency with PySpark, Databricks, AWS Glue, EMR, Snowflake, Airflow, Kubernetes, Python, and SQL; HIPAA/SOC2/GDPR compliance familiarity.
PySpark, Databricks, AWS Glue, EMR, Snowflake, Airflow, Kubernetes, Amazon Bedrock, Bedrock Agent Core, SageMaker, Python, SQL, AWS, Microsoft Azure, HL7, FHIR
1mo
Save
Mark Applied
Hide
Data Engineer (f/m/x)
Munich or New York City or Denver or Chicago or London or Heidelberg or Singapore
OnsiteFull Time
2+ YOE2+ years data engineering experience; strong Python, Pyspark and SQL skills; ETL/ELT and data pipeline architecture; exposure to cloud (AWS/Azure/GCP), Git and CI/CD; good communication and problem-solving.
Python, Pyspark, SQL, Databricks, Snowflake, SQL Server, AWS, Redshift, S3, Glue, Lambda, Azure DevOps, Azure Repo, Power BI, Docker, Jenkins, Octopus, Git, CI/CD, NoSQL
1mo
Save
Mark Applied
Hide
Senior Data Engineer (P1692)
Cincinnati or Chicago
$98k-$169k/yr OnsiteFull Time
3+ YOE3+ years data development experience with Databricks, PySpark/Spark, Python or Java, SQL/JSON, ETL and data warehousing knowledge; experience with CI/CD, pipeline orchestration, version control, and Agile.
Python, Databricks, Spark, JSON, SQL, PySpark, Java, Azure, Databricks Delta Tables, Delta Lake, Delta Live Tables, FastAPI, Flask, AKS, Kubernetes, Helm, Kafka, Azure Event Hub, Github SaaS, Github Actions, Terraform, Tableau, Power BI, Cognos
1mo
Save
Mark Applied
Hide
Senior Staff Data Engineer
Hartford or Chicago or Columbus or Charlotte
$135k-$203k/yr HybridFull Time
8+ YOE8+ years data engineering experience; hands-on with Snowflake, Oracle, Informatica, GitHub, Qlik, SharePlex, DMS; AWS/Azure, EMR, S3, Lambda; Python/PySpark, SQL/NoSQL, CI/CD, ETL; authorized to work in the US without sponsorship.
AWS, Azure, Amazon EMR, Amazon S3, AWS Lambda, Hadoop, Apache Spark, Apache Kafka, Snowflake, Oracle, Informatica Cloud, Informatica PowerCenter, GitHub, Qlik, SharePlex, OpenFlow, DMS, PySpark, Python, SQL, NoSQL, CI/CD, Google Cloud Platform (GCP), AWS Bedrock, Vertex AI
1d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Chicago or Edina
$102k-$179k/yr OnsiteFull Time
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Azure Databricks, PySpark, Spark, Spark SQL, Delta Lake, Delta Live Tables, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Databricks notebooks, Azure DevOps, Git, CI/CD, Pulumi, Apache Iceberg, AKS, Kubernetes, SQL
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Edina or Chicago
$102k-$179k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; strong experience with Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Azure DevOps/Git and CI/CD; experience with metadata, governance, and enterprise-scale analytical platforms; US work authorization required.
Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Delta Live Tables, Spark, Databricks notebooks, Azure DevOps, Git, CI/CD, Infrastructure as Code (IaC), Pulumi, Apache Iceberg, AKS/Kubernetes, SQL
1d
Save
Mark Applied
Hide
Lead Data Engineer (Sr. Palantir Engineer)
Chicago, Illinois, United States
$150k-$180k/yr OnsiteFull Time
8+ YOERequires 8+ years in data engineering, strong PySpark, Spark SQL, and Python skills, and deep Palantir Foundry experience. Requires data modeling, governance, access control, troubleshooting, and performance optimization expertise.
PySpark, Spark SQL, Python, Palantir Foundry, Pipeline Builder, Contour, Workshop, Quiver, Azure, Snowflake, Generative AI (GenAI)
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$100k-$120k/yr OnsiteFull Time
8+ YOE8+ years experience building ETL/ELT pipelines with SQL, Python, PySpark, Azure Data Factory, Databricks and Pulumi; Bachelor of Computer Science required.
ETL/ELT, SQL, Python, PySpark, Azure Data Factory, Databricks, Delta Lake, Azure, ADLS Gen2, Azure SQL, Pulumi, Azure API Services, Azure Function Apps, CI/CD
1w
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$175k-$270k/yr HybridFull Time
8+ YOE8+ years building large-scale data platforms, distributed systems, cloud-native data pipelines, EM/ML operationalization, and data warehouse/Big Data solutions; Bachelor's in CS or related.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, Aerospike, Elastic Search, IBM Infosphere, Oracle, SQL Server, AppDynamics, Kubernetes
4d
Save
Mark Applied
Hide
Data Engineer - Materials Discovery Research Institute
Skokie, Illinois, United States
$100k/yr OnsiteFull Time
4+ YOEBachelor's degree in a relevant field or equivalent experience, 4+ years in data engineering, strong SQL and Python skills, and experience with cloud platforms, data pipelines, machine learning, and infrastructure tools.
SQL, Python, pandas, NumPy, scikit-learn, PyTorch, TensorFlow, Azure, AWS, Google Cloud, Terraform, Docker, Kubernetes, Apache Spark, Azure Databricks, Azure Data Factory
6d
Save
Mark Applied
Hide
Manager, Data Engineering
Chicago, Illinois, United States
$89k-$127k/yr HybridFull Time
BS in CS/IT or related; hands-on PySpark, Python, SQL; experience building API-based pipelines; knowledge of data architecture, ETL, warehouses/lakehouses; strong documentation and communication skills.
PySpark, Python, SQL, REST, GraphQL, AWS, Azure, Databricks, Snowflake, Redshift, Tableau, Datorama
1w
Save
Mark Applied
Hide
Senior Data AI Engineer
Chicago, Illinois, United States
$72k-$141k/yr HybridFull Time
7+ YOEDesign and productionize scalable AI/ML solutions on cloud lakehouses; strong GCP, Python, SQL, vector DB and RAG experience; typically 7+ years of relevant data engineering/AI experience; BS required, MS preferred.
Vertex AI, BigQuery, Cloud Run, Pub/Sub, Dataflow, Apache Spark, Dataproc, Python, SQL, Claude Code, Vertex AI Vector Search, Pinecone, pgvector, text-embedding-gecko, OpenAI Ada, Cohere, ADK, LLM
2mo
Save
Mark Applied
Hide
Data Engineer III (CHICAGO, IL, US, 60661-4555)
Chicago, Illinois, United States
$113k-$188k/yr HybridFull Time
7+ YOESenior data engineer skilled in designing and building cloud-native data pipelines and data platforms; 7+ years of experience; SAP S/4HANA knowledge preferred.
Apache Spark, AWS, AWS Glue, Snowflake, Databricks, PostgreSQL, Kafka, Python, SQL, Scala, Docker, Kubernetes, OpenShift, GitHub Actions, Terraform, CloudFormation, SAP S/4HANA, SAP Datasphere
Explore Jobs