66 pyspark data engineer jobs at 40 companies in Bartlett, IL

6d
Save
Mark Applied
Hide
Data Engineer
Durham or Boston or Princeton or Emeryville or Evanston or Evanston or New York City or Rockville
$85k-$105k/yr HybridFull Time
Beghou Consulting
Beghou Consulting: Strategic consulting and data analytics for life sciences companies.
3+ YOEBachelor's degree,3+ years data engineering experience,proficient with Python/PySpark,Databricks,AWS/Azure,relational databases,Git,CI/CD,and cloud security/IAM.
Databricks, Python, PySpark, AWS, Azure, PostgreSQL, Oracle, MySQL, Amazon Redshift, Snowflake, Git, Azure AD, Okta, OAuth, SAML, Azure Data Factory, Informatica, SnapLogic, Boomi, Docker, Kubernetes, AWS ECS, Flask, Django, JavaScript, HTML, CSS, Ajax
4w
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$100k-$115k/yr HybridFull Time
HAVI
HAVI: Optimizing global supply chains for leading foodservice and retail brands.
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Unity Catalog, Databricks Jobs, Delta Live Tables, Azure Data Factory, ADLS Gen2, Key Vault, SQL, Great Expectations, Deequ, Git, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Log Analytics, Photon
1w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$110k-$125k/yr OnsiteFull Time
fairlife
fairlifeNYSE: KO: Produces nutrient-dense and ultra-filtered dairy products and shakes.
5+ YOEBachelor's degree and 5+ years data engineering experience, expert SQL and strong Python, Spark/PySpark, Azure data services, Azure DevOps, dimensional modeling, and manufacturing data experience preferred.
SQL, Python, Spark, PySpark, Azure SQL databases, Event Hubs, Functions, Data Factory, Key Vault, Microsoft Entra, Azure DevOps, Git, YAML, Delta Lake, Fabric, Databricks, KQL, Eventhouse, Application Insights, MCP, IIoT, MES
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$120k-$160k/yr HybridFull Time
iManage
iManage: Intelligent document and email management software for professionals.
5+ YOEBachelor's degree in CS or equivalent, 5+ years data engineering, hands-on Databricks/Delta Lake/PySpark, Terraform, CI/CD (GitHub Actions, DABs), data modeling, mentoring experience, and experience migrating platforms preferred.
PySpark, Databricks, Azure Databricks, Delta Lake, Databricks Asset Bundles (DABs), Databricks MCP connector, Terraform, GitHub Actions, Microsoft Synapse, Microsoft Power BI, Salesforce, Zendesk, Microsoft Event Hub, Apache Kafka, Informatica, Collibra
1w
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
Guidehouse
Guidehouse: Provides management and technology consulting services to diverse organizations.
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$82k-$120k/yr HybridFull Time
Conagra Brands
Conagra BrandsNYSE: CAG: Manufactures and markets a variety of packaged food brands.
3+ YOEBachelor's degree and 3+ years building data pipelines with Databricks (SQL and pyspark) and Snowflake; experience with relational/cloud DBs, data lake/warehouse concepts, Microsoft Azure components, and self-service analytics.
Databricks, SQL, pyspark, Snowflake, SQL Server, Oracle ADW, Redshift, Microsoft Azure, ADLS, Microsoft Azure Key Vault, Microsoft Azure Dev Ops, Power BI, Sigma, Microsoft Azure Data Factory, Informatica
1mo
Save
Mark Applied
Hide
Data Engineer (AI/ML)
Chicago, Illinois, United States
$101k-$139k/yr HybridFull Time
Blue Cross Blue Shield Association
Blue Cross Blue Shield Association: National association coordinating independent Blue Cross Blue Shield health plans.
5+ YOE5+ years data engineering experience building cloud-based pipelines for ML/GenAI; Bachelor's/Master's in Computer Science/Engineering; proficiency with PySpark, Databricks, AWS Glue, EMR, Snowflake, Airflow, Kubernetes, Python, and SQL; HIPAA/SOC2/GDPR compliance familiarity.
PySpark, Databricks, AWS Glue, EMR, Snowflake, Airflow, Kubernetes, Amazon Bedrock, Bedrock Agent Core, SageMaker, Python, SQL, AWS, Microsoft Azure, HL7, FHIR
1mo
Save
Mark Applied
Hide
Data Engineer (f/m/x)
Munich or New York City or Denver or Chicago or London or Heidelberg or Singapore
OnsiteFull Time
CEPRES
CEPRES: Digital investment analytics platform for private capital markets.
2+ YOE2+ years data engineering experience; strong Python, Pyspark and SQL skills; ETL/ELT and data pipeline architecture; exposure to cloud (AWS/Azure/GCP), Git and CI/CD; good communication and problem-solving.
Python, Pyspark, SQL, Databricks, Snowflake, SQL Server, AWS, Redshift, S3, Glue, Lambda, Azure DevOps, Azure Repo, Power BI, Docker, Jenkins, Octopus, Git, CI/CD, NoSQL
4w
Save
Mark Applied
Hide
Senior Data Engineer (P1692)
Cincinnati or Chicago
$98k-$169k/yr OnsiteFull Time
84.51°
84.51°NYSE: KR: Provides retail data analytics and targeted advertising services.
3+ YOE3+ years data development experience with Databricks, PySpark/Spark, Python or Java, SQL/JSON, ETL and data warehousing knowledge; experience with CI/CD, pipeline orchestration, version control, and Agile.
Python, Databricks, Spark, JSON, SQL, PySpark, Java, Azure, Databricks Delta Tables, Delta Lake, Delta Live Tables, FastAPI, Flask, AKS, Kubernetes, Helm, Kafka, Azure Event Hub, Github SaaS, Github Actions, Terraform, Tableau, Power BI, Cognos
1mo
Save
Mark Applied
Hide
Senior Staff Data Engineer
Hartford or Chicago or Columbus or Charlotte
$135k-$203k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
8+ YOE8+ years data engineering experience; hands-on with Snowflake, Oracle, Informatica, GitHub, Qlik, SharePlex, DMS; AWS/Azure, EMR, S3, Lambda; Python/PySpark, SQL/NoSQL, CI/CD, ETL; authorized to work in the US without sponsorship.
AWS, Azure, Amazon EMR, Amazon S3, AWS Lambda, Hadoop, Apache Spark, Apache Kafka, Snowflake, Oracle, Informatica Cloud, Informatica PowerCenter, GitHub, Qlik, SharePlex, OpenFlow, DMS, PySpark, Python, SQL, NoSQL, CI/CD, Google Cloud Platform (GCP), AWS Bedrock, Vertex AI
2w
Save
Mark Applied
Hide
Junior Architect / Senior Data Engineer - Remote
Schaumburg or Minneapolis or Washington or Springfield or United States
$92k-$164k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
5+ YOEHands-on experience with Azure Data Factory, Databricks/PySpark, Synapse/Fabric, T-SQL and Python; strong data warehouse, ETL, CI/CD, monitoring and migration skills; willing to travel ~10%.
Azure Data Factory, Azure Synapse Analytics, Databricks, Microsoft Fabric, Azure Data Lake Storage Gen2, Delta Lake, Parquet, PySpark, T-SQL, Spark SQL, KQL, PowerShell, Bash, Azure Key Vault, Azure AD, Entra ID, Azure Monitor, Log Analytics, Azure DevOps, ARM, Bicep, Terraform, Synapse Dedicated SQL Pool, Azure SQL, Teradata, Snowflake, Informatica PowerCenter, Unity Catalog, OneLake, pandas, pytest
3w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
5+ YOE5–8 years data engineering experience with ETL/ELT design, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and Git, experience with PostgreSQL/SparkSQL/Hive/AWS Glue, and ability to mentor engineers.
Apache Spark, Databricks, SQL, Python, Git, Airflow, PostgreSQL, SparkSQL, Hive, AWS Glue, Terraform
1mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Chicago or Edina
$102k-$179k/yr OnsiteFull Time
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Azure Databricks, PySpark, Spark, Spark SQL, Delta Lake, Delta Live Tables, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Databricks notebooks, Azure DevOps, Git, CI/CD, Pulumi, Apache Iceberg, AKS, Kubernetes, SQL
3w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr OnsiteFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
5+ YOE5+ years data engineering experience with ETL/ELT, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and experience with terabyte-to-petabyte datasets.
Apache Spark, Databricks, Airflow, SQL, Python, Git, PostgreSQL, SparkSQL, Hive, AWS Glue, Terraform
1mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Edina or Chicago
$102k-$179k/yr OnsiteFull Time
Vizient
Vizient: Healthcare performance improvement and group purchasing organization.
5+ YOE5+ years data engineering experience; strong experience with Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Azure DevOps/Git and CI/CD; experience with metadata, governance, and enterprise-scale analytical platforms; US work authorization required.
Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Delta Live Tables, Spark, Databricks notebooks, Azure DevOps, Git, CI/CD, Infrastructure as Code (IaC), Pulumi, Apache Iceberg, AKS/Kubernetes, SQL
3w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$100k-$120k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE8+ years experience building ETL/ELT pipelines with SQL, Python, PySpark, Azure Data Factory, Databricks and Pulumi; Bachelor of Computer Science required.
ETL/ELT, SQL, Python, PySpark, Azure Data Factory, Databricks, Delta Lake, Azure, ADLS Gen2, Azure SQL, Pulumi, Azure API Services, Azure Function Apps, CI/CD
4d
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$175k-$270k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
8+ YOE8+ years building large-scale data platforms, distributed systems, cloud-native data pipelines, EM/ML operationalization, and data warehouse/Big Data solutions; Bachelor's in CS or related.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, Aerospike, Elastic Search, IBM Infosphere, Oracle, SQL Server, AppDynamics, Kubernetes
2mo
Save
Mark Applied
Hide
Data Engineer III (CHICAGO, IL, US, 60661-4555)
Chicago, Illinois, United States
$113k-$188k/yr HybridFull Time
Grainger
GraingerNYSE: GWW: Distributes maintenance, repair, and operating supplies to businesses.
7+ YOESenior data engineer skilled in designing and building cloud-native data pipelines and data platforms; 7+ years of experience; SAP S/4HANA knowledge preferred.
Apache Spark, AWS, AWS Glue, Snowflake, Databricks, PostgreSQL, Kafka, Python, SQL, Scala, Docker, Kubernetes, OpenShift, GitHub Actions, Terraform, CloudFormation, SAP S/4HANA, SAP Datasphere
2w
Save
Mark Applied
Hide
Senior Engineer, Technology II (Data Engineering & Architecture)
North Chicago, Illinois, United States
$110k-$209k/yr HybridFull Time
AbbVie
AbbVieNYSE: ABBV: Develops and sells innovative pharmaceutical and biopharmaceutical medicines.
7+ YOE7+ years data architecture/engineering experience with AWS (Glue,S3,EMR), Redshift, Apache Iceberg, SQL, Python, Spark/PySpark; experience with data mesh, Medallion Architecture, SAP/Blue Yonder integration, data governance and cataloging.
AWS Glue, Amazon S3, AWS EMR, AWS Lambda, Informatica, Apache Iceberg, AWS Redshift, SAP, Blue Yonder, SQL, Python, Apache Spark, PySpark, Alation, AWS Glue Data Catalog, PowerBI
1mo
Save
Mark Applied
Hide
Lead Cloud Data Engineer - Multi-Cloud Data Platforms
Irving or Chicago or Hopkins
$133k-$157k/yr HybridFull Time
U.S. Bank
U.S. BankNYSE: USB: Provider of personal, business, and institutional financial services.
6+ YOE6+ years experience building cloud-native data pipelines and products across Azure, AWS, Databricks, and Snowflake; strong Spark and SQL skills; experience with security, governance, and domain-oriented data architectures.
Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, AWS Glue, S3, Databricks, Snowflake, Apache Spark, Delta Lake, SQL, REST, SOAP, GraphQL, Kafka, MQ, AWS SQS, RabbitMQ, API Gateway, OAuth 2.0, TLS, mTLS, JWT, IAM, RBAC, Microsoft Power BI, Tableau