HiringCafe
Join our community

65 pyspark developer jobs at 39 companies in Hoffman Estates, IL

1d
Save
Mark Applied
Hide
Sr. Software Engineer - PySpark
Scottsdale or San Francisco or Chicago or New York City
$118k-$152k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
5+ YOEBachelor's-level education typical; minimum 5 years software engineering experience; strong with Git, Spring/Spring Boot, SQL, REST, Docker/Kubernetes, Kafka, automated testing and DevOps practices.
Git, Git flow, Spring, Spring Boot, SQL, Confluence, CI/CD, Docker, Kubernetes, Kafka, Hadoop, Hive, XML, JSON, YAML, Redis, HBASE, AeroSpike, REST
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$120k-$130k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE8+ years experience building ETL/ELT pipelines with advanced SQL, Python, PySpark, Azure Data Factory and Databricks; bachelor in computer science required.
SQL, Python, PySpark, Azure Data Factory, Databricks, Azure, ADLS Gen2, Azure SQL, Pulumi, Azure API Services, Azure Function Apps, Delta Lake
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Chicago, Illinois, United States
$89k-$165k/yr OnsiteFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
5+ YOE5-8 years in software engineering; large-scale data engineering, distributed systems; Databricks, AWS, Python, PySpark; SQL/NoSQL; CI/CD; IaC (Terraform/Ansible).
Databricks, Python, PySpark, Apache Spark, AWS, S3, Lambda, API Gateway, EventBridge, Kafka, SQL Server, MongoDB, Jenkins, GitHub, GitLab, Bitbucket, Terraform, Ansible
Job PostingView all
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Engineer (P1692)
Cincinnati or Chicago
$98k-$169k/yr OnsiteFull Time
84.51°
84.51°NYSE: KR: Provides retail data analytics and targeted advertising services.
3+ YOE3+ years data development experience with Databricks, PySpark/Spark, Python or Java, SQL/JSON, ETL and data warehousing knowledge; experience with CI/CD, pipeline orchestration, version control, and Agile.
Python, Databricks, Spark, JSON, SQL, PySpark, Java, Azure, Databricks Delta Tables, Delta Lake, Delta Live Tables, FastAPI, Flask, AKS, Kubernetes, Helm, Kafka, Azure Event Hub, Github SaaS, Github Actions, Terraform, Tableau, Power BI, Cognos
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer
Chicago, Illinois, United States
$74k-$137k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
3+ YOE3+ years development experience in distributed environments; proficiency in Scala, Python or Java; familiarity with Apache Spark, Hive, Hadoop; experience with cloud platforms (AWS, Azure, GCP, Databricks); BA/BS in CS required.
Apache Spark, Hive, Hadoop, Databricks, AWS, Azure, GCP, Scala, Python, Java, Kubernetes, Docker, Airflow
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Full Stack Engineer - AI (Chicago, IL, US)
Chicago, Illinois, United States
$140k-$150k/yr HybridFull Time
Fitch Group
Fitch Group: Provides global credit ratings and financial market research services.
5+ YOE5+ years software engineering experience; bachelor's degree preferred; experience with React, Java micro-services, Kafka, AWS data services, Python (PySpark, Pandas, FastAPI), SQL, Airflow, Snowflake, data governance tools, and designing REST/GraphQL APIs.
React, micro-frontend, micro-services, Java, Kafka, CI/CD, Python, PySpark, Pandas, FastAPI, SQL, SQL Server, PostgreSQL, AWS Glue, AWS Lambda, Amazon S3, Amazon DynamoDB, Airflow, Snowflake, Iceberg, Delta Lake, Collibra, Alation, Starburst, REST, GraphQL, GitHub Copilot, Claude Code, Amazon Q, Cursor, Azure Blob storage, Azure Functions, MCP
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Chicago, Illinois, United States
$123k-$150k/yr OnsiteFull Time
JLL
JLLNYSE: JLL: Global commercial real estate and investment management services.
5+ YOE5–8 years software development with leadership; bachelor’s in CS, engineering, or related field; strong backend and frontend experience.
C#, Node.js, Python, Java, Angular, React, Next.js, Vue.js, REST, Microservices, SQL Server, PostgreSQL, MongoDB, Cosmos DB, Databricks, Python, PySpark, Spark SQL, Power BI, DAX, Power Query, Git, CI/CD, Azure, Docker, Kubernetes, Azure AI, AI/ML, Event-driven systems
Job PostingView all
3d
Save
Mark Applied
Hide
2026015 - Senior Software Engineer
Chicago, Illinois, United States
$125k-$135k/yr OnsiteFull Time
John Deere
John DeereNYSE: DE: Manufactures and distributes agricultural, construction, and forestry equipment.
5+ YOE5+ years designing and developing scalable data products and ETL pipelines; bachelor's in CS or related; experience with data modeling, query optimization, leadership in SDLC, and mentoring.
Abinitio, Talend, UNIX, SQL, AWS Services, Python, Apache Spark
Job PostingView all
3d
Save
Mark Applied
Hide
Data Engineer
Durham or Boston or Princeton or Emeryville or Evanston or Evanston or New York City or Rockville
$85k-$105k/yr HybridFull Time
Beghou Consulting
Beghou Consulting: Strategic consulting and data analytics for life sciences companies.
3+ YOEBachelor's degree,3+ years data engineering experience,proficient with Python/PySpark,Databricks,AWS/Azure,relational databases,Git,CI/CD,and cloud security/IAM.
Databricks, Python, PySpark, AWS, Azure, PostgreSQL, Oracle, MySQL, Amazon Redshift, Snowflake, Git, Azure AD, Okta, OAuth, SAML, Azure Data Factory, Informatica, SnapLogic, Boomi, Docker, Kubernetes, AWS ECS, Flask, Django, JavaScript, HTML, CSS, Ajax
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Developer, Analytics (Hybrid)
Redmond or Rosemont
HybridFull Time
PAC Worldwide
PAC Worldwide: Manufacturer of custom protective and automated packaging solutions.
8+ YOE8+ years in analytics or data engineering, manufacturing cost/financial analytics experience, Power BI, Microsoft Fabric/Synapse, SQL, Delta Lake, Python/PySpark, ETL design, data governance, and stakeholder collaboration.
Power BI, Microsoft Fabric, Synapse, SQL, Delta Lake, Python, PySpark
Job PostingView all
1w
Save
Mark Applied
Hide
Databricks Lead Engineer
Chicago or Milwaukee or Minneapolis
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Databricks and PySpark, end-to-end SDLC, coding, design, testing, and troubleshooting; bachelor’s degree or equivalent experience; authorized to work in the US without employer-based sponsorship.
Databricks, PySpark
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$110k-$125k/yr OnsiteFull Time
fairlife
fairlifeNYSE: KO: Produces nutrient-dense and ultra-filtered dairy products and shakes.
5+ YOEBachelor's degree and 5+ years data engineering experience, expert SQL and strong Python, Spark/PySpark, Azure data services, Azure DevOps, dimensional modeling, and manufacturing data experience preferred.
SQL, Python, Spark, PySpark, Azure SQL databases, Event Hubs, Functions, Data Factory, Key Vault, Microsoft Entra, Azure DevOps, Git, YAML, Delta Lake, Fabric, Databricks, KQL, Eventhouse, Application Insights, MCP, IIoT, MES
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$82k-$120k/yr HybridFull Time
Conagra Brands
Conagra BrandsNYSE: CAG: Manufactures and markets a variety of packaged food brands.
3+ YOEBachelor's degree and 3+ years building data pipelines with Databricks (SQL and pyspark) and Snowflake; experience with relational/cloud DBs, data lake/warehouse concepts, Microsoft Azure components, and self-service analytics.
Databricks, SQL, pyspark, Snowflake, SQL Server, Oracle ADW, Redshift, Microsoft Azure, ADLS, Microsoft Azure Key Vault, Microsoft Azure Dev Ops, Power BI, Sigma, Microsoft Azure Data Factory, Informatica
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$120k-$160k/yr HybridFull Time
iManage
iManage: Intelligent document and email management software for professionals.
5+ YOEBachelor's degree in CS or equivalent, 5+ years data engineering, hands-on Databricks/Delta Lake/PySpark, Terraform, CI/CD (GitHub Actions, DABs), data modeling, mentoring experience, and experience migrating platforms preferred.
PySpark, Databricks, Azure Databricks, Delta Lake, Databricks Asset Bundles (DABs), Databricks MCP connector, Terraform, GitHub Actions, Microsoft Synapse, Microsoft Power BI, Salesforce, Zendesk, Microsoft Event Hub, Apache Kafka, Informatica, Collibra
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$100k-$115k/yr HybridFull Time
HAVI
HAVI: Optimizing global supply chains for leading foodservice and retail brands.
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Unity Catalog, Databricks Jobs, Delta Live Tables, Azure Data Factory, ADLS Gen2, Key Vault, SQL, Great Expectations, Deequ, Git, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Log Analytics, Photon
Job PostingView all
2w
Save
Mark Applied
Hide
Sr. Streaming Engineer
Chicago, Illinois, United States
OnsiteFull Time
Ness Digital Engineering
Ness Digital Engineering: A digital engineering firm providing software development and cloud services.
5+ YOE5+ years building high-speed data solutions using Java, distributed streaming frameworks (Flink/Spark/Kafka Streams), message brokers, cloud platforms (AWS/GCP), DevOps tooling, and automated testing.
FLINK, Apache Spark, Kafka Streams, Kafka, RabbitMQ, ActiveMQ, Amazon Kinesis, AWS, EC2, RDS, S3, KMS, AWSCLI, IAM, Google, Junit, Citrus, Git, Terraform, Ansible, Jenkins, Kubernetes, Helm, CI/CD pipeline, Splunk, ElasticSearch, Prometheus, AppDynamics, Java, Spring, SpringBoot, Microservices, REST API, Unix/Linux
Job PostingView all
2w
Save
Mark Applied
Hide
Sr. Streaming Engineer
Chicago, Illinois, United States
OnsiteFull Time
Ness Digital Engineering
Ness Digital Engineering: Provides full-lifecycle digital engineering and software product development services.
5+ YOE5+ years building high-speed data-centric solutions using Java, stream frameworks, message brokers, cloud services, CI/CD and DevOps tools; BS in Computer Science required.
Java, FLINK, Apache Spark, Kafka Streams, Kafka, RabbitMQ, ActiveMQ, Amazon Kinesis, AWS, VPCs, Security groups, EC2, RDS, S3, ACLs, KMS, AWSCLI, IAM, Google, Junit, Citrus, Git, Terraform, Ansible, Jenkins, Kubernetes, Helm, CI/CD, Splunk, ElasticSearch, Prometheus, AppDynamics, Spring, SpringBoot, Microservices, REST API
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer (f/m/x)
Munich or New York City or Denver or Chicago or London or Heidelberg or Singapore
OnsiteFull Time
CEPRES
CEPRES: Digital investment analytics platform for private capital markets.
2+ YOE2+ years data engineering experience; strong Python, Pyspark and SQL skills; ETL/ELT and data pipeline architecture; exposure to cloud (AWS/Azure/GCP), Git and CI/CD; good communication and problem-solving.
Python, Pyspark, SQL, Databricks, Snowflake, SQL Server, AWS, Redshift, S3, Glue, Lambda, Azure DevOps, Azure Repo, Power BI, Docker, Jenkins, Octopus, Git, CI/CD, NoSQL
Job PostingView all
2w
Save
Mark Applied
Hide
Junior Architect / Senior Data Engineer - Remote
Schaumburg or Minneapolis or Washington or Springfield or United States
$92k-$164k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
5+ YOEHands-on experience with Azure Data Factory, Databricks/PySpark, Synapse/Fabric, T-SQL and Python; strong data warehouse, ETL, CI/CD, monitoring and migration skills; willing to travel ~10%.
Azure Data Factory, Azure Synapse Analytics, Databricks, Microsoft Fabric, Azure Data Lake Storage Gen2, Delta Lake, Parquet, PySpark, T-SQL, Spark SQL, KQL, PowerShell, Bash, Azure Key Vault, Azure AD, Entra ID, Azure Monitor, Log Analytics, Azure DevOps, ARM, Bicep, Terraform, Synapse Dedicated SQL Pool, Azure SQL, Teradata, Snowflake, Informatica PowerCenter, Unity Catalog, OneLake, pandas, pytest
Job PostingView all

Explore Jobs

Expand Your Job Search