157 spark engineer jobs at 72 companies in Wheeling, IL

1w
Save
Mark Applied
Hide
Lead Software Engineer (Python, Scala, Spark, AWS)
Richmond or McLean or Chicago
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years professional software engineering, 1+ year cloud experience (AWS/Azure/GCP). Experience with Java/Scala/Python/Spark, containerization, distributed microservices, and mentoring/leading teams.
Python, Scala, Spark, AWS, Java, SQL, Node, Go, Docker, Kubernetes
1w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr OnsiteFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
5+ YOE5+ years data engineering experience with ETL/ELT, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and experience with terabyte-to-petabyte datasets.
Apache Spark, Databricks, Airflow, SQL, Python, Git, PostgreSQL, SparkSQL, Hive, AWS Glue, Terraform
1w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago, Illinois, United States
$89k-$165k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
5+ YOE5–8 years data engineering experience with ETL/ELT design, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and Git, experience with PostgreSQL/SparkSQL/Hive/AWS Glue, and ability to mentor engineers.
Apache Spark, Databricks, SQL, Python, Git, Airflow, PostgreSQL, SparkSQL, Hive, AWS Glue, Terraform
4d
Save
Mark Applied
Hide
Engineer, Technology I
Mettawa, Illinois, United States
$133k-$162k/yr HybridFull Time
AbbVie
AbbVieNYSE: ABBV: Develops and sells innovative pharmaceutical and biopharmaceutical medicines.
4+ YOEBSc in a quantitative field and 4 years data engineering experience; expertise with AWS data services, Spark, Python, CI/CD, data modeling, BI tools, and generative AI frameworks.
EMR Hadoop, Spark, Python, GitHub, Azure DevOps, Airflow, Autosys, S3, Glue, Athena, Lake Formation, API Gateway, Lambda, RDS, IAM, Redshift, Snowflake, Qlik, Tableau, Power BI, Langchain, Llama Index, GraphRAG
1w
Save
Mark Applied
Hide
Lead Data Engineer (P4519)
Cincinnati or Chicago
$125k-$207k/yr OnsiteFull Time
84.51°
84.51°NYSE: KR: Provides retail data analytics and targeted advertising services.
5+ YOEBachelor's degree, 5+ years professional data development experience, Databricks/Spark and Python experience, ETL and data warehousing knowledge, Kubernetes and REST API development experience, Agile/Scrum familiarity.
Azure, Databricks, Spark, SQL, PySpark, Databricks Workflows, Python, JSON, Kubernetes, REST APIs
3mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer I // II
Denver or Seattle or Chicago or United States
$140k-$190k/yr RemoteFull Time
Signifyd
Signifyd: AI-driven fraud protection and payment security for online retailers
4+ YOE4-6+ years of production ML experience; strong ML theory; Python, SQL, Spark; able to ship production ML; good communicator.
Python, SQL, Spark, ML libraries
1w
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$100k-$115k/yr HybridFull Time
HAVI
HAVI: Optimizing global supply chains for leading foodservice and retail brands.
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Unity Catalog, Databricks Jobs, Delta Live Tables, Azure Data Factory, ADLS Gen2, Key Vault, SQL, Great Expectations, Deequ, Git, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Log Analytics, Photon
2w
Save
Mark Applied
Hide
Data Engineer III
Chicago, Illinois, United States
$138k-$173k/yr OnsiteFull Time
McDonald's
McDonald'sNYSE: MCD: Operate and franchise a global chain of quick-service restaurants.
5+ YOEBachelor's or Master's in CS or related,5+ years data engineering,proficient in Python and SQL,experience with data orchestration,cloud platforms,and clean room/privacy-safe data collaboration.
Python, SQL, Apache Airflow, dbt, Spark, NoSQL, BigQuery, Snowflake, Databricks, LiveRamp, LiveRamp Connect, Habu, Google Ads Data Hub, Amazon Marketing Cloud, GCP, AWS S3
1mo
Save
Mark Applied
Hide
Data Engineer
Charlotte or Chicago or Hartford or Columbus
$101k-$151k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
2+ YOE2+ years relevant experience; Bachelor’s in CS/Engineering/IT/MIS required; experience with R/Python/SQL, Hadoop/Spark, ETL, Linux, Git; familiarity with automation tools and AWS services; strong communication skills.
R, Python, SQL, Hadoop, Spark, XML, JSON, ETL, Linux, Git, GitHub, Autosys, Cron, Airflow, Amazon S3, Amazon EMR, MLOps, Agile
2w
Save
Mark Applied
Hide
Data Engineer Lead
Lake Elmo or Chicago or Evansville
$98k-$199k/yr OnsiteFull Time
Old National Bank
Old National BankNASDAQ: ONB: Regional financial services provider offering banking and wealth solutions.
7+ YOE7+ years data engineering experience, strong AWS/cloud and data warehouse background, expertise in SQL, Python, Spark/Databricks, leadership experience, BS in related field preferred.
AWS, S3, Glue, Lambda, Databricks, SQL, Python, Bash, Spark, GitOps
1mo
Save
Mark Applied
Hide
Data Engineer III
Lake Forest or Chicago
$105k-$174k/yr HybridFull Time
Grainger
GraingerNYSE: GWW: Distributes maintenance, repair, and operating supplies to businesses.
3+ YOEBachelor's degree or equivalent, 3+ years data engineering experience with Airflow, Kafka, Spark, Python; experience building scalable data pipelines, Snowflake models, SQL, and cloud tooling (AWS).
AWS, SQL, Python, Docker, Kubernetes, CI/CD, Git, Snowflake, dbt, Apache Airflow, Kafka, Spark, Scala
2mo
Save
Mark Applied
Hide
Software Engineer (Backend, Python) - Content Understanding
San Francisco or Atlanta or Austin or Boston or Chicago or Dallas or Denver or Houston or Jacksonville or Los Angeles or Miami or New York City or Phoenix or Portland or Sacramento or Salt Lake City or San Diego or Seattle or Washington, D.C. or Ottawa or Toronto or Vancouver or Mexico City
HybridFull Time
Scribd
Scribd: Subscription-based digital library for e-books, audiobooks, and documents.
4+ YOE4+ years in software engineering; Python/Scala/Ruby; distributed systems; AWS; Terraform; Spark/Databricks; CS degree.
Python, Scala, Ruby, Airflow, Databricks, Spark, AWS, Terraform
5d
Save
Mark Applied
Hide
Sr. Software Engineer - Data Engineering
Scottsdale or San Francisco or Chicago or New York City
$118k-$183k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
5+ YOEBachelor\u0002s degree in CS/engineering, 5+ years software engineering experience, proficient with Git, ETL/ELT, Spark/Scala, Kafka, SQL; familiarity with DevOps, CI/CD, automated tests and Confluence.
Git, Git flow, Spark, Scala, Kafka, SQL, Python, XML, JSON, YAML, Redis, HBASE, AeroSpike, Confluence, CI/CD
3mo
Save
Mark Applied
Hide
Data & AI Engineer – Equities Technology
Chicago, Illinois, United States
$130k-$161k/yr HybridFull Time
William Blair
William Blair: Provides investment banking, investment management, and private wealth services.
4+ YOE4–6+ years in data engineering and AI integration, strong Databricks/Spark/Azure skills, production AI/LLM experience, regulated environment.
Databricks, Spark, Azure Data Factory, Azure Synapse, Python, ADLS, Azure Functions, SQL, REST APIs, Azure DevOps, YAML, Azure Key Vault, Logic Apps, OpenAI, Embeddings
2mo
Save
Mark Applied
Hide
Senior Data Engineer / Analyst - USA
New York City or Miami or Mountain View or Los Angeles or Chicago or Seattle or Dallas or United States
$122k-$162k/yr HybridFull Time
Cognify Analytics
Cognify Analytics: Independent analytics firm focused on data-driven solutions.
5+ YOE5–8+ years data engineering/analytics delivery; SQL, Snowflake/Databricks, dbt, Python, Spark; data governance; client collaboration.
Snowflake, Databricks, dbt, Python, Pandas, PySpark, Spark, Airflow, Dagster, Kafka, Kinesis, Tableau, Looker, Power BI, Sigma Computing, SQL, Data Governance, Alation, Atlan, DataHub, Unity Catalog
1w
Save
Mark Applied
Hide
ReactJS with Azure developer
Chicago, Illinois, United States
$100k-$120k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOEReactJS frontend engineer with Azure deployment expertise plus Python, Apache Airflow, Spark on Kubernetes, Docker/Helm, CI/CD; ~6+ years experience; ReactJS 3+ years.
ReactJS, JavaScript, TypeScript, Redux, Zustand, Recoil, Material-UI, Ant Design, TailwindCSS, GraphQL, Jest, React Testing Library, Cypress, Microsoft Azure App Services, Microsoft Azure Static Web Apps, Microsoft Azure Kubernetes Service (AKS), Microsoft Azure Container Registry (ACR), Microsoft Azure Key Vault, Microsoft Azure DevOps Pipelines, Microsoft Azure Storage, Apache Airflow, Python, Spark, PySpark, Helm, Docker, kubectl, GitHub Actions
1mo
Save
Mark Applied
Hide
Platform Engineer
Chicago or Sydney or Shanghai or London or Singapore
$145k/yr OnsiteFull Time
Akuna Capital
Akuna Capital: Proprietary trading firm providing liquidity in global options markets.
3+ YOE3+ years in platform/cloud/SRE/DevOps roles, strong AWS and Kubernetes (EKS) experience, Terraform/IaC, Python/Bash scripting, Linux administration, CI/CD and observability expertise; Bachelor’s degree preferred.
AWS, Azure, Google Cloud, Kubernetes, EKS, Spark, Kafka, Terraform, Ansible, Jenkins, GitLab, Python, Bash, Amazon RDS, Aurora, Redshift, DynamoDB
2w
Save
Mark Applied
Hide
Principal Data Engineer
Chicago or Downers Grove or Alabama or Connecticut or Florida or Georgia or Ohio or Pennsylvania
$112k-$187k/yr HybridFull Time
Kemper
KemperNYSE: KMPR: Provides specialized auto, life, and health insurance services.
10+ YOE10+ years in data engineering/architecture; expert SQL, Python, Snowflake; experience with ETL/ELT, Spark, Kafka, Airflow, DBT, and cloud-native tools (AWS/Azure); proven technical leadership and mentoring; experience with data governance, security, and regulated industries; bachelor’s or master’s in related field preferred.
SQL, Python, Snowflake, Spark, Kafka, Airflow, AWS Glue, S3, AWS, Azure, Informatica, IICS, DBT, IDMC, Git, Guidewire, Life/400, Data Vault 2.0, CI/CD
2w
Save
Mark Applied
Hide
Senior Software Engineer - Machine Learning
San Francisco or Chicago or Frisco
$183k-$223k/yr HybridFull Time
Uber Freight
Uber Freight: Digital marketplace connecting shippers with trucking carriers.
5+ YOE5+ years ML engineering experience; deploy ML models at scale; experience with PyTorch/TensorFlow/Scikit-Learn/Spark MLlib; Python, Go, or Java; strong ML theory and production experience.
PyTorch, TensorFlow, Scikit-Learn, Spark MLlib, Python, Go, Java, Storm, Spark, Flink
4d
Save
Mark Applied
Hide
Senior Software Engineer
Chicago or United States
RemoteFull Time
DomainTools
DomainTools: Provides DNS-based threat intelligence and domain investigation solutions.
5+ YOE5+ years professional development with Python/Rust/Go, 3+ years with AWS/Docker/Kubernetes, Kafka, OpenSearch/Postgres/CockroachDB/Spark, Linux/Unix; strong communication and cross-team coordination.
Python, GoLang, Rust, AWS, Docker, Kubernetes, OpenSearch, Postgres, CockroachDB, Spark, Kafka, Linux, ElasticSearch, NATS, Apache Airflow, Bash, Scala, C, Hive