194 spark engineer jobs at 96 companies in Illinois
2w
Save
Mark Applied
Hide
2w
Lead Software Engineer (Python, Scala, Spark, AWS)
Richmond or McLean or Chicago
$179k-$225k/yrOnsiteFull Time
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years professional software engineering, 1+ year cloud experience (AWS/Azure/GCP). Experience with Java/Scala/Python/Spark, containerization, distributed microservices, and mentoring/leading teams.
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
5+ YOE5+ years data engineering experience with ETL/ELT, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and experience with terabyte-to-petabyte datasets.
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
5+ YOE5–8 years data engineering experience with ETL/ELT design, Apache Spark/Databricks, SQL, Python, Airflow, CI/CD and Git, experience with PostgreSQL/SparkSQL/Hive/AWS Glue, and ability to mentor engineers.
AbbVieNYSE: ABBV: Develops and sells innovative pharmaceutical and biopharmaceutical medicines.
4+ YOEBSc in a quantitative field and 4 years data engineering experience; expertise with AWS data services, Spark, Python, CI/CD, data modeling, BI tools, and generative AI frameworks.
EMR Hadoop, Spark, Python, GitHub, Azure DevOps, Airflow, Autosys, S3, Glue, Athena, Lake Formation, API Gateway, Lambda, RDS, IAM, Redshift, Snowflake, Qlik, Tableau, Power BI, Langchain, Llama Index, GraphRAG
84.51°NYSE: KR: Provides retail data analytics and targeted advertising services.
3+ YOE3+ years data development experience with Databricks, PySpark/Spark, Python or Java, SQL/JSON, ETL and data warehousing knowledge; experience with CI/CD, pipeline orchestration, version control, and Agile.
Databricks: A unified platform for data analytics and artificial intelligence.
6+ YOE6+ years in data engineering or software engineering, expertise with Spark, cloud platforms, production deployments, CI/CD, MLOps, strong communication and customer-facing experience.
Python, Scala, JavaScript, TypeScript, Apache Spark, AWS, Azure, GCP, CI/CD, MLOps, AI APIs, MLflow, Delta Lake, Databricks
HAVI: Optimizing global supply chains for leading foodservice and retail brands.
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Ohio or New York or New Jersey or Missouri or Minnesota or Michigan or Massachusetts or Indiana or Illinois or Georgia or Florida or Colorado or California or Arizona or Pennsylvania or Wisconsin or Texas or United States
$120k-$160k/yrRemoteFull Time
SullivanCotter: Consulting and data for healthcare and nonprofit compensation strategies.
5+ YOE5+ years experience; degree in CS/Software Engineering/Information Systems/IT or equivalent; proficiency in Python/Scala/Java/SQL, Apache Spark, Databricks, ELT/ETL, streaming, RESTful/gRPC, SDLC, testing and CI/CD tooling; strong design and mentoring skills.
McDonald'sNYSE: MCD: Operate and franchise a global chain of quick-service restaurants.
5+ YOEBachelor's or Master's in CS or related,5+ years data engineering,proficient in Python and SQL,experience with data orchestration,cloud platforms,and clean room/privacy-safe data collaboration.
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
2+ YOE2+ years relevant experience; Bachelor’s in CS/Engineering/IT/MIS required; experience with R/Python/SQL, Hadoop/Spark, ETL, Linux, Git; familiarity with automation tools and AWS services; strong communication skills.
Old National BankNASDAQ: ONB: Regional financial services provider offering banking and wealth solutions.
7+ YOE7+ years data engineering experience, strong AWS/cloud and data warehouse background, expertise in SQL, Python, Spark/Databricks, leadership experience, BS in related field preferred.
Scottsdale or San Francisco or Chicago or New York City
$118k-$183k/yrHybridFull Time
Early Warning Services: Operates payment and risk solutions for the financial industry.
5+ YOEBachelor\u0002s degree in CS/engineering, 5+ years software engineering experience, proficient with Git, ETL/ELT, Spark/Scala, Kafka, SQL; familiarity with DevOps, CI/CD, automated tests and Confluence.
fairlifeNYSE: KO: Produces nutrient-dense and ultra-filtered dairy products and shakes.
5+ YOEBachelor's degree and 5+ years data engineering experience, expert SQL and strong Python, Spark/PySpark, Azure data services, Azure DevOps, dimensional modeling, and manufacturing data experience preferred.
SQL, Python, Spark, PySpark, Azure SQL databases, Event Hubs, Functions, Data Factory, Key Vault, Microsoft Entra, Azure DevOps, Git, YAML, Delta Lake, Fabric, Databricks, KQL, Eventhouse, Application Insights, MCP, IIoT, MES
GraingerNYSE: GWW: Distributes maintenance, repair, and operating supplies to businesses.
3+ YOEBachelor's degree or equivalent; 3+ years data engineering experience with Airflow, Kafka, Spark, Python/Scala; strong cloud and analytics tooling experience (AWS, Snowflake, dbt); mentoring and building scalable data pipelines.
McLean or California or Colorado or Hawaii or Illinois or Maine or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or Virginia or Washington or District of Columbia or Cleveland
$130k-$265k/yrOnsiteFull Time
Accenture Federal ServicesNYSE: ACN: Provides technology and consulting services to U.S. federal agencies.
4+ YOE4+ years data lifecycle and ETL engineering experience; cloud and on-prem storage; Python, SQL, Spark; experience with ElasticSearch, NiFi, Palantir Foundry; Agile/Scrum experience; active TS/SCI with poly required.
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California
$188k-$277k/yrRemoteFull Time
TwilioNYSE: TWLO: Cloud communications platform for programmable messaging, voice, and email.
16+ YOE16+ years building high-scale, secure cloud-native distributed systems; expert in Java or Go and AWS; experience with LLM-driven development, APIs, high-throughput data, Kubernetes/Terraform, and cross-team technical leadership.