95 hadoop engineer jobs at 26 companies in St. Charles, IL
1w
Save
Mark Applied
Hide
1w
Data Engineer - Infrastructure
Chicago, Illinois, United States
$175k-$225k/yrOnsiteFull Time
IMC: Global trading firm providing liquidity to financial markets.
5+ YOE5+ years systems engineering focused on data storage; strong Linux fundamentals; experience with Ansible or Puppet, Hadoop/YARN, S3-compatible storage, Prometheus, Java and Python; familiarity with Kafka and Kubernetes.
IMC: Global proprietary trading firm and market maker.
5+ YOE5+ years in systems engineering focused on data storage; strong Linux, I/O performance tuning, Ansible, Puppet, Hadoop/YARN, Prometheus, Java, Python, and storage technologies. Kubernetes and Claude familiarity required.
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yrRemoteFull Time
SentiLink: Provides identity verification and fraud prevention for financial institutions.
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Hartford or Charlotte or Columbus or Chicago or United States
$153k-$229k/yrHybridFull Time
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
10+ YOE10+ years in data/cloud/platform/SRE with leadership; experience with Snowflake, EMR/Hadoop, AWS/GCP, Terraform/CloudFormation, Python, observability and SLO/SLI frameworks; US work authorization required.
PinterestNYSE: PINS: Visual discovery engine for finding inspiration and creative ideas.
5+ YOE5+ years building and operating large-scale distributed systems, BS in CS or equivalent, strong Python or Go skills, Linux internals, MySQL/Kafka/Envoy/Hadoop experience, IaC and cloud (Terraform, Docker, Kubernetes, AWS/GCP/Azure).
Charlotte or Hartford or Columbus or Chicago or United States
$153k-$229k/yrHybridFull Time
The HartfordNYSE: HIG: Provides property and casualty insurance and financial products.
10+ YOE10+ years in data, cloud, platform, reliability engineering, or distributed systems; expertise in Snowflake, EMR, Hadoop/Spark, AWS/GCP, automation, observability, IaC, CI/CD, and technical leadership.
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree,4+ years software engineering experience,1+ year cloud experience; expertise with Hadoop/HBase/Kafka/NiFi and AWS; strong communication and production systems experience.
Cloudera, HBase, Kafka, NiFi, Hadoop, AWS EC2, AWS MSK, AWS Lambda, AWS Glue, AWS DocumentDB, DynamoDB, Microsoft Azure, Google Cloud
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
3+ YOE3+ years software development in distributed environments; proficient in Scala, Python or Java; experience with Apache Spark, Hadoop, Hive; experience with cloud platforms (AWS, Azure, GCP, Databricks); BA/BS in CS or related field preferred.
Alliant Credit Union: Provides digital banking, consumer loans, and mortgage lending services.
5+ YOE5+ years data warehouse/data lake/cloud experience, Bachelor's in Computer Science or related (or 8 years experience), skills in Azure, Hadoop, SQL Server and data platform operations.
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data, 1+ year of cloud computing, and experience with programming, databases, data warehousing, and Agile practices.
IBMNew York Stock Exchange: IBM: Global technology providing enterprise software, cloud, and consulting.
High school diploma/GED required; bachelor's preferred. Requires Python, Java, Scala, SQL, Linux, Spark, Hadoop, ETL/ELT, cloud basics, statistical and machine learning techniques, and up to 100% travel.
Chicago or Scottsdale or San Francisco or New York City
$175k-$270k/yrHybridFull Time
Early Warning Services: Operates payment and risk solutions for the financial industry.
8+ YOE8+ years building large-scale data platforms, distributed systems, cloud-native data pipelines, EM/ML operationalization, and data warehouse/Big Data solutions; Bachelor's in CS or related.
PinterestNYSE: PINS: Visual discovery engine for finding and saving ideas.
5+ YOE5+ years building and operating large-scale distributed systems; bachelor's degree or equivalent; Python or Go; Linux/Unix, infrastructure, cloud, and service-oriented architecture experience.
Python, Go, Linux, Unix, MySQL, Kafka, Envoy, Hadoop, Terraform, Puppet, Chef, Ansible, Docker, Kubernetes, Amazon Web Services (AWS), Google Cloud Platform (GCP), Microsoft Azure
GrouponNASDAQ: GRPN: Marketplace for discounted local experiences, services, and goods.
5+ YOEBachelor's in Computer Science or related field plus 5+ years related experience; experience with Hadoop/Cloudera, Hive, Spark, Sqoop, BigQuery, Bigtable, Google Dataproc, Teradata, Keboola; Linux (RHEL/Ubuntu); Redis admin; Kibana/Grafana/Nagios/Ganglia; automation scripting.
PaychexNASDAQ: PAYX: Provider of integrated payroll, HR, and benefits outsourcing solutions.
4+ YOEBachelor's degree in computer science, data science, engineering, or equivalent experience; 2–4 years of experience with data engineering, cloud platforms, automation, CI/CD, security, and large-scale data processing.
SQL, Snowflake, Databricks, Apache Spark, Azure Data Factory, Integration Runtime, Data Lake, Azure Machine Learning, Cosmos DB, Python, PySpark, R, Ansible Tower, Microsoft Azure, Azure Resource Manager (ARM), Terraform Enterprise, Azure DevOps, GitHub Actions, Salesforce FSC, Salesforce Data Cloud, Extract Transform Load (ETL), Amazon Web Services, Apache Hadoop
Rush University Medical Center: Academic medical center providing patient care and medical education.
5+ YOEBachelor's degree and 5+ years experience; strong cloud, software engineering and data processing background; ETL, RDBMS, Python, SQL, NoSQL, Spark experience; strong analytical and communication skills.
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data technologies, and 1+ year of cloud computing experience; proficiency in data engineering technologies and programming languages.
American ExpressNYSE: AXP: Global financial services and credit card payment network.
Bachelor's degree or equivalent experience; significant production AI/ML engineering experience; Python and another language; distributed systems, LLMs, data pipelines, MLOps, CI/CD, and mentoring experience.