HiringCafe
Join our community

95 hadoop engineer jobs at 34 companies in Illinois

3w
Save
Mark Applied
Hide
Data Engineer - Infrastructure
Chicago, Illinois, United States
$175k-$225k/yr OnsiteFull Time
IMC
IMCNYSE American: IMC: Global proprietary trading firm and technology-driven liquidity provider.
5+ YOE5+ years systems engineering focused on data storage; strong Linux fundamentals; experience with Ansible or Puppet, Hadoop/YARN, S3-compatible storage, Prometheus, Java and Python; familiarity with Kafka and Kubernetes.
Hadoop, S3, Linux, Ansible, Puppet, Prometheus, Kubernetes, YARN, Kafka, Java, Python, Claude
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yr RemoteFull Time
SentiLink
SentiLink: Your fraud and risk partner
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Python, Golang, PostgreSQL (RDS), OpenSearch, Redshift, EMR, Spark, Docker, Lambda, AWS, EKS, SQS, SNS, S3, Kubernetes, Hadoop, Kafka, Microsoft Azure, GCP
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Reliability Engineer - EDS
Hartford or Charlotte or Columbus or Chicago or United States
$153k-$229k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provider of property and casualty insurance and employee benefits.
10+ YOE10+ years in data/cloud/platform/SRE with leadership; experience with Snowflake, EMR/Hadoop, AWS/GCP, Terraform/CloudFormation, Python, observability and SLO/SLI frameworks; US work authorization required.
AWS, GCP, Snowflake, EMR, Hadoop, ETL/ELT, Kubernetes, Terraform, CloudFormation, Python, CI/CD, Prometheus, Grafana, Datadog, Splunk, Dynatrace, OpenTelemetry, AWS Bedrock, SageMaker, Vertex AI
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Reliability Engineer - EDS
Charlotte or Hartford or Columbus or Chicago or United States
$153k-$229k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provider of property and casualty insurance and employee benefits.
10+ YOE10+ years in data, cloud, platform, reliability engineering, or distributed systems; expertise in Snowflake, EMR, Hadoop/Spark, AWS/GCP, automation, observability, IaC, CI/CD, and technical leadership.
AWS, GCP, Snowflake, EMR, Hadoop, Spark, Kubernetes, AWS Bedrock, SageMaker, Vertex AI, Python, Terraform, CloudFormation, CI/CD, Prometheus, Grafana, Datadog, Splunk, Dynatrace, OpenTelemetry, LLMs
Job PostingView all
5d
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Scottsdale or San Francisco or Chicago or New York City or Phoenix or California
$124k-$223k/yr HybridFull Time
Early Warning Services
Early Warning Services: U.S. bank-owned fintech and consumer reporting agency providing identity, fraud-risk, and real-time payment solutions to financial institutions.
8+ YOEBachelor's degree or equivalent experience, 8+ years relevant experience, and extensive data engineering expertise across scalable platforms, distributed systems, cloud, AI/ML, data warehouses, and real-time processing.
SQL Server, HDFS, Elastic Search, IBM Infosphere, Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, CI/CD, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Oracle, Aerospike, Scality S3, AppDynamics, Kubernetes, HBase, Hive, Solr, Scala, Databricks, Snowflake
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Software Engineer, Full Stack
Riverwoods or Plano or McLean
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
4+ YOEBachelor's degree,4+ years software engineering experience,1+ year cloud experience; expertise with Hadoop/HBase/Kafka/NiFi and AWS; strong communication and production systems experience.
Cloudera, HBase, Kafka, NiFi, Hadoop, AWS EC2, AWS MSK, AWS Lambda, AWS Glue, AWS DocumentDB, DynamoDB, Microsoft Azure, Google Cloud
Job PostingView all
2mo
Save
Mark Applied
Hide
Software Engineer
Chicago, Illinois, United States
$74k-$137k/yr HybridFull Time
Epsilon
Epsilon: Epsilon is a global marketing-data, consumer-analytics, and marketing-technology serving brands.
3+ YOE3+ years development experience in distributed environments; proficiency in Scala, Python or Java; familiarity with Apache Spark, Hive, Hadoop; experience with cloud platforms (AWS, Azure, GCP, Databricks); BA/BS in CS required.
Apache Spark, Hive, Hadoop, Databricks, AWS, Azure, GCP, Scala, Python, Java, Kubernetes, Docker, Airflow
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Chicago, Illinois, United States
$107k-$183k/yr HybridFull Time
Alliant Credit Union
Alliant Credit Union: Member-owned nonprofit digital credit union providing banking, lending, investment, and financial education services to nationwide members.
5+ YOE5+ years data warehouse/data lake/cloud experience, Bachelor's in Computer Science or related (or 8 years experience), skills in Azure, Hadoop, SQL Server and data platform operations.
Azure, Hadoop, SQL Server, Informatic
Job PostingView all
2w
Save
Mark Applied
Hide
Associate Data Engineer 2027
Chicago, Illinois, United States
$71k-$107k/yr OnsiteFull Time
IBM
IBMNYSE: IBM: Global technology and consulting focusing on cloud and AI.
High school diploma/GED required; bachelor's preferred. Requires Python, Java, Scala, SQL, Linux, Spark, Hadoop, ETL/ELT, cloud basics, statistical and machine learning techniques, and up to 100% travel.
AWS, Microsoft Azure, Java, Python, Scala, Extract, Transform, and Load (ETL), SQL, Linux, Spark, Hadoop, dbt, Snowflake, BigQuery, Airflow, CI/CD, RAG
Job PostingView all
4d
Save
Mark Applied
Hide
Responsible AI Engineer
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$68k-$220k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services delivering 360° value.
3+ YOEBachelor's degree or equivalent experience, 3+ years developing AI and machine learning solutions, 3+ years with programming, frameworks, APIs, version control, databases, and cloud platforms; responsible AI experience preferred.
Python, R, Java, Scikit-learn, TensorFlow, PyTorch, Django, Flask, FastAPI, GitHub, Bitbucket, AWS, Azure, Google Cloud, Hadoop, Spark
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Systems Software Engineer
Santa Clara or Champaign
$272k-$431k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Computing platform for AI and accelerated graphics.
15+ YOE15+ years software development experience; strong C++, Java or Scala skills; CUDA/C++ experience; distributed systems and OSS data platform familiarity; BS/MS/PhD or equivalent.
Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion, cuDF, CCCL, UCX, CUDA, C++, Java, Scala, AWS EMR, Databricks, Google Dataproc, Oracle Cloud Data Flow, Bytedance Volcengine, Tencent Cloud, Cloudera, RAPIDS
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Software Engineer - Big Data
Rockville or Washington or Tysons or Colorado or Florida or Texas or Illinois or Pennsylvania or Massachusetts or Maryland or Virginia or New York or New Jersey
$114k-$249k/yr HybridFull Time
FINRA
FINRA: Private nonprofit self-regulatory organization that supervises U.S. broker-dealers and protects investors.
7+ YOEBachelor's in CS or related + 7+ years experience; deep Big Data (Hadoop, Spark, Hive, Trino), SQL, AWS (S3, EMR, Glue, Lambda, Athena, EKS), Python/Scala, system design, CI/CD, DevOps, security, and team mentoring experience.
Hadoop, Spark, Hive, Trino, SQL, S3, EMR, Glue, Lambda, Athena, EKS, Python, Scala, GitHub Copilot, Q Developer, ChatGPT, Claude, Scrum, Kanban, CI/CD, DevOps
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Base Engineer Post - v2
Chicago, Illinois, United States
$170k/yr HybridFull Time
Groupon
GrouponNASDAQ: GRPN: Public American local e-commerce marketplace connecting consumers with merchants through discounted services and experiences.
5+ YOEBachelor's in Computer Science or related field plus 5+ years related experience; experience with Hadoop/Cloudera, Hive, Spark, Sqoop, BigQuery, Bigtable, Google Dataproc, Teradata, Keboola; Linux (RHEL/Ubuntu); Redis admin; Kibana/Grafana/Nagios/Ganglia; automation scripting.
BigQuery, Bigtable, Hadoop, Google Dataproc, Redis, Teradata, Keboola, Cloudera, Hive, Spark, Sqoop, Linux, RHEL, Ubuntu, Kibana, Grafana, Nagios, Ganglia
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer Software Developer
Scott AFB, Illinois, United States
$99k-$106k/yr OnsiteFull Time
I2X Technologies
I2X Technologies: CIRI-owned technical services provider delivering cybersecurity, engineering, enterprise IT, and mission operations to U.S. government customers.
4+ YOEUS citizen with active Secret clearance, Bachelor's in CS/Engineering, 4+ years experience building data pipelines, proficiency with Kafka/Elastic/AWS/OpenShift, Python/Java/SQL, Linux, CI/CD, and ability to work onsite at Scott AFB.
Confluent Kafka, Elastic Stack, AWS, Red Hat OpenShift, Kubernetes, Kafka, Elastic, Logstash, Kibana, React, JavaScript, HTML, AWS Redshift, S3, Hadoop, Snowflake, Python, Java, SQL, shell scripting, Elasticsearch, Spark, NiFi, Databricks, ELK Stack, Azure, GCP, AWS GovCloud, Ansible, Puppet, Chef, Prometheus, Grafana, Git, Bitbucket, Atlassian JIRA, Confluence, CI/CD
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$175k-$225k/yr OnsiteFull Time
IMC
IMCNYSE American: IMC: Global proprietary trading firm and technology-driven liquidity provider.
5+ YOERequires 5+ years in data engineering, Kafka streaming and Big Data pipeline experience, Java, Python, SQL, Spark or Flink, Kubernetes, Docker, monitoring tools, statistics, and Unix scripting.
Kafka, Hadoop, Dremio, Java, Python, Apache Spark, Apache Flink, SQL, S3, HDFS, Databricks, Iceberg, Kubernetes, Docker, Prometheus, Grafana, Alert Manager, Alerta, OpsGenie, Unix, Bash
Job PostingView all
4w
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$46-$69/hr OnsiteFull Time
Rush University Medical Center
Rush University Medical Center: Nonprofit academic medical center providing hospital care, health sciences education, research and community services in Chicago.
5+ YOEBachelor's degree and 5+ years experience; strong cloud, software engineering and data processing background; ETL, RDBMS, Python, SQL, NoSQL, Spark experience; strong analytical and communication skills.
Pentaho, Talend, Informatica, Azure Data Factory, Apache Kafka, Apache Camel, Cloudera Hadoop, Hortonworks Data Platform, Databricks, Oracle, SQL Server, DB2, MySQL, Python, SQL, NoSQL, Spark
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Data Engineer
McLean or Plano or Chicago or Richmond
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data technologies, and 1+ year of cloud computing experience; proficiency in data engineering technologies and programming languages.
Java, Scala, Python, SQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, AWS, Microsoft Azure, Google Cloud, RDBMS, NoSQL, Agile, machine learning, distributed microservices, shell scripting
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer (ELK)
O'Fallon or Belleville
OnsiteFull Time
Red River
Red River: Privately held IT integration firm serving government and commercial organizations with cloud, cybersecurity, and infrastructure services.
5+ YOEBachelor’s degree or equivalent experience, 5+ years in data engineering or warehousing, active DoD Secret clearance, Security+ certification, U.S. citizenship, and experience with cloud, big data, Kubernetes, and DoD environments.
Confluent Kafka, Elastic Stack, AWS, Red Hat OpenShift, Kubernetes, React, JavaScript, HTML, Logstash, Kibana, Apache Spark, Apache NiFi, Hadoop, Elasticsearch, Databricks, Azure, Google Cloud Platform (GCP), AWS GovCloud, Ansible, Puppet, Chef, Prometheus, Grafana, Atlassian JIRA, Atlassian Confluence, Scrum, SAFe, CI/CD, ETL/ELT
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Systems Software Engineer
Santa Clara or Champaign
$272k-$431k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Computing platform for AI and accelerated graphics.
15+ YOEBS, MS, or PhD in computer science, computer engineering, or related field; 15+ years of software development experience; strong distributed systems and C++, Java, and/or Scala skills.
Java, Scala, CUDA, C++, Apache Spark, RAPIDS Spark, AWS EMR, Databricks, Google Dataproc, Oracle Cloud Data Flow, Bytedance Volcengine, Tencent Cloud, Cloudera, cuDF, Apache Iceberg, Delta Lake, Unity Catalog, CCCL, UCX, Velox, Presto, Apache Arrow, Apache DataFusion, Parquet, ORC, JSON
Job PostingView all
6d
Save
Mark Applied
Hide
Intern C, Software Engineer (43518)
Colorado Springs or United States or Colorado or California or Massachusetts or New Jersey or Washington or Hawaii or Illinois or Maryland or Minnesota or New York or Vermont or Ohio
$25-$47/hr OnsiteInternship
L3Harris Technologies
L3Harris TechnologiesNYSE: LHX: Global aerospace and defense technology innovator and manufacturer.
Currently pursuing a bachelor's, master's, or PhD in computer science, computer, software, electrical, or wireless engineering, information security, or a related field.
C++, C#, C, Java, Ruby, HTML5, XML, SQL, Perl, Python, Ajax, Qt, Microsoft Windows, Microsoft .NET, Unix, Linux, VxWorks, QNX, Integrity, Windows CE, SOA, RTOS, Hadoop, Android
Job PostingView all

Explore Jobs

Expand Your Job Search