171 hadoop engineer jobs at 65 companies in Millbrae, CA
2w
Save
Mark Applied
Hide
2w
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yrRemoteFull Time
SentiLink: Provides identity verification and fraud prevention for financial institutions.
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Eightfold: An AI-native enterprise talent platform that builds scalable machine learning solutions and agentic AI for talent workflows.
6+ YOEDeep expertise in ML/DL/NLP and LLMs; technical leadership and team mentoring; proficiency with Python, TensorFlow, PyTorch, big data (Hadoop, Spark); experience deploying ML at scale. MS/PhD and 6+ years preferred.
Senior Site Reliability Engineer, Apple Data Platform SRE / Apple Services Engineering
Cupertino, California, United States
OnsiteFull Time
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Apply SRE principles to mentor teams, ensure reliability for large-scale analytics infrastructure across Hadoop, HBase, Spark, Data Lakes, and Airflow; participate in production on-call.
MastercardNYSE: MA: Global payment processing and financial technology service provider.
Bachelor’s or Master’s in CS/Engineering, extensive software engineering and platform architecture experience, strong Java/JVM and Spring skills, REST/microservices, cloud-native (AWS/Kubernetes), distributed systems (Hadoop/Spark/Kafka), CI/CD and leadership skills.
Java, JVM, Spring Boot, Spring MVC, Spring Security, Spring Cloud, RESTful web services, PostgreSQL, NoSQL, React, JavaScript, TypeScript, HTML, CSS, Hadoop, Spark, Kafka, AWS, PCF, Kubernetes, Docker, CI/CD, Jenkins, Git, Maven, Gradle, SonarQube
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
8+ YOE8+ years data engineering experience, strong SQL, Python preferred, expertise with big-data tech (Hadoop, Spark, Kafka, Hive, Airflow), data modeling, and cloud platforms (AWS/GCP).
OpenAI: Develops artificial intelligence models and generative AI software services.
3+ YOE3+ years data engineering; 8+ years software engineering; Python/Scala/Java; Databricks, Snowflake; ETL schedulers; Spark/Hadoop/Flink; S3/HDFS; strong data pipelines and collaboration.
SalesforceNYSE: CRM: Sells cloud-based customer relationship management and business software solutions.
8+ YOERequires 8+ years in data engineering, technical degree, SQL, Python, ETL/ELT, Airflow, Hadoop, data modeling, GitHub or Subversion, CI/CD, and technical leadership across enterprise data products.
Prague or Berlin or San Francisco or New York City
Kč70k-Kč85k/yrOnsiteFull Time
Zeta GlobalNYSE: ZETA: Provides an AI-powered marketing platform for enterprise customer engagement.
7+ YOE7+ years software engineering experience; strong Scala and Spark skills; experience with large-scale data-processing frameworks, Hadoop, Airflow, and AWS; mentoring and improving platform reliability.
Scottsdale or Chicago or San Francisco or New York City
$97k-$149k/yrHybridFull Time
Early Warning Services: Operates payment and risk solutions for the financial industry.
2+ YOEBachelor's degree typical; 2+ years experience building data engineering tools with Spark and Python, experience with ML toolkits, Hadoop or AWS/S3, and relational databases; strong communication and background/drug screen required.
Quantifind: AI-driven platform for financial risk and fraud detection.
8+ YOEBachelor's in a technical field, 8+ years network engineering experience, expertise with Dell OS10, PAN firewalls, cloud WAFs, BGP/OSPF, Ansible and Python, experience with AWS/data center networking, strong security and monitoring skills; US work authorization required.
VisaNYSE: V: Global payment technology facilitating electronic funds transfers.
8+ YOE8+ years with a BS or 5+ with an advanced degree; strong data engineering, Hadoop, Spark, Python, SQL; Java, REST APIs, Docker/Kubernetes; ETL pipelines; cloud services; leadership experience.
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
8+ YOESenior data engineer with 8+ years experience, distributed data and cloud technologies (Hadoop, Spark, Databricks, S3, EMR), streaming (Kafka/Kinesis), strong SQL and Python/PySpark/Scala skills, CI/CD and orchestration experience, and strong communication.
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
2+ YOEB.S. in CS or related required; 2+ years Java experience; Unix and shell scripting; professional experience with Spring, Hibernate, Maven, Git; SQL and relational DB experience; Hadoop, Spark, Scala, Docker, Kubernetes, AWS are pluses.
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
3+ YOEBachelor's degree or equivalent experience, strong Java and scalable systems experience, familiarity with Kafka/Spark/Hadoop/GCP/Scala, experience designing high-throughput microservices.
SpaceX: Designs and launches advanced rockets and satellite internet constellations.
5+ YOEBachelor's in CS/engineering/math with 5 years software experience or 7+ years SRE/DevOps experience; Linux experience required; Kubernetes, Kafka, cloud-native tooling, and programming in Python/Go/Java/C#/Scala preferred.
Bambu Lab: Manufacturer of desktop 3D printers and 3D printing accessories.
Extensive hands-on experience in data warehouse modeling and processing; expertise with Hadoop, Spark, Iceberg, Flink; software development in Java/Scala/Python; knowledge of CCPA/GDPR and strong business acumen.
6sense: AI platform for B2B buyer intent and revenue prediction.
BS/MS in Computer Science or equivalent experience; strong Big Data experience (Hadoop, Hive, Spark, Flink, Presto, Kafka, etc.), ETL, schema design, SQL, data ingestion/integration, and use of AI coding assistants.
Member of Technical Staff - GPU Infrastructure Engineer
San Francisco, California, United States
OnsiteFull Time
Liquid AI: Develops efficient general-purpose artificial intelligence foundation models.
Strong software engineering with production infrastructure tooling, deep distributed systems/Linux/networking/storage knowledge, experience operating shared compute clusters and supporting production users.