HiringCafe
Join our community

165 hadoop engineer jobs at 63 companies in Berkeley, CA

3mo
Save
Mark Applied
Hide
Product Support Engineer (Hadoop)
Campbell or United States
$80k-$100k/yr RemoteFull Time
Acceldata
Acceldata: Software for monitoring and managing enterprise data pipelines.
5+ YOE5+ years hands-on Hadoop experience; strong Linux; Spark/Hadoop ecosystem; scripting; problem solving.
Hadoop, HDFS, YARN, Hive, Impala, Kafka, NiFi, Ambari, Cloudera Manager, Python, Bash, Scala
Job PostingView all
3w
Save
Mark Applied
Hide
DE&A - Core - Big Data Engineering - Hadoop Ecosystem
Pune or Milpitas or Seattle or Princeton or Cape Town or London or Zurich or Singapore or Mexico City
RemoteFull Time
Zensar
ZensarNational Stock Exchange of India: ZENSARTECH: Global technology firm providing digital transformation and infrastructure services.
8+ YOESenior quant/engineering role: 8+ years in quantitative development/architecture; strong Python (required), C++/Java (preferred); experience with Spark/Hadoop, SQL/NoSQL, cloud platforms (AWS/Azure/GCP), Kafka/Flink; strong quant finance knowledge and model development experience.
Python, C++, Java, NumPy, Pandas, SciPy, TensorFlow, Spark, Hadoop, SQL, NoSQL, AWS, Azure, GCP, Databricks, Snowflake, Kafka, Flink
Job PostingView all
1w
Save
Mark Applied
Hide
Site Reliability Engineer, Compute Platform
San Jose, California, United States
$156k-$388k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
Bachelor's in CS/Engineering, strong Linux, networking, databases, Kubernetes, SRE/DevOps toolset knowledge, experience with ClickHouse/Spark/Presto/Doris/Hadoop, coding in Python/Shell/Java/Go, strong problem-solving and communication.
ClickHouse, Spark, Presto, Doris, Hadoop, Kubernetes, Python, Shell, Java, Go
Job PostingView all
1w
Save
Mark Applied
Hide
Site Reliability Engineer, Compute Platform
San Jose, California, United States
OnsiteFull Time
ByteDance
ByteDance: Developing AI-driven content platforms and mobile applications.
Experience with Linux, networking, databases, Kubernetes, ClickHouse/Hadoop/Doris/Spark/Presto, scripting or programming (Python, Shell, Java, Go), incident management, and capacity planning.
ClickHouse, Spark, Presto, Doris, Hadoop, Kubernetes, Linux, Python, Shell, Java, Go
Job PostingView all
2w
Save
Mark Applied
Hide
Staff Machine Learning Engineer
Bengaluru or Noida or Santa Clara
HybridFull Time
Eightfold
Eightfold: An AI-native enterprise talent platform that builds scalable machine learning solutions and agentic AI for talent workflows.
6+ YOEDeep expertise in ML/DL/NLP and LLMs; technical leadership and team mentoring; proficiency with Python, TensorFlow, PyTorch, big data (Hadoop, Spark); experience deploying ML at scale. MS/PhD and 6+ years preferred.
Azure, AWS, Python, TensorFlow, PyTorch, Hadoop, Spark, C/C++, Hava, Scala, R, LLMs, Transformers
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Site Reliability Engineer, Apple Data Platform SRE / Apple Services Engineering
Cupertino, California, United States
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Apply SRE principles to mentor teams, ensure reliability for large-scale analytics infrastructure across Hadoop, HBase, Spark, Data Lakes, and Airflow; participate in production on-call.
Hadoop, HBase, Spark, Data Lakes, Airflow
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Software Engineer
San Francisco, California, United States
$204k-$337k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment processing and financial technology service provider.
Bachelor’s or Master’s in CS/Engineering, extensive software engineering and platform architecture experience, strong Java/JVM and Spring skills, REST/microservices, cloud-native (AWS/Kubernetes), distributed systems (Hadoop/Spark/Kafka), CI/CD and leadership skills.
Java, JVM, Spring Boot, Spring MVC, Spring Security, Spring Cloud, RESTful web services, PostgreSQL, NoSQL, React, JavaScript, TypeScript, HTML, CSS, Hadoop, Spark, Kafka, AWS, PCF, Kubernetes, Docker, CI/CD, Jenkins, Git, Maven, Gradle, SonarQube
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer III
Sunnyvale, California, United States
$117k-$234k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
2+ YOEBachelor's degree or equivalent experience; 4+ years software engineering (or 2+ with degree). Experience with Java, scalable high-throughput systems, microservices, Kafka, Spark, Hadoop/Hive, Scala, and cloud (GCP).
Java, Kafka, Spark, Cassandra, Solr, Elastic, RESTful API, Scala, Hadoop, Hive, GCP, Spark Streaming
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer
San Jose, California, United States
$149k-$361k/yr HybridFull Time
Roku
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
8+ YOE8+ years data engineering experience, strong SQL, Python preferred, expertise with big-data tech (Hadoop, Spark, Kafka, Hive, Airflow), data modeling, and cloud platforms (AWS/GCP).
SQL, Python, Hadoop, HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, Presto, Trino, AWS, GCP, Looker, Claude Code, Cursor, MCP servers
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer, People Innovation Labs
San Francisco, California, United States
$293k-$325k/yr HybridFull Time
OpenAI
OpenAI: Develops artificial intelligence models and generative AI software services.
3+ YOE3+ years data engineering; 8+ years software engineering; Python/Scala/Java; Databricks, Snowflake; ETL schedulers; Spark/Hadoop/Flink; S3/HDFS; strong data pipelines and collaboration.
Python, Scala, Java, Databricks, Snowflake, Fivetran, Airflow, Dagster, Prefect, Spark, Hadoop, Flink, HDFS, S3
Job PostingView all
2w
Save
Mark Applied
Hide
Staff Network Engineer
Palo Alto, California, United States
$195k-$220k/yr HybridFull Time
Quantifind
Quantifind: AI-driven platform for financial risk and fraud detection.
8+ YOEBachelor's in a technical field, 8+ years network engineering experience, expertise with Dell OS10, PAN firewalls, cloud WAFs, BGP/OSPF, Ansible and Python, experience with AWS/data center networking, strong security and monitoring skills; US work authorization required.
Dell OS10, Dell network switches, PAN firewalls, Cloudflare, Akamai, Ubuntu, Docker, Kubernetes, Ansible, Git, Hadoop, Spark, Ganeti, Nagios, PostgreSQL, Jenkins, Scala, Python, NodeJS, AWS
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Compute Platform Engineer
Prague or Berlin or San Francisco or New York City
Kč70k-Kč85k/yr OnsiteFull Time
Zeta Global
Zeta GlobalNYSE: ZETA: Provides an AI-powered marketing platform for enterprise customer engagement.
7+ YOE7+ years software engineering experience; strong Scala and Spark skills; experience with large-scale data-processing frameworks, Hadoop, Airflow, and AWS; mentoring and improving platform reliability.
Scala, Spark, Iceberg, Hadoop, Airflow, Kubernetes, Amazon Web Services (EC2, S3, Athena), JVM
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer - Sr. Consultant level
Foster City, California, United States
HybridFull Time
Visa
VisaNYSE: V: Global payment technology facilitating electronic funds transfers.
8+ YOE8+ years with a BS or 5+ with an advanced degree; strong data engineering, Hadoop, Spark, Python, SQL; Java, REST APIs, Docker/Kubernetes; ETL pipelines; cloud services; leadership experience.
Hadoop, Apache Spark, Python, SQL, Java, REST APIs, Docker, Kubernetes, React, Redux, Spark, Kafka, Redis, Flink, TensorFlow, AWS, Airflow, Control-M, Unix/Shell, JQuery/JavaScript, HTML5, CSS4
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Science Engineer
San Jose or California or United States
$109k-$201k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
8+ YOESenior data engineer with 8+ years experience, distributed data and cloud technologies (Hadoop, Spark, Databricks, S3, EMR), streaming (Kafka/Kinesis), strong SQL and Python/PySpark/Scala skills, CI/CD and orchestration experience, and strong communication.
Hadoop, Hive, Presto, Spark, Databricks, S3, Azure Blob Storage, Notebooks, AWS EMR, Athena, Glue, Delta, Parquet, ORC, Kafka, Kinesis, SQL, Python, PySpark, Scala, Pandas, NumPy, Koalas, APIs, GitHub, Jenkins, Apache Air Flow, Azkaban, AEP, AJO, CJA, Adobe Experience Platform, Adobe Analytics, Customer Journey Analytics, Adobe Journey Optimizer, Collibra, JIRA, Confluence, Copilot, Claude, LLAMA, Databricks Genie, n8n, RAG, MCPs, GenStudio, Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud
Job PostingView all
3mo
Save
Mark Applied
Hide
Forward Deployed Engineer (Rust)
Bellevue or Seattle or San Francisco
HybridFull Time
Spice AI
Spice AI: Building open-source data and AI infrastructure for intelligent applications.
5+ YOE5+ years in engineering roles; experience deploying data, search, and AI systems in enterprise environments; designing and scaling production databases and distributed systems; strong communication; open-source contributions preferred.
Databricks, Snowflake, Starburst, Dremio, ElasticSearch, HDFS, Amazon S3, Relational Databases
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer, Data Architecture and Engineering, gData
Sunnyvale or Boulder or New York City
$130k-$188k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
3+ YOEBachelor's in CS/Math/related or equivalent; 3+ years with data processing (Hadoop, Spark, Pig, Hive), DB administration or data engineering, software experience in Java/C++/Python/Go/JavaScript, and client-facing project experience.
Hadoop, Spark, Pig, Hive, MapReduce, Flume, Java, C++, Python, Go, JavaScript, Advanced SQL, ETL/ELT, NoSQL, AI technologies
Job PostingView all
3w
Save
Mark Applied
Hide
Software Engineer
Irving or San Francisco or Los Angeles
$74k-$137k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
2+ YOEB.S. in CS or related required; 2+ years Java experience; Unix and shell scripting; professional experience with Spring, Hibernate, Maven, Git; SQL and relational DB experience; Hadoop, Spark, Scala, Docker, Kubernetes, AWS are pluses.
Java, Unix, Unix Shell Scripts, Spring, Hibernate, Maven, Git, SQL, Hadoop, Spark, Scala, Docker, Kubernetes, AWS, HBase, Ansible, Postgres, Angular, HTML, JavaScript
Job PostingView all
3d
Save
Mark Applied
Hide
Staff Software Engineer
San Jose, California, United States
$228k-$301k/yr HybridFull Time
PayPal
PayPalNASDAQ: PYPL: Global digital payments platform for consumers and merchants.
8+ YOEBachelor's degree plus 8+ years experience; strong Java/Scala and distributed systems background; experience with Spark, Hadoop, Kafka, GCP/BigQuery; designing high-throughput low-latency systems.
Java, Scala, Apache Spark, Hadoop MapReduce, HBase, Kafka, Google Cloud Platform (GCP), BigQuery, DataProc, Elasticsearch, Lucene
Job PostingView all
2w
Save
Mark Applied
Hide
Principal Engineer - AI/ML
Frisco or San Jose or Newport Beach or New York or Toronto or Waterloo
$172k-$283k/yr HybridFull Time
McAfee
McAfee: Provides consumer cybersecurity, identity protection, and online privacy software.
10+ YOE10+ years software development experience with technical leadership; expertise in cloud-native architecture, agentic AI/ML, full-stack development, distributed systems, Kubernetes, and modern cloud platforms.
Python, Java, Go, Rust, C++, JavaScript, TypeScript, Dart, React, Flutter, gRPC, protobuf, AWS, Azure, GCP, Docker, Kubernetes, Helm, ArgoCD, Calico, OPA, Istio, Linkerd, eBPF, Cilium, Data Bricks, Snowflake, BigQuery, Spark, Hadoop, Kafka, GitHub Copilot, Claude Code, Claude, ChatGPT
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Software Engineer
San Francisco, California, United States
$179k-$263k/yr RemoteFull Time
6sense
6sense: AI platform for B2B buyer intent and revenue prediction.
BS/MS in Computer Science or equivalent experience; strong Big Data experience (Hadoop, Hive, Spark, Flink, Presto, Kafka, etc.), ETL, schema design, SQL, data ingestion/integration, and use of AI coding assistants.
Hadoop, M/R, Hive, Spark, Flink, Metastore, Presto, Kafka, Claude Code, Windsurf, SQL, Django, AWS
Job PostingView all

Explore Jobs

Expand Your Job Search