47 hadoop engineer jobs at 29 companies in Penngrove, CA

2w
Save
Mark Applied
Hide
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yr RemoteFull Time
SentiLink
SentiLink: Provides identity verification and fraud prevention for financial institutions.
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Python, Golang, PostgreSQL (RDS), OpenSearch, Redshift, EMR, Spark, Docker, Lambda, AWS, EKS, SQS, SNS, S3, Kubernetes, Hadoop, Kafka, Microsoft Azure, GCP
2mo
Save
Mark Applied
Hide
Principal Software Engineer
San Francisco, California, United States
$204k-$337k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment processing and financial technology service provider.
Bachelor’s or Master’s in CS/Engineering, extensive software engineering and platform architecture experience, strong Java/JVM and Spring skills, REST/microservices, cloud-native (AWS/Kubernetes), distributed systems (Hadoop/Spark/Kafka), CI/CD and leadership skills.
Java, JVM, Spring Boot, Spring MVC, Spring Security, Spring Cloud, RESTful web services, PostgreSQL, NoSQL, React, JavaScript, TypeScript, HTML, CSS, Hadoop, Spark, Kafka, AWS, PCF, Kubernetes, Docker, CI/CD, Jenkins, Git, Maven, Gradle, SonarQube
3mo
Save
Mark Applied
Hide
Data Engineer, People Innovation Labs
San Francisco, California, United States
$293k-$325k/yr HybridFull Time
OpenAI
OpenAI: Develops artificial intelligence models and generative AI software services.
3+ YOE3+ years data engineering; 8+ years software engineering; Python/Scala/Java; Databricks, Snowflake; ETL schedulers; Spark/Hadoop/Flink; S3/HDFS; strong data pipelines and collaboration.
Python, Scala, Java, Databricks, Snowflake, Fivetran, Airflow, Dagster, Prefect, Spark, Hadoop, Flink, HDFS, S3
1mo
Save
Mark Applied
Hide
Senior Compute Platform Engineer
Prague or Berlin or San Francisco or New York City
Kč70k-Kč85k/yr OnsiteFull Time
Zeta Global
Zeta GlobalNYSE: ZETA: Provides an AI-powered marketing platform for enterprise customer engagement.
7+ YOE7+ years software engineering experience; strong Scala and Spark skills; experience with large-scale data-processing frameworks, Hadoop, Airflow, and AWS; mentoring and improving platform reliability.
Scala, Spark, Iceberg, Hadoop, Airflow, Kubernetes, Amazon Web Services (EC2, S3, Athena), JVM
2mo
Save
Mark Applied
Hide
Senior Engineer, Ceph
Austin or Toronto or New York City or Montreal or Kitchener or London or San Francisco
RemoteFull Time
Index Exchange
Index Exchange: Provides a programmatic marketplace for digital advertising transactions.
Experience building, maintaining, and troubleshooting Ceph and Rook at scale; IaC and config management (Salt, Ansible, Puppet, Terraform); storage replication, capacity planning, disaster recovery, monitoring, automation and CI/CD; strong cross-team communication and mentoring skills.
Ceph, Rook, Hadoop, Spark, Aerospike, Kafka, Salt, Ansible, Puppet, Terraform, IaC, CI/CD
1mo
Save
Mark Applied
Hide
Software Engineer
Irving or San Francisco or Los Angeles
$74k-$137k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
2+ YOEB.S. in CS or related required; 2+ years Java experience; Unix and shell scripting; professional experience with Spring, Hibernate, Maven, Git; SQL and relational DB experience; Hadoop, Spark, Scala, Docker, Kubernetes, AWS are pluses.
Java, Unix, Unix Shell Scripts, Spring, Hibernate, Maven, Git, SQL, Hadoop, Spark, Scala, Docker, Kubernetes, AWS, HBase, Ansible, Postgres, Angular, HTML, JavaScript
3mo
Save
Mark Applied
Hide
Sr. Software Engineer
San Francisco, California, United States
$179k-$263k/yr RemoteFull Time
6sense
6sense: AI platform for B2B buyer intent and revenue prediction.
BS/MS in Computer Science or equivalent experience; strong Big Data experience (Hadoop, Hive, Spark, Flink, Presto, Kafka, etc.), ETL, schema design, SQL, data ingestion/integration, and use of AI coding assistants.
Hadoop, M/R, Hive, Spark, Flink, Metastore, Presto, Kafka, Claude Code, Windsurf, SQL, Django, AWS
2w
Save
Mark Applied
Hide
Member of Technical Staff - GPU Infrastructure Engineer
San Francisco, California, United States
OnsiteFull Time
Liquid AI
Liquid AI: Develops efficient general-purpose artificial intelligence foundation models.
Strong software engineering with production infrastructure tooling, deep distributed systems/Linux/networking/storage knowledge, experience operating shared compute clusters and supporting production users.
Linux, SLURM, Kubernetes, Ray, Hadoop
2w
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$175k-$270k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
8+ YOE8+ years building large-scale data platforms, distributed systems, cloud-native data pipelines, EM/ML operationalization, and data warehouse/Big Data solutions; Bachelor's in CS or related.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, Aerospike, Elastic Search, IBM Infosphere, Oracle, SQL Server, AppDynamics, Kubernetes
1mo
Save
Mark Applied
Hide
Senior Software Engineer — Data Modeling (Europe)
San Francisco or Poland or Europe
RemoteContract
People.ai
People.ai: AI platform providing revenue intelligence and sales productivity solutions.
5+ YOE5+ years building backend systems; 2+ years in Python or Scala; experience with distributed systems, large-scale data processing (Spark/Hive/Hadoop/MapReduce), stream processing (Kafka/Apache Samza/Apache Storm); strong analytical and ownership skills.
Python, Scala, Spark, Hive, Hadoop, MapReduce, Kafka, Apache Samza, Apache Storm, Elasticsearch, LLMs, NLP
3d
Save
Mark Applied
Hide
Software Engineer II
San Francisco, California, United States
$171k-$209k/yr HybridFull Time
Uber
UberNYSE: UBER: A technology platform for transportation, delivery, and freight.
3+ YOEBachelor's degree in a technical field and 3+ years of software engineering experience. Requires programming, data modeling, distributed systems, testing, monitoring, and system design expertise.
Go, Java, Python, C++, GIT, SVN, SQL, MySQL, Spark, Hive, Presto, Flink, Michelangelo, Bullseye, Morpheus, Flow, Piper, Hadoop, Kafka
3w
Save
Mark Applied
Hide
Staff Data Engineer
San Francisco, California, United States
$237k-$270k/yr HybridFull Time
Front
Front: Customer operations platform for collaborative team communication.
5+ YOE5+ years data engineering/ETL experience, Snowflake, advanced SQL and Python, experience with big data technologies and workflow tools, BS/BA or equivalent, strong stakeholder collaboration and AI fluency.
Snowflake, Python, SQL, HDFS, EMR, Redshift, Spark, Flink, Presto, Airflow
3mo
Save
Mark Applied
Hide
Data Engineer, PXT Central Science
Seattle or Boston or Bellevue or Arlington or San Francisco
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOE3+ years data engineering; AWS stack; data modeling/ETL; programming in Python/Java/Scala/NodeJS; experience with Redshift/S3/Glue/EMR/Kinesis/Lambda; non-relational data stores.
AWS, Python, SQL, Spark, Hadoop, Hive, Redshift, S3, EMR, Lambda, Kinesis, Airflow
4d
Save
Mark Applied
Hide
Sr Product Software Engineer
San Francisco or Glendale or Santa Monica
$155k-$208k/yr OnsiteFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOEBachelor's degree in computer science, engineering, or related field and 5+ years of backend software development experience with Java, Scala, distributed systems, ETL, databases, testing, and reliable production services.
Java, Scala, Spark, Flink, Kafka, Airflow, Hadoop
2d
Save
Mark Applied
Hide
Associate Data Engineer 2027 - AI & Data Analytics
San Francisco, California, United States
$71k-$107k/yr OnsiteFull Time
IBM
IBMNew York Stock Exchange: IBM: Global technology providing enterprise software, cloud, and consulting.
High school diploma/GED and familiarity with programming or query languages, data engineering, cloud computing, AI/ML concepts, analytical problem solving, teamwork, and communication. Willingness to travel up to 100% required.
Python, SQL, Java, Scala, JavaScript, AWS, Azure, Google Cloud, IBM Cloud, Spark, Hadoop, Kafka, Airflow, dbt, Databricks, Snowflake, Delta Lake, Linux, Pinecone, Weaviate, pgvector, LangChain, LangGraph, LlamaIndex, Semantic Kernel, AutoGen, Git, Kubernetes, RAG, LLMs
1mo
Save
Mark Applied
Hide
Software Engineer, Systems
San Francisco, California, United States
$150k-$250k/yr HybridFull Time
Eventual
Eventual: Distributed data engine for processing multimodal AI datasets.
3+ YOE3+ years in distributed data systems, strong systems programming (C++, Rust, C), Linux, familiarity with cloud storage (AWS S3), and experience with query planning, scheduling, or data pipelines.
Daft, Apache Parquet, Apache Iceberg, Delta Lake, Hadoop, Spark, Dask, Ray, BigQuery, PostgreSQL, C++, Rust, C, Linux, AWS S3
1mo
Save
Mark Applied
Hide
Sr. Data Engineer
San Francisco, California, United States
$146k-$235k/yr HybridFull Time
DocuSign
DocuSignNASDAQ: DOCU: Provides electronic signature and agreement management software solutions.
8+ YOEBachelor's degree required; 8+ years experience in dimensional/relational data modeling, strong SQL and data pipeline skills in Python or Java, experience with cloud data platforms, ETL tools, and data architecture.
Python, Java, SQL, Snowflake, BigQuery, Teradata, Redshift, Oracle, SQL Server, MySQL, Hadoop, Spark, AWS, dbt, Matillion, SSIS, ADF, Erwin, SQLDBM, Airflow, Datadog, AWS SNS, Claude Code, Cortex Coco, VSCode copilot, Tableau, Jira, Confluence
1mo
Save
Mark Applied
Hide
Sr. Data Engineer
San Francisco, California, United States
$146k-$235k/yr HybridFull Time
DocuSign
DocuSignNASDAQ: DOCU: Provider of e-signature and intelligent agreement management software.
8+ YOEBachelor's in CS or related field, 8+ years dimensional/relational modeling, experience building data pipelines (Python or Java), strong SQL and data warehouse experience (Snowflake), ETL and cloud tool experience.
AWS, Snowflake, dbt, Airflow, Matillion, Python, Java, SQL, BigQuery, Teradata, Redshift, Hadoop, Spark, Oracle, SQL Server, MySQL, SSIS, ADF, Erwin, SQLDBM, Datadog, Claude Code, Cortex Coco, VSCode, Tableau, Jira, Confluence
3mo
Save
Mark Applied
Hide
Sr. Business Intelligence Engineer - Digital Experiences & Capabilities
San Francisco, California, United States
$181k-$289k/yr HybridFull Time
Visa
VisaNYSE: V: Global payment technology facilitating electronic funds transfers.
8+ YOE8+ years in data engineering/analytics with strong data modeling, governance, and AI-driven analytics; experience with large datasets, dashboards, and MarTech platforms; strong collaboration and communication skills.
Tableau, Power BI, Looker, Hadoop, AI/ML tooling
4d
Save
Mark Applied
Hide
Sr Product Software Engineer
San Francisco or Glendale or Santa Monica
$155k-$208k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOEBachelor's degree required; 5+ years of backend software development using Java, Scala, or similar languages, with distributed systems, ETL, databases, testing, and production services experience.
Java, Scala, Spark, Flink, Kafka, Airflow, Hadoop