52 big data engineer jobs at 35 companies in Hercules, CA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
3w
Save
Mark Applied
Hide
DE&A - Core - Big Data Engineering - Hadoop Ecosystem
Pune or Milpitas or Seattle or Princeton or Cape Town or London or Zurich or Singapore or Mexico City
RemoteFull Time
Zensar
ZensarNational Stock Exchange of India: ZENSARTECH: Global technology firm providing digital transformation and infrastructure services.
8+ YOESenior quant/engineering role: 8+ years in quantitative development/architecture; strong Python (required), C++/Java (preferred); experience with Spark/Hadoop, SQL/NoSQL, cloud platforms (AWS/Azure/GCP), Kafka/Flink; strong quant finance knowledge and model development experience.
Python, C++, Java, NumPy, Pandas, SciPy, TensorFlow, Spark, Hadoop, SQL, NoSQL, AWS, Azure, GCP, Databricks, Snowflake, Kafka, Flink
6d
Save
Mark Applied
Hide
Senior, Data Engineer
Bentonville or Sunnyvale
$90k-$234k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
2+ YOE5+ years data/software engineering experience (or equivalent degree+experience), 2+ years data engineering, expertise with big data technologies, SQL, Scala or Python, Airflow, Kafka, and cloud platforms.
Hadoop, Apache Spark, Apache Hive, GCP, Azure, Scala, Python, Apache Airflow, BigQuery, Spark SQL, Kafka
1w
Save
Mark Applied
Hide
Staff Data Engineer
Mountain View or San Diego
$189k-$259k/yr OnsiteFull Time
Intuit
IntuitNASDAQ: INTU: Provides financial software for accounting, tax, and personal finance.
7+ YOE7+ years experience in data analytics/engineering, bachelor's in a quantitative field, proficiency in Java or Python, ETL/data modeling, big data frameworks, and visualization tools; strong communication skills.
Java, Python, Tableau, Qlik, PowerBI, Apache Spark, Hadoop, Databricks
2mo
Save
Mark Applied
Hide
Principal Data Engineer
San Francisco, California, United States
$207k-$276k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
15+ YOE15+ years in software, FinTech, leading cross-functional teams; expert in data engineering, SDLC, cloud, and architectures; hands-on with Java, microservices, big data, and CI/CD.
Java, Spring, Microservices, Kafka, Oracle, SQL, JavaScript, Python, Hadoop/S3, Spark, TensorFlow, PyTorch, CI/CD, Git, Jenkins, Terraform, AWS, GCP, Azure, Jira, Confluence
1mo
Save
Mark Applied
Hide
Software Engineer II, Big Data, tvScientific
San Francisco, California, United States
$124k-$255k/yr RemoteFull Time
Pinterest
PinterestNYSE: PINS: Visual discovery engine for finding inspiration and creative ideas.
Production data engineering with Spark and Scala; AWS; data pipelines; APIs; data lakes; SQL; Bachelor's in CS; AI-assisted workflows experience.
Apache Spark, Scala, AWS, SQL, Apache Iceberg, Delta Lake, APIs
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica or Seattle or San Francisco
$142k-$190k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOEBachelor's or equivalent experience, 5+ years big data engineering, strong Python/Scala/SQL, Spark/Presto/Hive, Databricks and cloud MPP databases, Airflow, AWS S3, CI/CD, on-call and production operations experience.
Databricks, Spark, Presto, Hive, Python, Scala, SQL, Snowflake, Redshift, BigQuery, Airflow, CI/CD, AWS S3, Terraform
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco, California, United States
$138k-$221k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment network facilitating electronic transactions and financial services.
Senior-level Big Data engineering experience with Java or Scala, Apache Spark, Hive/Impala, streaming tools (Kafka, NiFi), relational and NoSQL databases, Linux/Shell, strong CS fundamentals, and experience designing high-scale distributed systems.
Java, Scala, Apache Spark, MySQL, PostgreSQL, Hive, Impala, Oozie, Airflow, NiFi, Kafka, Linux/Unix, Shell, Azure, AWS, GCP
2mo
Save
Mark Applied
Hide
Lead Data Engineer
San Francisco, California, United States
$215k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEFour+ years application development; two+ years big data; one year cloud computing; Bachelor’s degree.
Java, Scala, Python, SQL, NoSQL, Redshift, Snowflake, Hadoop, Kafka, Spark, MapReduce, Hive, Unix/Linux, Cloud Computing, JavaScript, Shell scripting
3w
Save
Mark Applied
Hide
Senior Data Infra Engineer
Mountain View, California, United States
$175k-$221k/yr OnsiteFull Time
NewsBreak
NewsBreak: Local news aggregation platform powered by artificial intelligence.
BS/MS in Computer Science or equivalent; experience with big-data technologies (Hadoop, Spark, Presto, Kafka, Flink), databases, and cloud (AWS). Strong modeling, communication, and mentoring skills; senior-level data infrastructure experience preferred.
Hadoop, Spark, Presto, Kafka, Flink, AWS
3mo
Save
Mark Applied
Hide
Staff Data Engineer, Data Platform
San Francisco, California, United States
$182k-$228k/yr HybridFull Time
Turo
Turo: Marketplace for renting cars directly from local owners.
7+ YOEStrong data platform engineering, ETL, Airflow, cloud platforms (AWS, GCP, Azure), Spark or big data, 7+ years.
Airflow, Prefect, Dagster, AWS, GCP, Azure, Terraform, Kubernetes, Spark
2mo
Save
Mark Applied
Hide
Staff Data Engineer
Foster City, California, United States
$146k-$234k/yr HybridAll Commitments Available
Visa
VisaNYSE: V: Global payment technology facilitating electronic funds transfers.
5+ YOE5+ years data engineering with a Bachelor's or 2+ years with an advanced degree; or 0 years with a PhD. Strong big data, Spark, Hadoop, Python, SQL; Java, REST APIs, and container tech; ML/AI model experience.
Hadoop, Spark, Python, SQL, Java, REST APIs, Docker, Kubernetes, Kafka, Redis, Flink, TensorFlow, Triton, AWS, Unix/Shell, Airflow, Control-M, React, Redux, HTML5, CSS, JavaScript
2mo
Save
Mark Applied
Hide
Senior Data Engineer, Sentinel (Pacific Time Zone)
United States or San Francisco
$153k-$190k/yr RemoteFull Time
Komodo Health
Komodo Health: Provides AI-driven healthcare data and patient journey analytics software.
Proficiency in Python with backend API/microservices experience; strong AWS knowledge; IaC (Terraform/Scalr); CI/CD with GitHub Actions; networking basics; big-data tools (Snowflake, Databricks, Airflow, Temporal); AI tools (Gemini, ChatGPT, Cursor); collaborative, proactive team player.
Python, AWS, Terraform, Scalr, GitHub Actions, Snowflake, Databricks, Airflow, Temporal, Gemini, ChatGPT, Cursor
2w
Save
Mark Applied
Hide
Senior Software Engineer, Data Platform
San Francisco or United Kingdom
$190k-$250k/yr HybridFull Time
Persona
Persona: Provides identity verification and fraud prevention software for businesses.
5+ YOE5+ years software engineering experience with data infrastructure or distributed systems; proficiency in Python and familiarity with Go; experience with big-data/streaming (Spark, Kafka, Flink) and Iceberg; leading projects and mentoring engineers.
Python, Go, Spark, Kafka, Flink, Iceberg, ClickHouse, DuckDB, Google Cloud (GCP), Kubernetes, MySQL, MongoDB, Snowflake
2mo
Save
Mark Applied
Hide
Sr. Software Engineer,Data, Autonomy
Palo Alto, California, United States
$163k-$204k/yr OnsiteFull Time
Rivian
RivianNASDAQ: RIVN: Designs and manufactures electric vehicles and charging networks.
Bachelor’s degree in CS or related field; experience as Software Engineer with big data, data pipelines, visualization; Python, SQL; Databricks, AWS; strong communication and teamwork.
Hex, Streamlit, SQL, Python, Databricks, AWS
6d
Save
Mark Applied
Hide
Software Engineer I (Data Eng infra)
Mountain View, California, United States
$116k-$174k/yr HybridFull Time
Aurora
AuroraNASDAQ: AUR: Developing autonomous driving technology for trucking and passenger mobility.
1+ YOE1+ years software engineering experience focused on data projects; proficiency in Python/Go/C++; experience with big-data frameworks, cloud data services, SQL, Airflow, DBT; BS in CS/Engineering or equivalent.
Python, Go, C++, Apache Spark, Flink, Kinesis Data Stream, AWS, GCP, Azure, S3, Redshift, BigQuery, Glue, SQL, DBT, Apache Airflow, Snowflake
1w
Save
Mark Applied
Hide
Senior Postmarket Surveillance Data Scientist
Alameda, California, United States
$90k-$180k/yr OnsiteFull Time
Abbott
AbbottNYSE: ABT: Manufactures medical devices, diagnostics, and nutritional health products.
4+ YOEBachelor's in CS, Data Analytics, Math, Stats, Physics, or Engineering; 4+ years relevant experience; advanced Python, SQL, PowerBI, Databricks; statistics and big-data analytics; mentoring experience.
Python, SQL, PowerBI, Databricks
2mo
Save
Mark Applied
Hide
Senior Software Engineer, Backend - RQL
Seattle or San Francisco
$168k-$280k/yr OnsiteFull Time
Rippling
Rippling: Unified platform managing workforce HR, IT, and finance operations
6+ YOE6+ years backend engineering experience; experience with distributed systems, distributed processing engines, big data technologies, mentoring developers, and building data platforms.
Python, MongoDB, CDC, Kafka, Aurora, Trino, Presto, Pinot, Iceberg, Flink, Rippling Query Language (RQL), Microsoft 365
1mo
Save
Mark Applied
Hide
Software Engineer (L3) Data Substrate
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California or San Francisco or Oakland or San Jose or Washington
$139k-$204k/yr RemoteFull Time
Twilio
TwilioNYSE: TWLO: Cloud communications platform for building customer engagement applications.
5+ YOEBachelor's or Master's in CS/Engineering, 5+ years software development, proficiency in Python/Java/Scala, experience with big data tools (Kafka, Spark, Hive, Hudi, Presto, Airflow) and AWS services, strong problem-solving and communication skills.
Kafka, Spark, Hive, Hudi, Presto, Airflow, AWS Lakeformation, Glue, Athena, Python, Java, Scala
2mo
Save
Mark Applied
Hide
Sr. Software Engineer
San Francisco, California, United States
$179k-$263k/yr RemoteFull Time
6sense
6sense: AI platform for B2B buyer intent and revenue prediction.
BS/MS in Computer Science or equivalent experience; strong Big Data experience (Hadoop, Hive, Spark, Flink, Presto, Kafka, etc.), ETL, schema design, SQL, data ingestion/integration, and use of AI coding assistants.
Hadoop, M/R, Hive, Spark, Flink, Metastore, Presto, Kafka, Claude Code, Windsurf, SQL, Django, AWS