53 big data developer jobs at 34 companies in Hercules, CA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
2w
Save
Mark Applied
Hide
DE&A - Core - Big Data Engineering - Hadoop Ecosystem
Pune or Milpitas or Seattle or Princeton or Cape Town or London or Zurich or Singapore or Mexico City
RemoteFull Time
Zensar
ZensarNational Stock Exchange of India: ZENSARTECH: Global technology firm providing digital transformation and infrastructure services.
8+ YOESenior quant/engineering role: 8+ years in quantitative development/architecture; strong Python (required), C++/Java (preferred); experience with Spark/Hadoop, SQL/NoSQL, cloud platforms (AWS/Azure/GCP), Kafka/Flink; strong quant finance knowledge and model development experience.
Python, C++, Java, NumPy, Pandas, SciPy, TensorFlow, Spark, Hadoop, SQL, NoSQL, AWS, Azure, GCP, Databricks, Snowflake, Kafka, Flink
2mo
Save
Mark Applied
Hide
Lead Data Engineer
San Francisco, California, United States
$215k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEFour+ years application development; two+ years big data; one year cloud computing; Bachelor’s degree.
Java, Scala, Python, SQL, NoSQL, Redshift, Snowflake, Hadoop, Kafka, Spark, MapReduce, Hive, Unix/Linux, Cloud Computing, JavaScript, Shell scripting
1w
Save
Mark Applied
Hide
Staff Data Engineer
Mountain View or San Diego
$189k-$259k/yr OnsiteFull Time
Intuit
IntuitNASDAQ: INTU: Provides financial software for accounting, tax, and personal finance.
7+ YOE7+ years experience in data analytics/engineering, bachelor's in a quantitative field, proficiency in Java or Python, ETL/data modeling, big data frameworks, and visualization tools; strong communication skills.
Java, Python, Tableau, Qlik, PowerBI, Apache Spark, Hadoop, Databricks
3d
Save
Mark Applied
Hide
Senior, Data Engineer
Bentonville or Sunnyvale
$90k-$234k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
2+ YOE5+ years data/software engineering experience (or equivalent degree+experience), 2+ years data engineering, expertise with big data technologies, SQL, Scala or Python, Airflow, Kafka, and cloud platforms.
Hadoop, Apache Spark, Apache Hive, GCP, Azure, Scala, Python, Apache Airflow, BigQuery, Spark SQL, Kafka
2d
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$145k-$223k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
8+ YOEBachelor's degree in CS or related,8+ years relevant experience building data platforms,experience with data warehouse, big data, ETL, cloud, AI/ML lifecycle, and delivering production systems.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, HDFS, Elastic Search, Oracle, SQL Server, IBM Infosphere, AppDynamics, Kubernetes
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica or Seattle or San Francisco
$142k-$190k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOEBachelor's or equivalent experience, 5+ years big data engineering, strong Python/Scala/SQL, Spark/Presto/Hive, Databricks and cloud MPP databases, Airflow, AWS S3, CI/CD, on-call and production operations experience.
Databricks, Spark, Presto, Hive, Python, Scala, SQL, Snowflake, Redshift, BigQuery, Airflow, CI/CD, AWS S3, Terraform
3mo
Save
Mark Applied
Hide
Staff Data Engineer, Data Platform
San Francisco, California, United States
$182k-$228k/yr HybridFull Time
Turo
Turo: Marketplace for renting cars directly from local owners.
7+ YOEStrong data platform engineering, ETL, Airflow, cloud platforms (AWS, GCP, Azure), Spark or big data, 7+ years.
Airflow, Prefect, Dagster, AWS, GCP, Azure, Terraform, Kubernetes, Spark
1mo
Save
Mark Applied
Hide
Software Engineer II, Big Data, tvScientific
San Francisco, California, United States
$124k-$255k/yr RemoteFull Time
Pinterest
PinterestNYSE: PINS: Visual discovery engine for finding inspiration and creative ideas.
Production data engineering with Spark and Scala; AWS; data pipelines; APIs; data lakes; SQL; Bachelor's in CS; AI-assisted workflows experience.
Apache Spark, Scala, AWS, SQL, Apache Iceberg, Delta Lake, APIs
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco, California, United States
$138k-$221k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment network facilitating electronic transactions and financial services.
Senior-level Big Data engineering experience with Java or Scala, Apache Spark, Hive/Impala, streaming tools (Kafka, NiFi), relational and NoSQL databases, Linux/Shell, strong CS fundamentals, and experience designing high-scale distributed systems.
Java, Scala, Apache Spark, MySQL, PostgreSQL, Hive, Impala, Oozie, Airflow, NiFi, Kafka, Linux/Unix, Shell, Azure, AWS, GCP
3w
Save
Mark Applied
Hide
Senior Data Infra Engineer
Mountain View, California, United States
$175k-$221k/yr OnsiteFull Time
NewsBreak
NewsBreak: Local news aggregation platform powered by artificial intelligence.
BS/MS in Computer Science or equivalent; experience with big-data technologies (Hadoop, Spark, Presto, Kafka, Flink), databases, and cloud (AWS). Strong modeling, communication, and mentoring skills; senior-level data infrastructure experience preferred.
Hadoop, Spark, Presto, Kafka, Flink, AWS
2mo
Save
Mark Applied
Hide
Staff Data Engineer
Foster City, California, United States
$146k-$234k/yr HybridAll Commitments Available
Visa
VisaNYSE: V: Global payment technology facilitating electronic funds transfers.
5+ YOE5+ years data engineering with a Bachelor's or 2+ years with an advanced degree; or 0 years with a PhD. Strong big data, Spark, Hadoop, Python, SQL; Java, REST APIs, and container tech; ML/AI model experience.
Hadoop, Spark, Python, SQL, Java, REST APIs, Docker, Kubernetes, Kafka, Redis, Flink, TensorFlow, Triton, AWS, Unix/Shell, Airflow, Control-M, React, Redux, HTML5, CSS, JavaScript
2w
Save
Mark Applied
Hide
Senior Software Engineer, Data Platform
San Francisco or United Kingdom
$190k-$250k/yr HybridFull Time
Persona
Persona: Provides identity verification and fraud prevention software for businesses.
5+ YOE5+ years software engineering experience with data infrastructure or distributed systems; proficiency in Python and familiarity with Go; experience with big-data/streaming (Spark, Kafka, Flink) and Iceberg; leading projects and mentoring engineers.
Python, Go, Spark, Kafka, Flink, Iceberg, ClickHouse, DuckDB, Google Cloud (GCP), Kubernetes, MySQL, MongoDB, Snowflake
2mo
Save
Mark Applied
Hide
Sr. Software Engineer,Data, Autonomy
Palo Alto, California, United States
$163k-$204k/yr OnsiteFull Time
Rivian
RivianNASDAQ: RIVN: Designs and manufactures electric vehicles and charging networks.
Bachelor’s degree in CS or related field; experience as Software Engineer with big data, data pipelines, visualization; Python, SQL; Databricks, AWS; strong communication and teamwork.
Hex, Streamlit, SQL, Python, Databricks, AWS
1mo
Save
Mark Applied
Hide
Software Engineer (L3) Data Substrate
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California or San Francisco or Oakland or San Jose or Washington
$139k-$204k/yr RemoteFull Time
Twilio
TwilioNYSE: TWLO: Cloud communications platform for building customer engagement applications.
5+ YOEBachelor's or Master's in CS/Engineering, 5+ years software development, proficiency in Python/Java/Scala, experience with big data tools (Kafka, Spark, Hive, Hudi, Presto, Airflow) and AWS services, strong problem-solving and communication skills.
Kafka, Spark, Hive, Hudi, Presto, Airflow, AWS Lakeformation, Glue, Athena, Python, Java, Scala
3w
Save
Mark Applied
Hide
Software Development Engineer – Big Data, AWS Elastic MapReduce (EMR), EMR EKS
East Palo Alto, California, United States
$165k-$224k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOE3+ years professional software development, 2+ years design/architecture experience, programming experience, full SDLC experience preferred, Bachelor\u0002s in CS preferred.
Hadoop, Hive, Pig, Impala, Spark, Presto, HBase, Amazon Simple Storage Service (S3), Amazon Elastic Compute Cloud (EC2), Elastic MapReduce (EMR), EMR EKS
3d
Save
Mark Applied
Hide
Software Engineer I (Data Eng infra)
Mountain View, California, United States
$116k-$174k/yr HybridFull Time
Aurora
AuroraNASDAQ: AUR: Developing autonomous driving technology for trucking and passenger mobility.
1+ YOE1+ years software engineering experience focused on data projects; proficiency in Python/Go/C++; experience with big-data frameworks, cloud data services, SQL, Airflow, DBT; BS in CS/Engineering or equivalent.
Python, Go, C++, Apache Spark, Flink, Kinesis Data Stream, AWS, GCP, Azure, S3, Redshift, BigQuery, Glue, SQL, DBT, Apache Airflow, Snowflake
2mo
Save
Mark Applied
Hide
Senior Data Engineer, Sentinel (Pacific Time Zone)
United States or San Francisco
$153k-$190k/yr RemoteFull Time
Komodo Health
Komodo Health: Provides AI-driven healthcare data and patient journey analytics software.
Proficiency in Python with backend API/microservices experience; strong AWS knowledge; IaC (Terraform/Scalr); CI/CD with GitHub Actions; networking basics; big-data tools (Snowflake, Databricks, Airflow, Temporal); AI tools (Gemini, ChatGPT, Cursor); collaborative, proactive team player.
Python, AWS, Terraform, Scalr, GitHub Actions, Snowflake, Databricks, Airflow, Temporal, Gemini, ChatGPT, Cursor
2mo
Save
Mark Applied
Hide
Sr. Software Engineer
San Francisco, California, United States
$179k-$263k/yr RemoteFull Time
6sense
6sense: AI platform for B2B buyer intent and revenue prediction.
BS/MS in Computer Science or equivalent experience; strong Big Data experience (Hadoop, Hive, Spark, Flink, Presto, Kafka, etc.), ETL, schema design, SQL, data ingestion/integration, and use of AI coding assistants.
Hadoop, M/R, Hive, Spark, Flink, Metastore, Presto, Kafka, Claude Code, Windsurf, SQL, Django, AWS
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Apple Services Engineering
Cupertino, California, United States
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Experienced engineer for building distributed, large-scale data processing systems and platforms using big data technologies to support Apple Services and partner teams.