HiringCafe
Join our community

27 big data engineer jobs at 20 companies in Petaluma, CA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal Data Engineer
San Francisco, California, United States
$207k-$276k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
15+ YOE15+ years in software, FinTech, leading cross-functional teams; expert in data engineering, SDLC, cloud, and architectures; hands-on with Java, microservices, big data, and CI/CD.
Java, Spring, Microservices, Kafka, Oracle, SQL, JavaScript, Python, Hadoop/S3, Spark, TensorFlow, PyTorch, CI/CD, Git, Jenkins, Terraform, AWS, GCP, Azure, Jira, Confluence
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer II, Big Data, tvScientific
San Francisco, California, United States
$124k-$255k/yr RemoteFull Time
Pinterest
PinterestNYSE: PINS: Visual discovery engine for finding inspiration and creative ideas.
Production data engineering with Spark and Scala; AWS; data pipelines; APIs; data lakes; SQL; Bachelor's in CS; AI-assisted workflows experience.
Apache Spark, Scala, AWS, SQL, Apache Iceberg, Delta Lake, APIs
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica or Seattle or San Francisco
$142k-$190k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOEBachelor's or equivalent experience, 5+ years big data engineering, strong Python/Scala/SQL, Spark/Presto/Hive, Databricks and cloud MPP databases, Airflow, AWS S3, CI/CD, on-call and production operations experience.
Databricks, Spark, Presto, Hive, Python, Scala, SQL, Snowflake, Redshift, BigQuery, Airflow, CI/CD, AWS S3, Terraform
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco, California, United States
$138k-$221k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment network facilitating electronic transactions and financial services.
Senior-level Big Data engineering experience with Java or Scala, Apache Spark, Hive/Impala, streaming tools (Kafka, NiFi), relational and NoSQL databases, Linux/Shell, strong CS fundamentals, and experience designing high-scale distributed systems.
Java, Scala, Apache Spark, MySQL, PostgreSQL, Hive, Impala, Oozie, Airflow, NiFi, Kafka, Linux/Unix, Shell, Azure, AWS, GCP
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Data Engineer
San Francisco, California, United States
$215k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEFour+ years application development; two+ years big data; one year cloud computing; Bachelor’s degree.
Java, Scala, Python, SQL, NoSQL, Redshift, Snowflake, Hadoop, Kafka, Spark, MapReduce, Hive, Unix/Linux, Cloud Computing, JavaScript, Shell scripting
Job PostingView all
3mo
Save
Mark Applied
Hide
Staff Data Engineer, Data Platform
San Francisco, California, United States
$182k-$228k/yr HybridFull Time
Turo
Turo: Marketplace for renting cars directly from local owners.
7+ YOEStrong data platform engineering, ETL, Airflow, cloud platforms (AWS, GCP, Azure), Spark or big data, 7+ years.
Airflow, Prefect, Dagster, AWS, GCP, Azure, Terraform, Kubernetes, Spark
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer, Sentinel (Pacific Time Zone)
United States or San Francisco
$153k-$190k/yr RemoteFull Time
Komodo Health
Komodo Health: Provides AI-driven healthcare data and patient journey analytics software.
Proficiency in Python with backend API/microservices experience; strong AWS knowledge; IaC (Terraform/Scalr); CI/CD with GitHub Actions; networking basics; big-data tools (Snowflake, Databricks, Airflow, Temporal); AI tools (Gemini, ChatGPT, Cursor); collaborative, proactive team player.
Python, AWS, Terraform, Scalr, GitHub Actions, Snowflake, Databricks, Airflow, Temporal, Gemini, ChatGPT, Cursor
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Software Engineer, Data Platform
San Francisco or United Kingdom
$190k-$250k/yr HybridFull Time
Persona
Persona: Provides identity verification and fraud prevention software for businesses.
5+ YOE5+ years software engineering experience with data infrastructure or distributed systems; proficiency in Python and familiarity with Go; experience with big-data/streaming (Spark, Kafka, Flink) and Iceberg; leading projects and mentoring engineers.
Python, Go, Spark, Kafka, Flink, Iceberg, ClickHouse, DuckDB, Google Cloud (GCP), Kubernetes, MySQL, MongoDB, Snowflake
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Postmarket Surveillance Data Scientist
Alameda, California, United States
$90k-$180k/yr OnsiteFull Time
Abbott
AbbottNYSE: ABT: Manufactures medical devices, diagnostics, and nutritional health products.
4+ YOEBachelor's in CS, Data Analytics, Math, Stats, Physics, or Engineering; 4+ years relevant experience; advanced Python, SQL, PowerBI, Databricks; statistics and big-data analytics; mentoring experience.
Python, SQL, PowerBI, Databricks
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Software Engineer, Backend - RQL
Seattle or San Francisco
$168k-$280k/yr OnsiteFull Time
Rippling
Rippling: Unified platform managing workforce HR, IT, and finance operations
6+ YOE6+ years backend engineering experience; experience with distributed systems, distributed processing engines, big data technologies, mentoring developers, and building data platforms.
Python, MongoDB, CDC, Kafka, Aurora, Trino, Presto, Pinot, Iceberg, Flink, Rippling Query Language (RQL), Microsoft 365
Job PostingView all
2mo
Save
Mark Applied
Hide
Software Engineer (L3) Data Substrate
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California or San Francisco or Oakland or San Jose or Washington
$139k-$204k/yr RemoteFull Time
Twilio
TwilioNYSE: TWLO: Cloud communications platform for building customer engagement applications.
5+ YOEBachelor's or Master's in CS/Engineering, 5+ years software development, proficiency in Python/Java/Scala, experience with big data tools (Kafka, Spark, Hive, Hudi, Presto, Airflow) and AWS services, strong problem-solving and communication skills.
Kafka, Spark, Hive, Hudi, Presto, Airflow, AWS Lakeformation, Glue, Athena, Python, Java, Scala
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Software Engineer
San Francisco, California, United States
$179k-$263k/yr RemoteFull Time
6sense
6sense: AI platform for B2B buyer intent and revenue prediction.
BS/MS in Computer Science or equivalent experience; strong Big Data experience (Hadoop, Hive, Spark, Flink, Presto, Kafka, etc.), ETL, schema design, SQL, data ingestion/integration, and use of AI coding assistants.
Hadoop, M/R, Hive, Spark, Flink, Metastore, Presto, Kafka, Claude Code, Windsurf, SQL, Django, AWS
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff SW Engineer
Foster City, California, United States
$135k-$215k/yr HybridFull Time
Visa
VisaNYSE: V: Global payment technology facilitating electronic funds transfers.
5+ YOE5+ years software engineering; Java and Big Data tech; release management, security practices, CI/CD; hybrid/DevOps focus.
Java, Big Data, Microservices, CI/CD, Jenkins, ArgoCD, Git, Linux, Scripting, Python, Ansible, Terraform, YAML, Prometheus, Grafana, Fluent Bit, Humio, Istio, ServiceMesh, Patch management
Job PostingView all
3mo
Save
Mark Applied
Hide
Sr Sales Engineer, West
San Francisco or United States
$160k-$196k/yr RemoteFull Time
Dataiku
Dataiku: Software platform for building and managing enterprise AI applications.
6+ YOE6+ years in technical pre-sales; experience with data science/big data; strong communication; located in MDT/PST time zones for West region.
SQL, NoSQL, Kubernetes, Spark
Job PostingView all
2mo
Save
Mark Applied
Hide
Technical Support Engineer
San Francisco, California, United States
RemoteFull Time
Starburst
Starburst: Provides an open data lakehouse platform for multi-cloud analytics.
5+ YOE5+ years in tech support; 3+ years with Big Data, Docker, Kubernetes and cloud technologies; willing to travel up to ~25%.
Docker, Kubernetes, Hadoop, Data Lakes, Spark, AWS, Azure, GCP, LDAP, OAuth2.0, SSL/TLS, Linux, SQL, Java, Python, Bash
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Manager - BFSI, Field Engineering
Mumbai or Delhi or San Francisco
OnsiteFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
6+ YOE6+ Mgmt6+ years in pre-sales/consulting managerial roles and Big Data architecture; experience with strategic BFSI accounts, scaling and mentoring field engineering teams, and expertise in Apache Spark/Databricks.
Apache Spark, Databricks
Job PostingView all
3d
Save
Mark Applied
Hide
Principal, Solutions Architect
United States or San Francisco or Los Angeles or New York City or Remote
$170k-$206k/yr RemoteFull Time
Scout Motors
Scout Motors: Designs and manufactures all-electric rugged SUVs and trucks.
15+ YOE15+ years cloud platform engineering experience, bachelor’s degree in CS/IT, deep cloud and DevOps expertise, CI/CD and IaC experience, containerization (Docker,Kubernetes), big data familiarity, strong communication and leadership.
AWS, Azure, Nutanix, Terraform, AWS CloudFormation, Azure Resource Manager, CI/CD, Docker, Kubernetes
Job PostingView all
3mo
Save
Mark Applied
Hide
Director of AI Engineering
Dunwoody or Chicago or Sugar Land or New York or Austin or Cleveland or Los Angeles or Raleigh or San Francisco or Tempe or Tustin
$144k-$205k/yr HybridFull Time
ABM Industries
ABM IndustriesNYSE: ABM: Provides integrated facility, engineering, and infrastructure management solutions.
12+ YOE5+ MgmtML/AI leadership with deep learning, NLP, MLOps, cloud data platforms (Azure, AWS, GCP), Python/TensorFlow/PyTorch, OpenAI/GPT models, big data tech, AI governance and compliance; 12+ years in AI/data/ML with 5+ years leading teams; experience deploying AI at scale.
Python, TensorFlow, PyTorch, Hugging Face, Scikit-learn, SQL, Azure, Synapse, ADF, Databricks, Spark, Kubernetes, Kafka, OpenAI GPT, Gemini, LLaMA, Alteryx, GDPR, CCPA
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineering Architect
San Francisco or Bellevue
$263k-$401k/yr HybridFull Time
Salesforce
SalesforceNYSE: CRM: Sells cloud-based customer relationship management and business software solutions.
15+ YOE15+ years software development experience, related technical degree required, extensive cloud and big-data platform experience (AWS/GCP/Azure, Trino/Presto, Iceberg, Airflow, Spark), strong architecture and mentoring skills.
AWS, GCP, Azure, Trino/Presto, Iceberg, Airflow, Spark, Agentforce, Data Cloud
Job PostingView all

Explore Jobs

Expand Your Job Search