HiringCafe
Join our community

29 big data engineer jobs at 20 companies in Novato, CA

1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
Job PostingView all
6d
Save
Mark Applied
Hide
Staff Data Engineer
San Francisco, California, United States
$237k-$270k/yr HybridFull Time
Front
Front: Customer operations platform for collaborative team communication.
5+ YOE5+ years data engineering/ETL experience, Snowflake, advanced SQL and Python, experience with big data technologies and workflow tools, BS/BA or equivalent, strong stakeholder collaboration and AI fluency.
Snowflake, Python, SQL, HDFS, EMR, Redshift, Spark, Flink, Presto, Airflow
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal Data Engineer
San Francisco, California, United States
$207k-$276k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
15+ YOE15+ years in software, FinTech, leading cross-functional teams; expert in data engineering, SDLC, cloud, and architectures; hands-on with Java, microservices, big data, and CI/CD.
Java, Spring, Microservices, Kafka, Oracle, SQL, JavaScript, Python, Hadoop/S3, Spark, TensorFlow, PyTorch, CI/CD, Git, Jenkins, Terraform, AWS, GCP, Azure, Jira, Confluence
Job PostingView all
2mo
Save
Mark Applied
Hide
Software Engineer II, Big Data, tvScientific
San Francisco, California, United States
$124k-$255k/yr RemoteFull Time
Pinterest
PinterestNYSE: PINS: Visual discovery engine for finding inspiration and creative ideas.
Production data engineering with Spark and Scala; AWS; data pipelines; APIs; data lakes; SQL; Bachelor's in CS; AI-assisted workflows experience.
Apache Spark, Scala, AWS, SQL, Apache Iceberg, Delta Lake, APIs
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica or Seattle or San Francisco
$142k-$190k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOEBachelor's or equivalent experience, 5+ years big data engineering, strong Python/Scala/SQL, Spark/Presto/Hive, Databricks and cloud MPP databases, Airflow, AWS S3, CI/CD, on-call and production operations experience.
Databricks, Spark, Presto, Hive, Python, Scala, SQL, Snowflake, Redshift, BigQuery, Airflow, CI/CD, AWS S3, Terraform
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco, California, United States
$138k-$221k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment network facilitating electronic transactions and financial services.
Senior-level Big Data engineering experience with Java or Scala, Apache Spark, Hive/Impala, streaming tools (Kafka, NiFi), relational and NoSQL databases, Linux/Shell, strong CS fundamentals, and experience designing high-scale distributed systems.
Java, Scala, Apache Spark, MySQL, PostgreSQL, Hive, Impala, Oozie, Airflow, NiFi, Kafka, Linux/Unix, Shell, Azure, AWS, GCP
Job PostingView all
3mo
Save
Mark Applied
Hide
Staff Data Engineer, Data Platform
San Francisco, California, United States
$182k-$228k/yr HybridFull Time
Turo
Turo: Marketplace for renting cars directly from local owners.
7+ YOEStrong data platform engineering, ETL, Airflow, cloud platforms (AWS, GCP, Azure), Spark or big data, 7+ years.
Airflow, Prefect, Dagster, AWS, GCP, Azure, Terraform, Kubernetes, Spark
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Data Engineer
Foster City, California, United States
$146k-$234k/yr HybridAll Commitments Available
Visa
VisaNYSE: V: Global payment technology facilitating electronic funds transfers.
5+ YOE5+ years data engineering with a Bachelor's or 2+ years with an advanced degree; or 0 years with a PhD. Strong big data, Spark, Hadoop, Python, SQL; Java, REST APIs, and container tech; ML/AI model experience.
Hadoop, Spark, Python, SQL, Java, REST APIs, Docker, Kubernetes, Kafka, Redis, Flink, TensorFlow, Triton, AWS, Unix/Shell, Airflow, Control-M, React, Redux, HTML5, CSS, JavaScript
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer, Sentinel (Pacific Time Zone)
United States or San Francisco
$153k-$190k/yr RemoteFull Time
Komodo Health
Komodo Health: Provides AI-driven healthcare data and patient journey analytics software.
Proficiency in Python with backend API/microservices experience; strong AWS knowledge; IaC (Terraform/Scalr); CI/CD with GitHub Actions; networking basics; big-data tools (Snowflake, Databricks, Airflow, Temporal); AI tools (Gemini, ChatGPT, Cursor); collaborative, proactive team player.
Python, AWS, Terraform, Scalr, GitHub Actions, Snowflake, Databricks, Airflow, Temporal, Gemini, ChatGPT, Cursor
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Postmarket Surveillance Data Scientist
Alameda, California, United States
$90k-$180k/yr OnsiteFull Time
Abbott
AbbottNYSE: ABT: Manufactures medical devices, diagnostics, and nutritional health products.
4+ YOEBachelor's in CS, Data Analytics, Math, Stats, Physics, or Engineering; 4+ years relevant experience; advanced Python, SQL, PowerBI, Databricks; statistics and big-data analytics; mentoring experience.
Python, SQL, PowerBI, Databricks
Job PostingView all
1w
Save
Mark Applied
Hide
Software Engineer III - Cloud Data Platform
San Mateo, California, United States
$124k-$210k/yr HybridFull Time
Guidewire
GuidewireNYSE: GWRE: Provides a software platform for property and casualty insurers.
5+ YOE5+ years data-platform engineering experience; deep Java/Scala and distributed-systems expertise; experience with Kubernetes, AWS, Docker, Terraform/CloudFormation and modern big-data stack.
Kafka, Hadoop, Spark, Flink, Hive, Java, Scala, Kubernetes, AWS, Docker, Terraform, CloudFormation, ELK, Debezium, TeamCity
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Software Engineer, Backend - RQL
Seattle or San Francisco
$168k-$280k/yr OnsiteFull Time
Rippling
Rippling: Unified platform managing workforce HR, IT, and finance operations
6+ YOE6+ years backend engineering experience; experience with distributed systems, distributed processing engines, big data technologies, mentoring developers, and building data platforms.
Python, MongoDB, CDC, Kafka, Aurora, Trino, Presto, Pinot, Iceberg, Flink, Rippling Query Language (RQL), Microsoft 365
Job PostingView all
2mo
Save
Mark Applied
Hide
Software Engineer (L3) Data Substrate
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California or San Francisco or Oakland or San Jose or Washington
$139k-$204k/yr RemoteFull Time
Twilio
TwilioNYSE: TWLO: Cloud communications platform for building customer engagement applications.
5+ YOEBachelor's or Master's in CS/Engineering, 5+ years software development, proficiency in Python/Java/Scala, experience with big data tools (Kafka, Spark, Hive, Hudi, Presto, Airflow) and AWS services, strong problem-solving and communication skills.
Kafka, Spark, Hive, Hudi, Presto, Airflow, AWS Lakeformation, Glue, Athena, Python, Java, Scala
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Software Engineer
San Francisco, California, United States
$179k-$263k/yr RemoteFull Time
6sense
6sense: AI platform for B2B buyer intent and revenue prediction.
BS/MS in Computer Science or equivalent experience; strong Big Data experience (Hadoop, Hive, Spark, Flink, Presto, Kafka, etc.), ETL, schema design, SQL, data ingestion/integration, and use of AI coding assistants.
Hadoop, M/R, Hive, Spark, Flink, Metastore, Presto, Kafka, Claude Code, Windsurf, SQL, Django, AWS
Job PostingView all
22h
Save
Mark Applied
Hide
Staff Security Detection Engineer, Machine Learning
Seattle or San Francisco
$144k-$248k/yr OnsiteFull Time
SoFi
SoFiNasdaq: SOFI: Mobile-first platform for banking, lending, and investment services.
7+ YOE7+ years building and operating ML detection/anomaly models in production, strong Python and SQL skills, experience with data lake big-data tech and security telemetry, bachelor’s degree or equivalent.
Snowflake, Databricks, Spark, Delta, Iceberg, S3, GCS, Python, SQL, pandas, scikit-learn, PyTorch, TensorFlow, Kafka, Kinesis, Pub/Sub, Flink, SageMaker, Glue, Athena, Lambda
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Development Engineer – Big Data, AWS Elastic MapReduce (EMR), EMR EKS
East Palo Alto, California, United States
$165k-$224k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOE3+ years professional software development, 2+ years design/architecture experience, programming experience, full SDLC experience preferred, Bachelor\u0002s in CS preferred.
Hadoop, Hive, Pig, Impala, Spark, Presto, HBase, Amazon Simple Storage Service (S3), Amazon Elastic Compute Cloud (EC2), Elastic MapReduce (EMR), EMR EKS
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Manager - BFSI, Field Engineering
Mumbai or Delhi or San Francisco
OnsiteFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
6+ YOE6+ Mgmt6+ years in pre-sales/consulting managerial roles and Big Data architecture; experience with strategic BFSI accounts, scaling and mentoring field engineering teams, and expertise in Apache Spark/Databricks.
Apache Spark, Databricks
Job PostingView all
1w
Save
Mark Applied
Hide
Principal, Solutions Architect
United States or San Francisco or Los Angeles or New York City or Remote
$170k-$206k/yr RemoteFull Time
Scout Motors
Scout Motors: Designs and manufactures all-electric rugged SUVs and trucks.
15+ YOE15+ years cloud platform engineering experience, bachelor’s degree in CS/IT, deep cloud and DevOps expertise, CI/CD and IaC experience, containerization (Docker,Kubernetes), big data familiarity, strong communication and leadership.
AWS, Azure, Nutanix, Terraform, AWS CloudFormation, Azure Resource Manager, CI/CD, Docker, Kubernetes
Job PostingView all
3mo
Save
Mark Applied
Hide
Director of AI Engineering
Dunwoody or Chicago or Sugar Land or New York or Austin or Cleveland or Los Angeles or Raleigh or San Francisco or Tempe or Tustin
$144k-$205k/yr HybridFull Time
ABM Industries
ABM IndustriesNYSE: ABM: Provides integrated facility, engineering, and infrastructure management solutions.
12+ YOE5+ MgmtML/AI leadership with deep learning, NLP, MLOps, cloud data platforms (Azure, AWS, GCP), Python/TensorFlow/PyTorch, OpenAI/GPT models, big data tech, AI governance and compliance; 12+ years in AI/data/ML with 5+ years leading teams; experience deploying AI at scale.
Python, TensorFlow, PyTorch, Hugging Face, Scikit-learn, SQL, Azure, Synapse, ADF, Databricks, Spark, Kubernetes, Kafka, OpenAI GPT, Gemini, LLaMA, Alteryx, GDPR, CCPA
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineering Architect
San Francisco or Bellevue
$263k-$401k/yr HybridFull Time
Salesforce
SalesforceNYSE: CRM: Sells cloud-based customer relationship management and business software solutions.
15+ YOE15+ years software development experience, related technical degree required, extensive cloud and big-data platform experience (AWS/GCP/Azure, Trino/Presto, Iceberg, Airflow, Spark), strong architecture and mentoring skills.
AWS, GCP, Azure, Trino/Presto, Iceberg, Airflow, Spark, Agentforce, Data Cloud
Job PostingView all

Explore Jobs

Expand Your Job Search