HiringCafe
Join our community

258 spark data engineer jobs at 140 companies in Vallejo, CA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
1mo
Save
Mark Applied
Hide
Data Engineer
New York City or San Francisco
OnsiteFull Time
Bedrock Robotics
Bedrock Robotics: Automates heavy construction machinery with AI retrofit kits.
5+ YOE5+ years data engineering experience in large-scale data lake/warehouse environments; strong SQL and distributed query engine experience; pipeline orchestration (Airflow/Prefect) and Spark/Databricks experience; data quality and observability expertise.
SQL, Spark, BigQuery, Snowflake, Airflow, Prefect, Databricks
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
United States or San Francisco
$100k-$167k/yr OnsiteFull Time
Stitch Fix
Stitch FixNASDAQ: SFIX: Provides personalized apparel styling services through algorithms and stylists.
2+ YOEBachelor's in engineering or computer science, 2+ years data engineering experience, familiarity with Spark, dbt, Fivetran, Airflow, S3; production Python and SQL; experience with AI coding agents; strong communication.
Spark, dbt, Fivetran, Airflow, S3, Claude Code, Codex, Python, SQL
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yr RemoteFull Time
Samsara
SamsaraNYSE: IOT: Connected Operations Cloud platform for physical operations and IoT.
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
Spark, PySpark, Databricks, Python, SQL, Snowflake, Google BigQuery, Apache Iceberg, Fivetran, dbt, NetSuite, Salesforce, MySQL, AWS RDS/Aurora, PostgreSQL, Oracle, Microsoft SQL Server, AWS, Azure, GCP, Splunk, Datadog, AWS CloudWatch, API Gateway, Lambda, S3, SNS, SQS, SecretsManager, MCP (Model Context Protocol)
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer III
San Ramon, California, United States
$104k-$153k/yr RemoteFull Time
Robert Half
Robert HalfNYSE: RHI: Provides specialized staffing and global business consulting services.
5+ YOE5+ years Python/SQL data engineering; 3+ years cloud AWS; ETL/ELT pipelines; Docker/Kubernetes; Terraform/CloudFormation; Spark; CI/CD; collaboration with data science and MLOps; mentoring.
Python, SQL, Spark, Databricks, Delta Lake, Unity Catalog, MLflow, AWS, Docker, Kubernetes, Terraform, CloudFormation
Job PostingView all
3mo
Save
Mark Applied
Hide
Lead Data Engineer
Fremont, California, United States
$141k-$307k/yr HybridFull Time
Lam Research
Lam ResearchNASDAQ: LRCX: Designs and manufactures wafer fabrication equipment for the semiconductor industry.
8+ YOEBachelor's degree in CS/CE/Information Systems, 8+ years in data engineering/architecture, strong Microsoft Azure experience, proficiency in Python, SQL, Spark, experience building production-grade data pipelines and modern data architectures for AI/ML.
Microsoft Azure, Microsoft Fabric, Python, SQL, Spark, Azure Databricks, Azure Data Factory, Synapse, Neo4j, Azure AI Search, CI/CD
Job PostingView all
2w
Save
Mark Applied
Hide
Sr Data Engineer
Glendale or San Francisco
$139k-$186k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOE5+ years data engineering experience (1+ year senior/lead), strong Python/Java/SQL, streaming pipeline experience (Kafka/Flink/Spark/Kinesis), embedding/vector store experience, workflow orchestration, and data architecture skills.
Python, Java, SQL, Kafka, Flink, Spark, Kinesis, Pinecone, Weaviate, FAISS, pgvector, Airflow, Dagster, Databricks, LangChain, LangGraph, S3, Glue, MWAA, Datadog, Prometheus
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
San Francisco or Denver
$170k-$220k/yr HybridFull Time
Windfall
Windfall: Provides consumer financial data and AI-driven go-to-market insights.
4+ YOE4-8 years in data engineering; experience with Apache Beam/Spark/Flink or MapReduce; JVM language proficiency; distributed data processing; experience at a small company; strong communication and ownership.
GCP, Java, Python, Kotlin, BigQuery, PostgreSQL, Scylla/Cassandra, Apache Beam, Apache Spark, Dataflow, Airflow
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Denver or San Francisco or Nashville or Santiago
$157k-$218k/yr OnsiteFull Time
Checkr
Checkr: AI-powered platform for background checks and identity verification.
5+ YOE5+ years engineering experience building scalable data platforms; proficiency in Python, PySpark, SQL; experience with ETL/ELT, batch and stream processing; familiarity with Kafka, Spark, Iceberg, AWS services.
Python, PySpark, SQL, MongoDB, Kafka, Spark, Iceberg, AWS, EKS, EMR, Glue, Athena, S3, Databricks, Snowflake
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica or Seattle or San Francisco
$142k-$190k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOEBachelor's or equivalent experience, 5+ years big data engineering, strong Python/Scala/SQL, Spark/Presto/Hive, Databricks and cloud MPP databases, Airflow, AWS S3, CI/CD, on-call and production operations experience.
Databricks, Spark, Presto, Hive, Python, Scala, SQL, Snowflake, Redshift, BigQuery, Airflow, CI/CD, AWS S3, Terraform
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer, People Innovation Labs
San Francisco, California, United States
$293k-$325k/yr HybridFull Time
OpenAI
OpenAI: Develops artificial intelligence models and generative AI software services.
3+ YOE3+ years data engineering; 8+ years software engineering; Python/Scala/Java; Databricks, Snowflake; ETL schedulers; Spark/Hadoop/Flink; S3/HDFS; strong data pipelines and collaboration.
Python, Scala, Java, Databricks, Snowflake, Fivetran, Airflow, Dagster, Prefect, Spark, Hadoop, Flink, HDFS, S3
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
San Francisco, California, United States
OnsiteFull Time
Sapiom
Sapiom: Financial infrastructure for autonomous AI agents.
5+ YOE5+ years building production data pipelines; hands-on SQL, Python, Spark, AWS Glue, EMR, DBT, Airflow; 3+ years with MPP databases (Snowflake/Redshift/Teradata); on-call experience and strong cross-team communication.
SQL, Python, Spark, AWS Glue, EMR, DBT, Airflow, Snowflake, AWS Redshift, Teradata
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Platform Engineer
Bengaluru or Novato
OnsiteFull Time
2K
2KNASDAQ: TTWO: Publishes and develops global video game franchises and entertainment.
6+ YOEBachelor's/Master's in CS or engineering, 6+ years in data platform/distributed systems, mastery of SQL and Python, Spark, Snowflake/Databricks, AWS services, Airflow, and data modeling expertise.
Snowflake, Databricks, Kafka, Kinesis, Spark, PySpark, AWS S3, AWS EKS, AWS IAM, AWS SNS, AWS SQS, Apache Iceberg, SQL, Python, Apache Airflow, Terraform, Monte Carlo, DataHub, Soda, Docker, Kubernetes, Pinecone, Weaviate, Milvus, Model Context Protocol (MCP)
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer - Data Lead
San Francisco, California, United States
$150k-$250k/yr OnsiteFull Time
Foundry Robotics
Foundry Robotics: An AI-native robotics manufacturer focused on deploying advanced assembly and production capability for robotics companies and national-security-critical hardware.
5+ YOE5-7 years data engineering experience; TB–PB-scale pipelines; Spark/Flink/Kafka/Airflow/dbt; Python/SQL; Go/Java/TypeScript a plus; cloud data services; architecture and governance; independent, end-to-end ownership.
Spark, Flink, Kafka, Airflow, dbt, Python, SQL, Go, Java, TypeScript, AWS, GCP, Azure, Kubernetes
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Foster City, California, United States
$123k-$191k/yr HybridFull Time
Visa
VisaNYSE: V: Global payment technology facilitating electronic funds transfers.
2+ YOE2+ years experience with a Bachelor's (or Advanced) degree; strong programming in Java/Python/Go/Scala; experience building scalable data pipelines, Spark/Kafka/Hadoop ecosystem, cloud platforms, GenAI and data modeling.
Java, Python, Go, Scala, Gen AI, GenAI, Apache Spark, Spark, Kafka, Hadoop, Hive, Trino, Presto, Apache Airflow, Hbase, AWS, Azure, DataBricks, HDFS, S3, LLMs, NLP, RAG, Vector DBs, MCP, A2A, J2EE, Microservices, REST APIs, CI/CD, Jira, Jira Align
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Mateo or New York City
$140k-$160k/yr HybridFull Time
Chartmetric
Chartmetric: Provides a global music data analytics platform for professionals.
6+ YOE6+ years building production data systems; expert in Python, PostgreSQL, Airflow, Clickhouse, Snowflake, Elasticsearch, Spark, and AWS; Bachelor's in CS/Data Engineering or equivalent experience.
Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, AWS, AWS RDS
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or United States
$190k-$220k/yr HybridFull Time
Arbital Health
Arbital Health: Provides infrastructure for adjudicating healthcare value-based care contracts.
5+ YOE5+ years building data-intensive SaaS platforms, deep Spark and distributed processing expertise, strong SQL and data modeling, experience with Airflow, Terraform, Databricks, dbt/Great Expectations, healthcare data and HIPAA, Python proficiency.
Python, Spark, SQL, R, Databricks, AWS, Airflow, Terraform, dbt, Great Expectations, Cursor, Claude, Copilot, Gemini, Databricks Genie, Next.js, React, TypeScript, Tailwind CSS, GitHub, Jira, Confluence, Kafka, Structured Streaming, CI/CD
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
Houston or Golden or Reno or Oakland or Salt Lake City
HybridFull Time
Fervo Energy
Fervo Energy: Generates clean electricity using advanced geothermal drilling technology.
2+ YOE2+ years building and operating production data pipelines with Apache Spark, Python/SQL, Databricks, Azure, and Snowflake; experience with streaming, data modeling, data quality, governance, and CI/CD.
Databricks, Delta Lake, Delta Live Tables, Unity Catalog, Databricks Workflows, Databricks SQL, Apache Spark, PySpark, Spark SQL, Structured Streaming, Kafka, Microsoft Event Hubs, Microsoft Azure Data Factory, Microsoft Azure Data Lake Storage (ADLS), Snowflake, Microsoft Power BI, Spotfire, Python, SQL, Git, Azure DevOps, GitHub Actions, dbt, Terraform, Docker, Airflow, Microsoft Entra ID, Microsoft Key Vault, MQTT, OPC UA, SparkplugB, Canary, Ignition, Snowflake Semantic Views, Databricks Metric Views
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Software Engineer, Data Engineering
San Francisco, California, United States
$164k-$227k/yr OnsiteFull Time
Chime
ChimeNasdaq: CHYM: Provides mobile banking and financial tools for everyday consumers.
5+ YOE5+ years data engineering; strong SQL, Spark, AWS Glue/EMR, Airflow, Python; 3+ years with Snowflake/Redshift/Teradata; collaborate with Analytics/DS/DevOps; on-call rotation.
SQL, Spark, AWS Glue, EMR, Airflow, Python, Snowflake, Redshift, Teradata
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
Woodland or Burlington
$110k-$125k/yr OnsiteFull Time
Sakata Seed America
Sakata Seed AmericaTokyo Stock Exchange: 1377: Breeding and distributing high-quality vegetable and flower seeds.
5+ YOEDesign and maintain scalable ETL/ELT pipelines, data models, and Microsoft Fabric solutions; strong SQL and Python skills; 5+ years data engineering experience; knowledge of data governance and monitoring.
Microsoft Fabric, Data Factory, Lakehouse, Warehouse, Dataflow Gen2, notebooks, semantic models, SQL Server, PostgreSQL, MySQL, SQL, Python, REST APIs, Spark
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer, Data Foundations
San Francisco or New York City or Chicago
$153k-$180k/yr HybridFull Time
Komodo Health
Komodo Health: Provides AI-driven healthcare data and patient journey analytics software.
Design, implement and scale data pipelines and foundational data systems; experience with Spark, Python, Rust, SQL; leadership experience; healthcare data knowledge beneficial.
Apache Spark, Python, Rust, SQL, Cloud computing, CI/CD
Job PostingView all

Explore Jobs

Expand Your Job Search