HiringCafe
Join our community

19 batch data engineer jobs at 13 companies in Dublin, CA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Denver or San Francisco or Nashville or Santiago
$157k-$218k/yr OnsiteFull Time
Checkr
Checkr: AI-powered platform for background checks and identity verification.
5+ YOE5+ years engineering experience building scalable data platforms; proficiency in Python, PySpark, SQL; experience with ETL/ELT, batch and stream processing; familiarity with Kafka, Spark, Iceberg, AWS services.
Python, PySpark, SQL, MongoDB, Kafka, Spark, Iceberg, AWS, EKS, EMR, Glue, Athena, S3, Databricks, Snowflake
Job PostingView all
4w
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or New York City
HybridFull Time
Beast Industries
Beast Industries: Produces digital media and consumer goods for MrBeast brands.
8+ YOE8+ years building production data platforms, expertise in batch and streaming pipelines, data modeling, ETL/ELT, reliability, observability, and privacy-safe foundations for AI/ML.
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Glendale or San Francisco or Seattle
$139k-$204k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOE5+ years data engineering experience (1+ year senior/lead), building streaming and batch pipelines, strong Python/Java/SQL, experience with Kafka/Flink/Spark/Kinesis, embedding/vector stores and orchestration tools, bachelor's in CS or equivalent.
Python, Java, SQL, Kafka, Flink, Spark, Kinesis, Pinecone, Weaviate, FAISS, pgvector, Airflow, Dagster, LangChain, LangGraph, Datadog, Prometheus, Databricks, S3, Glue, MWAA
Job PostingView all
6d
Save
Mark Applied
Hide
Senior Staff Data Engineer
San Jose or Draper
$166k-$245k/yr HybridFull Time
BILL
BILLNYSE: BILL: Automated financial operations software for small and midsize businesses.
8+ YOELead architecture and delivery of data platform capabilities (ingest, lake, streaming, feature store, query, graph, search). Requires distributed systems, streaming and batch experience, SQL and Python, and technical leadership.
Starburst, Databricks Feature Store, Neo4j, OpenSearch, Kafka, Flink, Spark Streaming, Airflow, dbt, Spark, Glue, Apache Iceberg, Delta Lake, Trino, Presto, Python, SQL
Job PostingView all
3mo
Save
Mark Applied
Hide
Software Engineer - Data Infrastructure
San Francisco, California, United States
$160k-$225k/yr HybridFull Time
Fable Security
Fable Security: AI-driven platform managing human risk and employee security behavior.
3+ YOE3+ years in data infrastructure or platform engineering; strong real-time and batch processing knowledge; Spark, Kafka, dbt, Airflow; cloud (AWS/GCP); startup environment.
Spark, Kafka, dbt, Airflow, AWS, GCP
Job PostingView all
4d
Save
Mark Applied
Hide
Software Engineer - X Data
Palo Alto, California, United States
$125k-$400k/yr OnsiteFull Time
xAI
xAI: Develops advanced artificial intelligence systems to understand the universe.
3+ YOE3+ years software engineering experience; expertise in Python,Rust,Scala,Go or Java; experience with data pipelines, realtime and batch processing, and distributed systems.
Python, Rust, Scala, Go, Java, BigQuery, Trino, Clickhouse, Flink, Kafka, Spark, Scalding, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineering Manager, Data & ML Platform
San Francisco or Montreal or Bengaluru
$220k-$330k/yr HybridFull Time
Hinge Health
Hinge HealthNYSE: HNGE: Digital provider of musculoskeletal care and physical therapy
5+ YOE2+ Mgmt5+ years data engineering; 2+ years managing engineering teams; 2+ years building ML platform capabilities; experience with batch & streaming systems and tools such as Kafka, Flink, Spark; proficiency with Python, SQL, dbt, Databricks, and AWS.
Kafka, Flink, Spark, Python, SQL, dbt, Databricks, AWS, Delta Lake, MLflow, Unity Catalog
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Manager, Content Promotion & Distribution Data Engineering
Los Angeles or Los Gatos
$525k-$950k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
7+ Mgmt7+ years leading data engineering teams; expertise in data modeling, batch/streaming pipelines, data quality, and multi-modal media pipelines for ML/GenAI; strong stakeholder communication and people management.
S3, Spark
Job PostingView all
1mo
Save
Mark Applied
Hide
Group Director, Data Architecture/ Engineering
Sunnyvale or Bentonville
$254k-$481k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
15+ YOE4+ Mgmt15+ years building data integration and platform solutions; experience with RDBMS and NoSQL, Hadoop/Spark, data modeling, real-time and batch pipelines; leadership of distributed platform teams; strong solution architecture and DevOps knowledge.
Oracle, My SQL, Cassandra, HBase, Hadoop, Spark, DevOps, Web Content Accessibility Guidelines (WCAG) 2.2 AA
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead AI Engineer, Data Solutions
San Francisco, California, United States
$173k-$260k/yr HybridFull Time
Salesforce
SalesforceNYSE: CRM: Sells cloud-based customer relationship management and business software solutions.
6+ YOE6+ years in AI/ML engineering or applied data science; strong Python in production; ML model development and deployment; data pipelines (ETL/ELT, batch or streaming); APIs and backend systems; experience with LLM-powered systems and agent workflows; familiarity with Spark, Airflow/Dagster, Snowflake/BigQuery.
Python, Spark, Airflow, Dagster, Snowflake, BigQuery
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer, Platform
San Francisco, California, United States
$200k-$250k/yr OnsiteFull Time
Duckbill
Duckbill: SaaS platform for enterprise cloud financial planning and analysis.
Proven experience building data systems and ETL for batch and streaming; strong Python and SQL; experience with data warehouses/lakehouses/OLAP, columnar databases, cloud storage, and data quality practices.
Python, ClickHouse, Airflow, Parquet, S3, Flask, React, OpenTelemetry (OTel), HTTP APIs, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Member of Technical Staff (Software Engineer, Data Platform)
San Francisco or New York City or Palo Alto
$220k-$405k/yr OnsiteFull Time
Perplexity
Perplexity: AI-powered search engine providing conversational answers with citations.
5+ YOE5+ years software engineering experience (8+ for staff), production data infrastructure and batch/streaming experience, Airflow/Dagster, Python plus another backend language (Go/TypeScript), ML/AI workflow support, data quality and observability knowledge.
Databricks, Snowflake, Spark, Kafka, Flink, Airflow, Dagster, dbt, Iceberg, Delta Lake, ClickHouse, Kinesis, PubSub, Python, Go, TypeScript
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Glendale or San Francisco or New York
$142k-$199k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOEExperience building and operating large-scale data/ML systems, strong distributed systems fundamentals, streaming/batch technologies (Kafka, Kinesis, Spark, Flink), Python, plus working knowledge of Java/Scala/Go/C++, cloud-native (AWS, containers, Kubernetes, IaC), observability, and collaboration skills; Bachelor's or Master's required.
Kafka, Kinesis, Spark, Flink, Python, Java, Scala, Go, C++, AWS, Kubernetes, containers, IaC tools
Job PostingView all
3mo
Save
Mark Applied
Hide
Software Engineer - Platform/Infrastructure
San Francisco, California, United States
$160k-$225k/yr HybridFull Time
Fable Security
Fable Security: AI-driven platform managing human risk and employee security behavior.
3+ YOE3–7+ years backend/infrastructure experience; distributed systems; real-time/batch data processing; cloud (AWS/GCP); scalable, reliable systems; cross-functional collaboration.
Kafka, Spark, AWS, GCP, Airflow
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer 5 - Ads Identity Graph
New York City or Seattle or Los Angeles or Los Gatos
$388k-$558k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
Experience designing and operating large-scale identity graphs and identity resolution (deterministic & probabilistic) in batch and near-real-time; familiarity with ad tech, data governance/privacy, and big data tools such as Spark.
Spark, Privacy Enhancing Technologies (PETs)
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer 5 - Ads Audience Activation
New York or Los Angeles or Los Gatos or Seattle
$388k-$619k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Global video streaming and media production service.
Experience in designing scalable batch and streaming data onboarding systems; proficiency in Java, Python, C++, or similar; familiarity with Kafka, Flink; big data tools like Spark; distributed cloud applications; knowledge of ad tech and privacy considerations.
Kafka, Flink, Spark, Java, Python, C++
Job PostingView all
1w
Save
Mark Applied
Hide
Software Engineer SMTS/ MTS
Bellevue or San Francisco
$117k-$224k/yr HybridFull Time
Salesforce
SalesforceNYSE: CRM: Sells cloud-based customer relationship management and business software solutions.
10+ YOE10+ years software development experience building large-scale data platforms using Apache Spark, AWS S3, streaming/batch pipelines; strong distributed systems, API, and architecture expertise; MSc/BS or equivalent; Scrum/Kanban experience.
Apache Spark, AWS S3, OpenAPI
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Cloud Engineer AI
Chicago or San Francisco
$81k-$152k/yr OnsiteFull Time
BMO
BMOTSX: BMO: Provides personal and commercial banking, investment, and wealth services.
5+ YOE5-7 years experience; ETL/ELT, SQL/NoSQL, Python, Spark, Scala; AWS/Azure, SSIS/Glue, Hadoop, Netezza; data types (batch/streaming); Agile/JIRA; GenAI/RAG concepts.
SQL, NoSQL, Python, Spark, Scala, SSIS, Glue, AWS, Azure, Hadoop, Netezza, ETL/ELT
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer 5 - Ads Audience Activation
New York or Seattle or Los Angeles or Los Gatos
$388k-$619k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
Design and build scalable batch and streaming advertiser audience ingestion and activation systems; experience with Kafka/Flink, big data tools (Spark), cloud-distributed systems; proficiency in Java, Python, or C++; strong communication and ad tech knowledge.
Kafka, Flink, Java, Python, C++, Spark
Job PostingView all

Explore Jobs

Expand Your Job Search