HiringCafe
Join our community

78 streaming data engineer jobs at 58 companies in Berkeley, CA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
2mo
Save
Mark Applied
Hide
Senior Software Engineer - Observe by Snowflake, Streaming Data Products
Menlo Park, California, United States
$200k-$288k/yr OnsiteFull Time
Snowflake
SnowflakeNYSE: SNOW: Cloud-based platform for data storage, processing, and analytics.
7+ YOE7+ years in software engineering, with deep expertise in databases/SQL, streaming/data pipelines, API design, and Go or system languages; strong problem solving and product intuition.
Go, SQL, Databases, Streaming, APIs, Data pipelines
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
Houston or Golden or Reno or Oakland or Salt Lake City
HybridFull Time
Fervo Energy
Fervo Energy: Generates clean electricity using advanced geothermal drilling technology.
2+ YOE2+ years building and operating production data pipelines with Apache Spark, Python/SQL, Databricks, Azure, and Snowflake; experience with streaming, data modeling, data quality, governance, and CI/CD.
Databricks, Delta Lake, Delta Live Tables, Unity Catalog, Databricks Workflows, Databricks SQL, Apache Spark, PySpark, Spark SQL, Structured Streaming, Kafka, Microsoft Event Hubs, Microsoft Azure Data Factory, Microsoft Azure Data Lake Storage (ADLS), Snowflake, Microsoft Power BI, Spotfire, Python, SQL, Git, Azure DevOps, GitHub Actions, dbt, Terraform, Docker, Airflow, Microsoft Entra ID, Microsoft Key Vault, MQTT, OPC UA, SparkplugB, Canary, Ignition, Snowflake Semantic Views, Databricks Metric Views
Job PostingView all
1w
Save
Mark Applied
Hide
Sr Data Engineer
Glendale or San Francisco
$139k-$186k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOE5+ years data engineering experience, streaming pipeline expertise, strong Python/Java/SQL skills, experience with embedding/vector stores and workflow orchestration, and ability to design scalable, reliable data systems for AI applications.
Python, Java, SQL, Kafka, Flink, Spark, Kinesis, Pinecone, Weaviate, FAISS, pgvector, Airflow, Dagster, LangChain, LangGraph, Databricks, Datadog, Prometheus, S3, Glue, MWAA
Job PostingView all
1w
Save
Mark Applied
Hide
Sr Data Engineer
Glendale or San Francisco
$139k-$186k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOE5+ years data engineering experience (1+ year senior/lead), strong Python/Java/SQL, streaming pipeline experience (Kafka/Flink/Spark/Kinesis), embedding/vector store experience, workflow orchestration, and data architecture skills.
Python, Java, SQL, Kafka, Flink, Spark, Kinesis, Pinecone, Weaviate, FAISS, pgvector, Airflow, Dagster, Databricks, LangChain, LangGraph, S3, Glue, MWAA, Datadog, Prometheus
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Denver or San Francisco or Nashville or Santiago
$157k-$218k/yr OnsiteFull Time
Checkr
Checkr: AI-powered platform for background checks and identity verification.
5+ YOE5+ years engineering experience building scalable data platforms; proficiency in Python, PySpark, SQL; experience with ETL/ELT, batch and stream processing; familiarity with Kafka, Spark, Iceberg, AWS services.
Python, PySpark, SQL, MongoDB, Kafka, Spark, Iceberg, AWS, EKS, EMR, Glue, Athena, S3, Databricks, Snowflake
Job PostingView all
4w
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or New York City
HybridFull Time
Beast Industries
Beast Industries: Produces digital media and consumer goods for MrBeast brands.
8+ YOE8+ years building production data platforms, expertise in batch and streaming pipelines, data modeling, ETL/ELT, reliability, observability, and privacy-safe foundations for AI/ML.
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco, California, United States
$138k-$221k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment network facilitating electronic transactions and financial services.
Senior-level Big Data engineering experience with Java or Scala, Apache Spark, Hive/Impala, streaming tools (Kafka, NiFi), relational and NoSQL databases, Linux/Shell, strong CS fundamentals, and experience designing high-scale distributed systems.
Java, Scala, Apache Spark, MySQL, PostgreSQL, Hive, Impala, Oozie, Airflow, NiFi, Kafka, Linux/Unix, Shell, Azure, AWS, GCP
Job PostingView all
2w
Save
Mark Applied
Hide
Staff Data Engineer
Berkeley, California, United States
$185k-$223k/yr HybridFull Time
Copper
Copper: Manufacturing battery-integrated induction stoves for simple home electrification.
8+ YOE8+ years building production data infrastructure; fluency in Python, SQL, TypeScript; hands-on AWS data services and IaC; experience with time-series, streaming/ETL, and telemetry for fleet or IoT systems.
Python, SQL, TypeScript, AWS IoT Core, Kinesis Firehose, S3, Athena, Lambda, ElastiCache/Redis, Terraform, AWS CDK
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Science Engineer
San Jose or California or United States
$109k-$201k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
8+ YOESenior data engineer with 8+ years experience, distributed data and cloud technologies (Hadoop, Spark, Databricks, S3, EMR), streaming (Kafka/Kinesis), strong SQL and Python/PySpark/Scala skills, CI/CD and orchestration experience, and strong communication.
Hadoop, Hive, Presto, Spark, Databricks, S3, Azure Blob Storage, Notebooks, AWS EMR, Athena, Glue, Delta, Parquet, ORC, Kafka, Kinesis, SQL, Python, PySpark, Scala, Pandas, NumPy, Koalas, APIs, GitHub, Jenkins, Apache Air Flow, Azkaban, AEP, AJO, CJA, Adobe Experience Platform, Adobe Analytics, Customer Journey Analytics, Adobe Journey Optimizer, Collibra, JIRA, Confluence, Copilot, Claude, LLAMA, Databricks Genie, n8n, RAG, MCPs, GenStudio, Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Paris or San Francisco or Sophia-Antipolis or Hong Kong or Spain
HybridFull Time
Outsight
Outsight: Provides 3D LiDAR software to track people and vehicles.
Own data lifecycle and build production-grade ELT pipelines for high-volume streaming spatial data; architect schemas in Databricks/AWS; design semantic layers (Cube.js) for LLM agents; strong systems thinking and AI-enabled productivity.
Databricks, AWS, Cube.js, LLM
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Data Platform Engineer
United States or San Francisco
$170k-$235k/yr RemoteFull Time
Doma
Doma: Automating residential real estate closings using machine learning technology.
8+ YOE8+ years in data/platform engineering; deep cloud (Azure preferred), IaC (Terraform), CI/CD, SQL, data modeling, streaming, orchestration, Python/Go, and production distributed systems experience.
Microsoft Azure, AWS, GCP, Terraform, GitHub Actions, GitLab CI, ArgoCD, Flux, Airflow, Prefect, Dagster, Kafka, Flink, Airbyte, Snowflake, dbt, PostgreSQL, Python, Go, SQL, YAML, JSON, HCL, Prometheus, Grafana, Datadog, Great Expectations, Soda, Avro, Protobuf, JSON Schema, Microsoft Purview, Microsoft Azure Key Vault, Iceberg, Delta, Hudi, Model Context Protocol (MCP)
Job PostingView all
6d
Save
Mark Applied
Hide
Senior Staff Data Engineer
San Jose or Draper
$166k-$245k/yr HybridFull Time
BILL
BILLNYSE: BILL: Automated financial operations software for small and midsize businesses.
8+ YOELead architecture and delivery of data platform capabilities (ingest, lake, streaming, feature store, query, graph, search). Requires distributed systems, streaming and batch experience, SQL and Python, and technical leadership.
Starburst, Databricks Feature Store, Neo4j, OpenSearch, Kafka, Flink, Spark Streaming, Airflow, dbt, Spark, Glue, Apache Iceberg, Delta Lake, Trino, Presto, Python, SQL
Job PostingView all
3d
Save
Mark Applied
Hide
Principal Engineer - Data Platform
Santa Clara, California, United States
$221k-$387k/yr RemoteFull Time
ServiceNow
ServiceNowNYSE: NOW: Provides a cloud platform for automating enterprise digital workflows.
15+ YOE15+ years software/data engineering experience building and migrating large-scale, cloud-native data platforms; expertise migrating Cloudera/Hadoop to modern lakehouse, Trino, dbt, Iceberg, CDC, streaming, regulated cloud environments, and observability.
Trino, dbt, Apache Iceberg, Argo Workflows, Cloudera, Impala, Hive, HDFS, Hive Metastore, Kafka, PostgreSQL, Spark, Tableau, Lightdash, Splunk, Grafana, Prometheus, CloudWatch, Kubernetes, Terraform, CDK, CloudFormation, GitOps, Debezium, Great Expectations, Snowflake, BigQuery, Rust, Go, C++
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Data Platform Engineer
New York or Los Angeles or San Francisco
$190k-$240k/yr HybridFull Time
Tatari
Tatari: A platform for buying and measuring TV advertising campaigns.
3+ YOE3+ years cloud infrastructure/SRE/platform engineering; strong operational discipline; experience with HA architectures, workflow orchestration, Linux scripting, containers, distributed processing, streaming, IaC, observability, and managed data platforms.
AWS, GCP, Azure, Airflow, Bash, Python, Spark, PySpark, Kubernetes, Docker, Kafka, Flink, Terraform, Helm, ClickHouse, Postgres, Redshift, Datadog, Prometheus, Kibana, Databricks
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Software Engineer - Data Platform
Mountain View or McLean
$218k-$260k/yr OnsiteFull Time
ID.me
ID.me: Provides secure digital identity verification and authentication services.
8+ YOE8+ years in data or distributed systems; 6+ years in Go, Python, or Java; strong data infra, event streaming, and cloud experience.
Go, Python, Java, PostgreSQL, AWS, GCP, Kafka, Google Pub/Sub, Dataflow, Airflow, Temporal, Terraform, Kubernetes, Helm
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer Self Service Analytics and Real Time Data Platforms (Burbank, CA, US, 91505)
Burbank or San Francisco
$99k-$147k/yr OnsiteFull Time
Paramount
ParamountNASDAQ: PSKY: Produces and distributes media content across global entertainment platforms.
2+ YOE2+ years data engineering experience building ETL/ELT and streaming pipelines; expert SQL, Python, Spark; experience with Airflow/Composer, Kafka or Pub/Sub, GCP and BI/semantic layers; BS/MS in CS/Engineering or equivalent.
Airflow, Composer, SQL, Python, Spark, Vertex AI, Databricks ML, Kafka, Pub/Sub, Superset, GCP
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Staff Data Engineer - Platform Data and Analytics
San Francisco or Waterloo or Toronto or London or New York City
$268k-$369k/yr HybridFull Time
Faire
Faire: Online wholesale marketplace connecting independent retailers with unique brands.
Technical leader with strong SQL and Python, experience building and operating ETL/ELT, streaming, orchestration, and petabyte-scale data warehousing; experience with Snowflake, Airflow, Spark; bachelor's degree or equivalent experience.
AWS, Snowflake, Airflow, Spark, Python, Kotlin, SQL
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior/Staff Software Engineer (Data Platform)
New York City or San Francisco
$140k-$210k/yr OnsiteFull Time
Actively AI
Actively AI: AI agents for automated enterprise revenue and sales operations.
5+ YOE5+ years designing and operating core data infrastructure; real-time/streaming pipelines; Python, SQL, DBT; BigQuery or Snowflake; startup-scale experience; able to own end-to-end data pipelines.
Python, SQL, DBT, BigQuery, Snowflake, Pub/Sub, Kafka, Airflow, Fivetran, Dataflow, Polytomic
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff, Software Engineer, Streaming and Messaging
Sunnyvale, California, United States
$143k-$286k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
4+ YOEBachelor's degree or equivalent experience (4+ years) in software engineering; strong experience in streaming/messaging, distributed systems, deployment automation, Rust/C++/Java, CI/CD, testing frameworks, and large-scale data platforms.
Docker, Kubernetes, Helm, Nomad, Rust, C++, Java, Git, Jenkins, GitOps, JUnit, Cucumber, Kafka, MQ, JMS, Cassandra, MySQL, CosmosDB, Spanner, Dynamo
Job PostingView all

Explore Jobs

Expand Your Job Search