HiringCafe
Join our community

153 big data jobs at 60 companies in San Francisco, CA

2mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
Job PostingView all
3d
Save
Mark Applied
Hide
Big Data Engineer Graduate (TikTok Recommendation Architecture) - 2027 Start
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$128k-$317k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
Bachelor's degree in computer science or related field; knowledge of big data frameworks and Java or C++; strong coding and troubleshooting ability; enthusiasm for learning.
Hadoop, Hive, Flink, FlinkSQL, Apache Spark, Apache Kafka, HBase, Redis, RocksDB, Elasticsearch, Java, C++
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Scientist
Dublin or Mountain View
OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment processing and financial technology service provider.
Expertise with large data sets, statistical and ML techniques, Python and related libraries, big data tools, version control, and ability to translate analyses into business insights.
Python, Pandas, scikit-learn, PySpark, Hadoop, Impala, Spark, Git, Tableau, Domo, Power BI
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Jose, California, United States
$149k-$361k/yr HybridFull Time
Roku
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
8+ YOE8+ years data engineering experience, strong SQL, Python preferred, expertise with big-data tech (Hadoop, Spark, Kafka, Hive, Airflow), data modeling, and cloud platforms (AWS/GCP).
SQL, Python, Hadoop, HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, Presto, Trino, AWS, GCP, Looker, Claude Code, Cursor, MCP servers
Job PostingView all
3w
Save
Mark Applied
Hide
GCP Data Engineer
San Jose, California, United States
RemoteFull Time
Tredence
Tredence: Providing AI-driven data science and business analytics solutions.
4+ YOERequires 4+ years in data engineering, big data, or cloud data platforms; Scala, Apache Spark, GCP, SQL, ETL/ELT, Git, CI/CD, and DevOps expertise; bachelor's or master's degree preferred.
Scala, Apache Spark, Spark SQL, Spark Streaming, DataFrames, Datasets, Google Cloud Platform (GCP), BigQuery, Cloud Storage, Dataproc, Dataflow, Pub/Sub, Composer (Airflow), Cloud Functions, Cloud Run, SQL, Git, Kafka, Python, Docker, Kubernetes, GKE, Terraform, AWS, Azure
Job PostingView all
3w
Save
Mark Applied
Hide
Staff Data Engineer
San Francisco, California, United States
$237k-$270k/yr HybridFull Time
Front
Front: Customer operations platform for collaborative team communication.
5+ YOE5+ years data engineering/ETL experience, Snowflake, advanced SQL and Python, experience with big data technologies and workflow tools, BS/BA or equivalent, strong stakeholder collaboration and AI fluency.
Snowflake, Python, SQL, HDFS, EMR, Redshift, Spark, Flink, Presto, Airflow
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Scientist, Marketing
San Jose, California, United States
$267k-$339k/yr HybridFull Time
Zoom
ZoomNasdaq: ZM: Provides a cloud-based platform for video, voice, and collaboration.
5+ YOEMaster's in data-related field, 5+ years data science experience in marketing/ecommerce, expertise with causal inference, experimentation, segmentation, ML model operationalization, SQL and Python, and big data frameworks.
SQL, Python, Hadoop, Spark, Flink, BrightHire
Job PostingView all
2w
Save
Mark Applied
Hide
Staff Data Engineer - Dev360
Mountain View or San Diego
$189k-$274k/yr OnsiteFull Time
Intuit
IntuitNASDAQ: INTU: Provides financial software for accounting, tax, and personal finance.
8+ YOE8+ years in product or web analytics domains; advanced SQL and big-data tech, BI tools, Python/Java/Scala, experience architecting data platforms and pipelines, strong communication and business acumen.
SQL, Redshift, Spark, Hive, BigQuery, Tableau, Qlik, Dash, Python, Java, Scala
Job PostingView all
1mo
Save
Mark Applied
Hide
(USA) Staff, Data Scientist
Sunnyvale, California, United States
$143k-$286k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
5+ YOESenior data scientist with expertise in ML (deep learning, RL, NLP), distributed computing (Spark/Hadoop), Python, big-data platforms, SQL, cloud (GCP/Azure), model deployment in high-scale production, and strong leadership.
Spark, Python, Java, C, C++, Hadoop, Hive, Pig, MapReduce, Scala, Git, SQL, GCP, Azure, scikit-learn, TensorFlow, PyTorch, R
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica or Seattle or San Francisco
$142k-$190k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOEBachelor's or equivalent experience, 5+ years big data engineering, strong Python/Scala/SQL, Spark/Presto/Hive, Databricks and cloud MPP databases, Airflow, AWS S3, CI/CD, on-call and production operations experience.
Databricks, Spark, Presto, Hive, Python, Scala, SQL, Snowflake, Redshift, BigQuery, Airflow, CI/CD, AWS S3, Terraform
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco, California, United States
$138k-$221k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment network facilitating electronic transactions and financial services.
Senior-level Big Data engineering experience with Java or Scala, Apache Spark, Hive/Impala, streaming tools (Kafka, NiFi), relational and NoSQL databases, Linux/Shell, strong CS fundamentals, and experience designing high-scale distributed systems.
Java, Scala, Apache Spark, MySQL, PostgreSQL, Hive, Impala, Oozie, Airflow, NiFi, Kafka, Linux/Unix, Shell, Azure, AWS, GCP
Job PostingView all
2mo
Save
Mark Applied
Hide
(USA) Staff, Data Scientist
Bentonville or Bellevue or San Francisco or New York or New Jersey
$110k-$220k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Operates a chain of hypermarkets, discount stores, and grocery stores.
4+ YOERequires a bachelor's degree and 4 years, master's degree and 2 years, or 6 years of analytics experience; strong Python, big data, machine learning, Hadoop, Git, SQL, and database expertise.
Python, Hadoop, Hive, Pig, MapReduce, Scala, Spark, Git, SQL, relational databases, data warehouse, Kafka, SRE, scikit-learn, TensorFlow, Torch, R, WCAG 2.2 AA
Job PostingView all
2w
Save
Mark Applied
Hide
Staff Software Engineer, Big Data Storage
Palo Alto, California, United States
$177k-$365k/yr HybridFull Time
Pinterest
PinterestNYSE: PINS: Visual discovery engine for finding and saving ideas.
8+ YOE8+ years designing large-scale distributed systems; expertise in storage, metadata, data lakes, ML/AI workloads, and big data technologies. Requires Java, Scala, or Python proficiency and a relevant bachelor's degree or equivalent experience.
Apache Iceberg, Apache Spark, Apache Flink, Presto, Trino, Apache Hive, Java, Scala, Python
Job PostingView all
2mo
Save
Mark Applied
Hide
Advanced Data Science Associate
Bellevue or Chicago or Princeton or South San Francisco or New York or Philadelphia
$105k-$115k/yr HybridFull Time
ZS
ZS: Global management consulting and technology firm for healthcare and life sciences.
1+ YOE1-3 years of data science work; strong ML, statistical skills; knowledge of big data tools; programming in Java/Python/R; experience with Hadoop/Azure/databases.
Hadoop, Microsoft Azure, Databases, Python, Java, R, Machine Learning, Text mining
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Infra Engineer
Mountain View, California, United States
$175k-$221k/yr OnsiteFull Time
NewsBreak
NewsBreak: Local news aggregation platform powered by artificial intelligence.
BS/MS in Computer Science or equivalent; experience with big-data technologies (Hadoop, Spark, Presto, Kafka, Flink), databases, and cloud (AWS). Strong modeling, communication, and mentoring skills; senior-level data infrastructure experience preferred.
Hadoop, Spark, Presto, Kafka, Flink, AWS
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Data Scientist - AI Foundations, Specialist Models
McLean or New York City or San Jose
$162k-$201k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
3+ YOEAdvanced quantitative degree plus 3–5+ years performing data analytics; hands-on experience with Python/SQL, machine learning, and cloud platforms; strong statistical and big-data skills.
Python, AWS, Spark, transformers, graph ML, Agentic AI, SQL, Scala, R
Job PostingView all
5d
Save
Mark Applied
Hide
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start
San Jose, California, United States
OnsiteFull Time
ByteDance
ByteDance: Developing AI-driven content platforms and mobile applications.
Bachelor's or master's in computer science, software engineering, data science, or related field; data structures, algorithms, distributed systems, programming, SQL, and big data or lakehouse experience required.
SQL, Large Language Model (LLM), Model-as-a-Service (MaaS), OLAP
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Growth Data Analyst
Palo Alto, California, United States
$152k-$227k/yr HybridFull Time
Mercari
MercariTokyo Stock Exchange: 4385: Mobile marketplace for buying and selling pre-owned items.
8+ YOEBachelor's degree,8+ years analytics experience with large-scale data tools,proficiency in Python and SQL (Google Big Query),strong statistics and experimental design skills,experience in growth/marketing analytics.
SQL, Python, Google Big Query, Looker, LookML
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Postmarket Surveillance Data Scientist
Alameda, California, United States
$90k-$180k/yr OnsiteFull Time
Abbott
AbbottNYSE: ABT: Manufactures medical devices, diagnostics, and nutritional health products.
4+ YOEBachelor's in CS, Data Analytics, Math, Stats, Physics, or Engineering; 4+ years relevant experience; advanced Python, SQL, PowerBI, Databricks; statistics and big-data analytics; mentoring experience.
Python, SQL, PowerBI, Databricks
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Contact Center Data Engineer
Richardson or Palo Alto or Bethesda
$105k-$172k/yr HybridFull Time
GEICO
GEICO: Provides vehicle and property insurance services to consumers.
3+ YOERequires 3+ years in analytics and SQL, programming language experience, source control or DevOps experience, cloud or big data exposure, and a BA/BS degree or equivalent experience.
Microsoft Power BI, SQL, Amazon QuickSight, Amazon CloudWatch, Python, R, SAS, .NET, M, DAX, Snowflake, Hive, Spark, Hadoop, Azure, AWS, Tableau, DevOps
Job PostingView all

Explore Jobs

Expand Your Job Search