68 software developer big data jobs at 29 companies in San Mateo, CA

1w
Save
Mark Applied
Hide
Big Data Engineer Graduate (TikTok Recommendation Architecture) - 2027 Start
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$128k-$317k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
Bachelor's degree in computer science or related field; knowledge of big data frameworks and Java or C++; strong coding and troubleshooting ability; enthusiasm for learning.
Hadoop, Hive, Flink, FlinkSQL, Apache Spark, Apache Kafka, HBase, Redis, RocksDB, Elasticsearch, Java, C++
3w
Save
Mark Applied
Hide
Staff Software Engineer, Big Data Storage
Palo Alto, California, United States
$177k-$365k/yr HybridFull Time
Pinterest
PinterestNYSE: PINS: Visual discovery engine for finding and saving ideas.
8+ YOE8+ years designing large-scale distributed systems; expertise in storage, metadata, data lakes, ML/AI workloads, and big data technologies. Requires Java, Scala, or Python proficiency and a relevant bachelor's degree or equivalent experience.
Apache Iceberg, Apache Spark, Apache Flink, Presto, Trino, Apache Hive, Java, Scala, Python
2mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
2mo
Save
Mark Applied
Hide
Software Engineer II, Big Data, tvScientific
San Francisco, California, United States
$124k-$255k/yr RemoteFull Time
Pinterest
PinterestNYSE: PINS: Visual discovery engine for finding inspiration and creative ideas.
Production data engineering with Spark and Scala; AWS; data pipelines; APIs; data lakes; SQL; Bachelor's in CS; AI-assisted workflows experience.
Apache Spark, Scala, AWS, SQL, Apache Iceberg, Delta Lake, APIs
3mo
Save
Mark Applied
Hide
Software Engineer (L3) Data Substrate
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California or San Francisco or Oakland or San Jose or Washington
$139k-$204k/yr RemoteFull Time
Twilio
TwilioNYSE: TWLO: Cloud communications platform for building customer engagement applications.
5+ YOEBachelor's or Master's in CS/Engineering, 5+ years software development, proficiency in Python/Java/Scala, experience with big data tools (Kafka, Spark, Hive, Hudi, Presto, Airflow) and AWS services, strong problem-solving and communication skills.
Kafka, Spark, Hive, Hudi, Presto, Airflow, AWS Lakeformation, Glue, Athena, Python, Java, Scala
1w
Save
Mark Applied
Hide
Staff Software Engineer, Data Platform
Salem or Pittsburgh or Fremont
$191k-$299k/yr RemoteFull Time
Agility Robotics
Agility Robotics: Develops bipedal humanoid robots for industrial warehouse automation.
5+ YOERequires 5+ years building cloud data platforms, big data frameworks, cloud providers, observability, Java/Scala/Python, distributed systems, and microservices experience.
Fluent Bit, OpenTelemetry, Apache Spark, Apache Kafka, AWS S3, Amazon Athena, Amazon SageMaker, Java, Scala, Python, Parquet, Apache Arrow, Apache Iceberg, Apache Avro, Protocol Buffers, Prometheus, DataHub, Amundsen, Databricks Unity Catalog, Databricks, Kubernetes, Bazel, Blaze, C++, Rust, MCAP, ROS, Rerun, AWS, GCP, Azure
2w
Save
Mark Applied
Hide
Software Development Engineer – Big Data, AWS Elastic MapReduce (EMR), EMR EKS
East Palo Alto, California, United States
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOERequires 3+ years of professional software development, 2+ years designing or architecting scalable systems, and programming experience in at least one language. Bachelor's degree in computer science preferred.
AWS, Elastic MapReduce, EMR, Hadoop, Hive, Pig, Impala, Spark, Presto, HBase, Amazon Simple Storage Service (S3), Amazon Elastic Compute Cloud (EC2)
1mo
Save
Mark Applied
Hide
Software Engineer III - Cloud Data Platform
San Mateo, California, United States
$124k-$210k/yr HybridFull Time
Guidewire
GuidewireNYSE: GWRE: Provides a software platform for property and casualty insurers.
5+ YOE5+ years data-platform engineering experience; deep Java/Scala and distributed-systems expertise; experience with Kubernetes, AWS, Docker, Terraform/CloudFormation and modern big-data stack.
Kafka, Hadoop, Spark, Flink, Hive, Java, Scala, Kubernetes, AWS, Docker, Terraform, CloudFormation, ELK, Debezium, TeamCity
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Apple Data Platform
Cupertino, California, United States
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Experience building scalable, highly available big-data platforms and cloud-based solutions; strong problem-solving and systems design skills.
3w
Save
Mark Applied
Hide
Software Engineer, Data Platform (All Teams)
San Francisco or Seattle or Sunnyvale or New York City
$131k-$285k/yr OnsiteFull Time
DoorDash
DoorDashNYSE: DASH: Local food delivery and on-demand logistics platform.
2+ YOEComputer science degree or equivalent, 2+ years industry experience at I4 or 5+ years at I5, AI coding tool proficiency, and experience building scalable big data infrastructure and governance.
Apache Spark, Apache Flink, Apache Kafka, Apache Airflow, Cassandra, ClickHouse, Apache Iceberg, DataHub, Claude Code, Codex, Cursor
4d
Save
Mark Applied
Hide
Senior Software Engineer - Marketplace Foundation
San Mateo, California, United States
$197k-$243k/yr HybridFull Time
Roblox
RobloxNYSE: RBLX: Platform for creating and playing user-generated 3D digital experiences.
4+ YOERequires 4+ years of software development experience focused on distributed systems, systems programming, Docker, Kubernetes, Terraform, Helm, big data, distributed databases, monitoring, and technical leadership.
C#, Go, Rust, Java, C++, Python, Docker, Kubernetes, Terraform, Helm, Hadoop, Spark, Kafka, Cassandra, MongoDB, Grafana, Datadog, Prometheus, ELK stack
6d
Save
Mark Applied
Hide
Staff Software Engineer
Sunnyvale, California, United States
$265k-$284k/yr HybridFull Time
Uber
UberNYSE: UBER: A technology platform for transportation, delivery, and freight.
5+ YOEBachelor's degree in a quantitative or computer science field and 5 years of experience developing and deploying production machine learning models, with Python, Java, big data, MLOps, and database expertise.
Python, Java, Spark, Hadoop, SQL, MySQL, Presto
3mo
Save
Mark Applied
Hide
Software Engineer
Foster City, California, United States
$98k-$152k/yr HybridFull Time
Visa
VisaNYSE: V: Global payment technology facilitating electronic funds transfers.
3+ YOEBachelor's degree or 3+ years of relevant work experience; 2+ years with Java, Spring, Python; experience with Gen AI and big data.
Java, Spring, Python, Jenkins, Artifactory, Git, Selenium, Chef, LLM frameworks, DB2, MySQL, NoSQL
2w
Save
Mark Applied
Hide
Staff, Software Engineer
Sunnyvale, California, United States
$143k-$286k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Operates a chain of hypermarkets, discount stores, and grocery stores.
4+ YOERequires a bachelor's degree plus 4 years of software engineering experience or 6 years of experience. Expertise in Java, Python, AI, big data, Azure Cosmos DB, distributed systems, and cloud architecture.
Java, Python, Azure Cosmos DB, CI/CD, Generative AI, AI/ML, WCAG 2.2 AA
2w
Save
Mark Applied
Hide
Staff, Software Engineer
Sunnyvale, California, United States
$143k-$286k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
4+ YOERequires a bachelor's degree and 4 years of software engineering experience, or 6 years of experience. Expertise in Java, Python, AI solutions, big data, Azure Cosmos DB, cloud-native architecture, and distributed systems.
Java, Python, Azure Cosmos DB, CI/CD, WCAG 2.2 AA
4w
Save
Mark Applied
Hide
Principal Software Engineer, Real Time Data Enrichment Platform (Hybrid)
New York City or Austin or Sunnyvale or Redmond
$195k-$290k/yr HybridFull Time
CrowdStrike
CrowdStrikeNASDAQ: CRWD: Provides cloud-native endpoint protection and cybersecurity services.
12+ YOEExtensive experience designing and operating very high-scale data platforms; deep expertise in distributed systems, big-data frameworks, and JVM languages; advanced degree and 12+ years experience preferred.
Spark, Flink, Iceberg, Pinot, Ray, Scala, Java, Kotlin, Postgres, MySQL, Cassandra, DynamoDB, Presto, Trino, Druid, Kafka, Hadoop, Linux, Go, Kubernetes, Mesos
2mo
Save
Mark Applied
Hide
Lead Software Engineer
San Jose, California, United States
$115k-$213k/yr OnsiteFull Time
Cadence Design Systems
Cadence Design SystemsNASDAQ: CDNS: Develops computational software and hardware for electronic system design.
5+ YOEBS +5 years or MS +3 years industry experience; advanced experience with LLM/ML/big data (e.g., Langchain, Spark); strong architecture design, performance tuning, algorithms, distributed systems; development in Python and C++, and high SQL proficiency.
Langchain, Spark, Python, C++, SQL
2w
Save
Mark Applied
Hide
Software Engineer Graduate (E-Commerce) - 2027 Start
San Jose, California, United States
$123k-$187k/yr OnsiteFull Time
TikTok USDS Joint Venture
TikTok USDS Joint Venture: Operates and secures TikTok services for U.S. users.
Completing or recently completed a bachelor's or master's degree in a relevant field; requires big data frameworks, distributed systems, coding, algorithms, data structures, and software design experience.
Hadoop, Flink, Spark, Kafka, Hive, HBase, Redis, RocksDB
7h
Save
Mark Applied
Hide
Principal Software Engineer - PA172
Bethesda or San Francisco or Waltham or Colorado
$164k-$257k/yr RemoteFull Time
ZoomInfo
ZoomInfoNASDAQ: GTM: Provides B2B contact data and sales intelligence software.
8+ YOERequires 8+ years of backend, data, or infrastructure engineering experience; proficiency in Java, Go, or Python; SQL and large-scale data modeling; and experience with distributed systems, big data, or applied AI/ML.
Java, Go, Python, SQL, LangGraph, MCP, Kafka, Kinesis, ClickHouse, DynamoDB, Bigtable, Memcached, Firehose, Airflow, Snowflake, Microsoft Copilot, Cursor, ChatGPT, Claude
2mo
Save
Mark Applied
Hide
Staff Software Engineer
San Jose or Durham or Mexico City or Bangalore or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$190k-$380k/yr HybridFull Time
Nutanix
NutanixNASDAQ: NTNX: Sells cloud software and hyperconverged infrastructure for enterprises.
15+ YOE15+ years experience; bachelor’s in computer science or related required; experience architecting scalable data platforms, databases, big-data pipelines, Kubernetes, message queues/API gateways, OTEL, Parquet, Iceberg; proficiency in Python, Golang, C++, or Java; mentoring and SDLC experience.
Python, Golang, C++, Java, Kubernetes, OTEL, Apache Parquet, Apache Iceberg, API gateway, Message queues