83 software developer big data jobs at 36 companies in California

1w
Save
Mark Applied
Hide
Big Data Engineer Graduate (TikTok Recommendation Architecture) - 2027 Start
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$128k-$317k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
Bachelor's degree in computer science or related field; knowledge of big data frameworks and Java or C++; strong coding and troubleshooting ability; enthusiasm for learning.
Hadoop, Hive, Flink, FlinkSQL, Apache Spark, Apache Kafka, HBase, Redis, RocksDB, Elasticsearch, Java, C++
3w
Save
Mark Applied
Hide
Staff Software Engineer, Big Data Storage
Palo Alto, California, United States
$177k-$365k/yr HybridFull Time
Pinterest
PinterestNYSE: PINS: Visual discovery engine for finding and saving ideas.
8+ YOE8+ years designing large-scale distributed systems; expertise in storage, metadata, data lakes, ML/AI workloads, and big data technologies. Requires Java, Scala, or Python proficiency and a relevant bachelor's degree or equivalent experience.
Apache Iceberg, Apache Spark, Apache Flink, Presto, Trino, Apache Hive, Java, Scala, Python
2mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
1mo
Save
Mark Applied
Hide
Sr. Software Engineer, Data (Starlink)
Redmond or Hawthorne
$160k-$270k/yr OnsiteFull Time
SpaceX
SpaceX: Designs and launches advanced rockets and satellite internet constellations.
5+ YOE5+ years software/data engineering experience; BS in CS or 7+ years alternative; proficiency in Scala/Java/C#/Python/Go; experience with big data frameworks, databases, and frontend frameworks; strong communication and problem-solving.
Scala, Java, C#, Python, Go, Angular, React, Apache Kafka, Apache Spark, Apache Flink, Hive, Delta Lake, PostgreSQL, CockroachDB, Grafana, Metabase, PowerBI
2mo
Save
Mark Applied
Hide
Software Engineer II, Big Data, tvScientific
San Francisco, California, United States
$124k-$255k/yr RemoteFull Time
Pinterest
PinterestNYSE: PINS: Visual discovery engine for finding inspiration and creative ideas.
Production data engineering with Spark and Scala; AWS; data pipelines; APIs; data lakes; SQL; Bachelor's in CS; AI-assisted workflows experience.
Apache Spark, Scala, AWS, SQL, Apache Iceberg, Delta Lake, APIs
3mo
Save
Mark Applied
Hide
Software Engineer (L3) Data Substrate
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California or San Francisco or Oakland or San Jose or Washington
$139k-$204k/yr RemoteFull Time
Twilio
TwilioNYSE: TWLO: Cloud communications platform for building customer engagement applications.
5+ YOEBachelor's or Master's in CS/Engineering, 5+ years software development, proficiency in Python/Java/Scala, experience with big data tools (Kafka, Spark, Hive, Hudi, Presto, Airflow) and AWS services, strong problem-solving and communication skills.
Kafka, Spark, Hive, Hudi, Presto, Airflow, AWS Lakeformation, Glue, Athena, Python, Java, Scala
1w
Save
Mark Applied
Hide
Staff Software Engineer, Data Platform
Salem or Pittsburgh or Fremont
$191k-$299k/yr RemoteFull Time
Agility Robotics
Agility Robotics: Develops bipedal humanoid robots for industrial warehouse automation.
5+ YOERequires 5+ years building cloud data platforms, big data frameworks, cloud providers, observability, Java/Scala/Python, distributed systems, and microservices experience.
Fluent Bit, OpenTelemetry, Apache Spark, Apache Kafka, AWS S3, Amazon Athena, Amazon SageMaker, Java, Scala, Python, Parquet, Apache Arrow, Apache Iceberg, Apache Avro, Protocol Buffers, Prometheus, DataHub, Amundsen, Databricks Unity Catalog, Databricks, Kubernetes, Bazel, Blaze, C++, Rust, MCAP, ROS, Rerun, AWS, GCP, Azure
2w
Save
Mark Applied
Hide
Software Development Engineer – Big Data, AWS Elastic MapReduce (EMR), EMR EKS
East Palo Alto, California, United States
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOERequires 3+ years of professional software development, 2+ years designing or architecting scalable systems, and programming experience in at least one language. Bachelor's degree in computer science preferred.
AWS, Elastic MapReduce, EMR, Hadoop, Hive, Pig, Impala, Spark, Presto, HBase, Amazon Simple Storage Service (S3), Amazon Elastic Compute Cloud (EC2)
1mo
Save
Mark Applied
Hide
Software Engineer III - Cloud Data Platform
San Mateo, California, United States
$124k-$210k/yr HybridFull Time
Guidewire
GuidewireNYSE: GWRE: Provides a software platform for property and casualty insurers.
5+ YOE5+ years data-platform engineering experience; deep Java/Scala and distributed-systems expertise; experience with Kubernetes, AWS, Docker, Terraform/CloudFormation and modern big-data stack.
Kafka, Hadoop, Spark, Flink, Hive, Java, Scala, Kubernetes, AWS, Docker, Terraform, CloudFormation, ELK, Debezium, TeamCity
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Apple Data Platform
Cupertino, California, United States
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Experience building scalable, highly available big-data platforms and cloud-based solutions; strong problem-solving and systems design skills.
3w
Save
Mark Applied
Hide
Software Engineer, Data Platform (All Teams)
San Francisco or Seattle or Sunnyvale or New York City
$131k-$285k/yr OnsiteFull Time
DoorDash
DoorDashNYSE: DASH: Local food delivery and on-demand logistics platform.
2+ YOEComputer science degree or equivalent, 2+ years industry experience at I4 or 5+ years at I5, AI coding tool proficiency, and experience building scalable big data infrastructure and governance.
Apache Spark, Apache Flink, Apache Kafka, Apache Airflow, Cassandra, ClickHouse, Apache Iceberg, DataHub, Claude Code, Codex, Cursor
1mo
Save
Mark Applied
Hide
Product Software Engineer I
Glendale, California, United States
$98k-$131k/yr OnsiteFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
0+ YOEBachelor's degree or equivalent, 0–2 years software development experience, foundational skills in Java/Scala/Python, knowledge of data processing and SQL, and interest in big data and cloud technologies.
Java, Scala, Python, Spark, Kafka, Flink, Databricks, Snowflake, SQL, AWS, Terraform, Docker, Kubernetes, Presto, Kinesis
4d
Save
Mark Applied
Hide
Senior Software Engineer - Marketplace Foundation
San Mateo, California, United States
$197k-$243k/yr HybridFull Time
Roblox
RobloxNYSE: RBLX: Platform for creating and playing user-generated 3D digital experiences.
4+ YOERequires 4+ years of software development experience focused on distributed systems, systems programming, Docker, Kubernetes, Terraform, Helm, big data, distributed databases, monitoring, and technical leadership.
C#, Go, Rust, Java, C++, Python, Docker, Kubernetes, Terraform, Helm, Hadoop, Spark, Kafka, Cassandra, MongoDB, Grafana, Datadog, Prometheus, ELK stack
6d
Save
Mark Applied
Hide
Staff Software Engineer
Sunnyvale, California, United States
$265k-$284k/yr HybridFull Time
Uber
UberNYSE: UBER: A technology platform for transportation, delivery, and freight.
5+ YOEBachelor's degree in a quantitative or computer science field and 5 years of experience developing and deploying production machine learning models, with Python, Java, big data, MLOps, and database expertise.
Python, Java, Spark, Hadoop, SQL, MySQL, Presto
3mo
Save
Mark Applied
Hide
Software Engineer
Foster City, California, United States
$98k-$152k/yr HybridFull Time
Visa
VisaNYSE: V: Global payment technology facilitating electronic funds transfers.
3+ YOEBachelor's degree or 3+ years of relevant work experience; 2+ years with Java, Spring, Python; experience with Gen AI and big data.
Java, Spring, Python, Jenkins, Artifactory, Git, Selenium, Chef, LLM frameworks, DB2, MySQL, NoSQL
2w
Save
Mark Applied
Hide
Staff, Software Engineer
Sunnyvale, California, United States
$143k-$286k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Operates a chain of hypermarkets, discount stores, and grocery stores.
4+ YOERequires a bachelor's degree plus 4 years of software engineering experience or 6 years of experience. Expertise in Java, Python, AI, big data, Azure Cosmos DB, distributed systems, and cloud architecture.
Java, Python, Azure Cosmos DB, CI/CD, Generative AI, AI/ML, WCAG 2.2 AA
2w
Save
Mark Applied
Hide
Staff, Software Engineer
Sunnyvale, California, United States
$143k-$286k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
4+ YOERequires a bachelor's degree and 4 years of software engineering experience, or 6 years of experience. Expertise in Java, Python, AI solutions, big data, Azure Cosmos DB, cloud-native architecture, and distributed systems.
Java, Python, Azure Cosmos DB, CI/CD, WCAG 2.2 AA
4w
Save
Mark Applied
Hide
Principal Software Engineer, Real Time Data Enrichment Platform (Hybrid)
New York City or Austin or Sunnyvale or Redmond
$195k-$290k/yr HybridFull Time
CrowdStrike
CrowdStrikeNASDAQ: CRWD: Provides cloud-native endpoint protection and cybersecurity services.
12+ YOEExtensive experience designing and operating very high-scale data platforms; deep expertise in distributed systems, big-data frameworks, and JVM languages; advanced degree and 12+ years experience preferred.
Spark, Flink, Iceberg, Pinot, Ray, Scala, Java, Kotlin, Postgres, MySQL, Cassandra, DynamoDB, Presto, Trino, Druid, Kafka, Hadoop, Linux, Go, Kubernetes, Mesos
2mo
Save
Mark Applied
Hide
Lead Software Engineer
San Jose, California, United States
$115k-$213k/yr OnsiteFull Time
Cadence Design Systems
Cadence Design SystemsNASDAQ: CDNS: Develops computational software and hardware for electronic system design.
5+ YOEBS +5 years or MS +3 years industry experience; advanced experience with LLM/ML/big data (e.g., Langchain, Spark); strong architecture design, performance tuning, algorithms, distributed systems; development in Python and C++, and high SQL proficiency.
Langchain, Spark, Python, C++, SQL
1mo
Save
Mark Applied
Hide
Senior Lead Data Engineer (Bank Tech)
McLean or Wilmington or Richmond or New York or California or Pennsylvania
$209k-$262k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
6+ YOEBachelor's degree, 6+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; strong programming and data engineering skills required.
Java, Scala, Python, RDBMS, NoSQL, Redshift, Snowflake, machine learning, microservices, Agile, SQL, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, AWS, Microsoft Azure, Google Cloud