125 big data developer jobs at 56 companies in California

2w
Save
Mark Applied
Hide
Big Data Engineer Graduate (TikTok Recommendation Architecture) - 2027 Start
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$128k-$317k/yr OnsiteFull Time
TikTok
TikTok: Short-form mobile video and social media platform.
Bachelor's degree in computer science or related field; knowledge of big data frameworks and Java or C++; strong coding and troubleshooting ability; enthusiasm for learning.
Hadoop, Hive, Flink, FlinkSQL, Apache Spark, Apache Kafka, HBase, Redis, RocksDB, Elasticsearch, Java, C++
6d
Save
Mark Applied
Hide
Sr. Staff Software Engineer, Big Data Platform
Palo Alto or Seattle or New York City or San Francisco or United States
HybridFull Time
Pinterest
PinterestNYSE: PINS: A visual discovery engine for finding inspiration.
10+ YOE10+ years of industry experience, 5+ years building scalable Kubernetes or big data platforms, expertise in big data and ML technologies, programming proficiency, AWS experience, and a bachelor's degree or equivalent.
Flink, Spark, Kubernetes, Presto, Ray, PyTorch, TensorFlow, Java, Go, Scala, Python, AWS
6d
Save
Mark Applied
Hide
Sr. Staff Software Engineer, Big Data Platform
Palo Alto, California, United States
HybridFull Time
Pinterest
PinterestNYSE: PINS: A visual discovery engine for finding inspiration.
10+ YOE10+ years of industry experience, 5+ years building scalable Kubernetes or big data platforms, expertise in big data and ML technologies, programming proficiency, AWS experience, and a bachelor's degree or equivalent.
Apache Flink, Apache Spark, Kubernetes, Presto, Ray, PyTorch, TensorFlow, Java, Go, Scala, Python, Amazon Web Services (AWS)
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Jose, California, United States
$149k-$361k/yr HybridFull Time
Roku
RokuNASDAQ: ROKU: TV streaming platform powering the global television ecosystem.
8+ YOE8+ years data engineering experience, strong SQL, Python preferred, expertise with big-data tech (Hadoop, Spark, Kafka, Hive, Airflow), data modeling, and cloud platforms (AWS/GCP).
SQL, Python, Hadoop, HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, Presto, Trino, AWS, GCP, Looker, Claude Code, Cursor, MCP servers
6d
Save
Mark Applied
Hide
Principal Data Engineer
Thousand Oaks or Tampa
$159k-$216k/yr HybridFull Time
Amgen
AmgenNASDAQ: AMGN: Developing innovative medicines to fight serious diseases.
2+ YOECloud data engineering expertise with AWS, Azure, or GCP; Python, PySpark, SQL, big data ETL tuning; team leadership; and a qualifying degree with 2–12 years of data engineering experience.
AWS, Azure, GCP, Python, PySpark, SQL, Apache Spark, Apache Airflow, Git, Subversion, Jenkins, Maven, Databricks
4d
Save
Mark Applied
Hide
Associate Data Engineer
Costa Mesa, California, United States
$86k-$115k/yr HybridFull Time
Auto Club Enterprises
Auto Club Enterprises: Provider of insurance, travel, financial, and roadside assistance services.
Proficiency in SQL and at least one programming language such as Python or Spark; experience querying large datasets, data analysis, quality testing, Agile collaboration, and Big Data integration preferred.
SQL, Python, Spark, Big Data, Agile
1mo
Save
Mark Applied
Hide
Staff Data Engineer
San Francisco, California, United States
$237k-$270k/yr HybridFull Time
Front
Front: Private customer-operations software serving B2B teams with collaborative communication and workflow tools.
5+ YOE5+ years data engineering/ETL experience, Snowflake, advanced SQL and Python, experience with big data technologies and workflow tools, BS/BA or equivalent, strong stakeholder collaboration and AI fluency.
Snowflake, Python, SQL, HDFS, EMR, Redshift, Spark, Flink, Presto, Airflow
2mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica, California, United States
$142k-$190k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: A leading global entertainment and media conglomerate.
5+ YOEBachelor's degree or equivalent experience, 5+ years big data engineering, experience with Databricks/Spark/Presto/Hive, strong Python/Scala and SQL, MPP/cloud DBs (Snowflake/Redshift/Big Query/Databricks), Airflow, CI/CD, AWS S3; on-call experience and strong communication.
Databricks, Spark, Presto, Hive, Python, Scala/Spark, SQL, Snowflake, Redshift, Big Query, Airflow, CI/CD, AWS S3, Terraform
1mo
Save
Mark Applied
Hide
Staff Data Engineer - Dev360
Mountain View or San Diego
$189k-$274k/yr OnsiteFull Time
Intuit
IntuitNASDAQ: INTU: A global financial technology platform powering prosperity.
8+ YOE8+ years in product or web analytics domains; advanced SQL and big-data tech, BI tools, Python/Java/Scala, experience architecting data platforms and pipelines, strong communication and business acumen.
SQL, Redshift, Spark, Hive, BigQuery, Tableau, Qlik, Dash, Python, Java, Scala
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco, California, United States
$138k-$221k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payments technology powering digital economies.
Senior-level Big Data engineering experience with Java or Scala, Apache Spark, Hive/Impala, streaming tools (Kafka, NiFi), relational and NoSQL databases, Linux/Shell, strong CS fundamentals, and experience designing high-scale distributed systems.
Java, Scala, Apache Spark, MySQL, PostgreSQL, Hive, Impala, Oozie, Airflow, NiFi, Kafka, Linux/Unix, Shell, Azure, AWS, GCP
1mo
Save
Mark Applied
Hide
Senior, Data Engineer
Sunnyvale, California, United States
$117k-$234k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Global retail, e-commerce, and supply chain.
2+ YOE4–6 years big data experience preferred; 2+ years data engineering; experience with cloud data platforms (GCP/Azure), Spark/PySpark, SQL, Java/Python/Scala, Kafka, containerization, and full-stack systems.
GCP, Azure, BigQuery, Dataflow, Pub/Sub, LangChain, LlamaIndex, CrewAI, PySpark, Spark, Kafka, Druid, Presto, Python, Java, Scala, Spring Boot, React, Angular, Vue.js, Azure SQL, Cosmos, Cassandra, MongoDB, Docker, Kubernetes
1mo
Save
Mark Applied
Hide
Senior Lead Data Engineer (Bank Tech)
McLean or Wilmington or Richmond or New York or California or Pennsylvania
$209k-$262k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
6+ YOEBachelor's degree, 6+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; strong programming and data engineering skills required.
Java, Scala, Python, RDBMS, NoSQL, Redshift, Snowflake, machine learning, microservices, Agile, SQL, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, AWS, Microsoft Azure, Google Cloud
2mo
Save
Mark Applied
Hide
Senior Data Infra Engineer
Mountain View, California, United States
$175k-$221k/yr OnsiteFull Time
NewsBreak
NewsBreak: AI-powered local news and information platform serving Americans, publishers, and local businesses.
BS/MS in Computer Science or equivalent; experience with big-data technologies (Hadoop, Spark, Presto, Kafka, Flink), databases, and cloud (AWS). Strong modeling, communication, and mentoring skills; senior-level data infrastructure experience preferred.
Hadoop, Spark, Presto, Kafka, Flink, AWS
1mo
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
McLean or New York City or Richmond or San Francisco or Philadelphia or Canada or United Kingdom or Philippines
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, and 1+ year cloud computing; Python, SQL, data pipelines, and cloud technologies required.
Python, Amazon Web Services (AWS), Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, Generative AI (GenAI), Open Source RDBMS, NoSQL, MapReduce, Hadoop, Hive, Amazon EMR, MySQL, Mongo, Cassandra, Redshift, UNIX, Linux, Claude Code, GitHub Copilot, AWS Glue, ETL
1mo
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$175k-$270k/yr HybridFull Time
Early Warning Services
Early Warning Services: U.S. bank-owned fintech and consumer reporting agency providing identity, fraud-risk, and real-time payment solutions to financial institutions.
8+ YOE8+ years building large-scale data platforms, distributed systems, cloud-native data pipelines, EM/ML operationalization, and data warehouse/Big Data solutions; Bachelor's in CS or related.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, Aerospike, Elastic Search, IBM Infosphere, Oracle, SQL Server, AppDynamics, Kubernetes
3w
Save
Mark Applied
Hide
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start
San Jose, California, United States
OnsiteFull Time
ByteDance
ByteDance: Global technology specializing in AI-powered content platforms.
Bachelor's or master's in computer science, software engineering, data science, or related field; data structures, algorithms, distributed systems, programming, SQL, and big data or lakehouse experience required.
SQL, Large Language Model (LLM), Model-as-a-Service (MaaS), OLAP
1mo
Save
Mark Applied
Hide
Data Architect
Alabama or Arizona or California or Colorado or Connecticut or Florida or Georgia or Illinois or Iowa or Kentucky or Maryland or Massachusetts or Michigan or Minnesota or Missouri or New Jersey or New York or North Carolina or Ohio or Pennsylvania or South Carolina or Tennessee or Texas or Utah
$100k-$200k/yr RemoteFull Time
RegEd
RegEd: Private RegTech software provider serving financial-services firms with compliance, credentialing, education, licensing, and registration solutions.
10+ YOEBachelor's in CS/Data Science,10+ years data engineering/development experience,expertise in data modeling,warehousing,and integrations,experience with Databricks,Azure/AWS,Big Data and governance tools.
Databricks, Azure Data Lake Storage Gen2, Unity Catalog, Azure Data Factory, Microsoft Purview, Hadoop, Spark, AWS, Azure, Phyton, R, SQL
2w
Save
Mark Applied
Hide
Staff Software Engineer, Data Platform
Salem or Pittsburgh or Fremont
$191k-$299k/yr RemoteFull Time
Agility Robotics
Agility Robotics: Private U.S. humanoid-robot manufacturer serving warehouses, factories, and distribution centers.
5+ YOERequires 5+ years building cloud data platforms, big data frameworks, cloud providers, observability, Java/Scala/Python, distributed systems, and microservices experience.
Fluent Bit, OpenTelemetry, Apache Spark, Apache Kafka, AWS S3, Amazon Athena, Amazon SageMaker, Java, Scala, Python, Parquet, Apache Arrow, Apache Iceberg, Apache Avro, Protocol Buffers, Prometheus, DataHub, Amundsen, Databricks Unity Catalog, Databricks, Kubernetes, Bazel, Blaze, C++, Rust, MCAP, ROS, Rerun, AWS, GCP, Azure
2w
Save
Mark Applied
Hide
Data Infrastructure Engineer (Query Engine)
San Mateo, California, United States
OnsiteFull Time
Zaimler
Zaimler: Private AI infrastructure providing enterprise agents with governed context from fragmented business data.
Experience with query engines, distributed systems, parallel query processing, big data technologies, SQL optimization, and scalable petabyte-scale systems; proficiency in Java, Scala, Rust, or C++.
Java, Scala, Rust, C++, Apache Iceberg, Delta Lake, Hudi, Apache Spark, Presto, Trino, Parquet, ORC, Avro, SQL, Linux, Docker
3w
Save
Mark Applied
Hide
Government and Public Sector - AI & Data - GenAI Developer
McLean or Washington, D.C. or New York or Washington or California
$76k-$126k/yr HybridFull Time
EY
EY: Global professional services firm providing assurance, tax, and consulting.
1+ YOEBachelor's degree and 1–2+ years of web and backend development experience. Requires JavaScript/TypeScript, Python or Node.js, generative AI integration, cloud deployment, data engineering, big data, and Secret Clearance eligibility.
JavaScript, React, Next.js, Python, FastAPI, AWS, Azure, Vercel, Svelte, Vue, Remix, React Router, Node.js, TypeScript, openAI, Anthropic, Hortonworks, Microsoft, Hadoop, RAG