136 spark engineer jobs at 57 companies in Commerce, CA
1w
Save
Mark Applied
Hide
1w
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yrRemoteFull Time
SentiLink: Provides identity verification and fraud prevention for financial institutions.
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Tatari: A platform for buying and measuring TV advertising campaigns.
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOEExperience building and operating large-scale data/ML systems, strong distributed systems fundamentals, streaming/batch technologies (Kafka, Kinesis, Spark, Flink), Python, plus working knowledge of Java/Scala/Go/C++, cloud-native (AWS, containers, Kubernetes, IaC), observability, and collaboration skills; Bachelor's or Master's required.
SpaceX: Designs and launches advanced rockets and satellite internet constellations.
1+ YOE1+ years software or data engineering experience; bachelor's in CS/data/engineering/math/physics or 2+ years professional software experience; experience with big data systems and modern programming languages.
Scala, Java, C#, Python, Go, Angular, React, Apache Kafka, Spark, Flink, Hive, Delta Lake, PostgreSQL, CockroachDB, Grafana, Metabase, Microsoft Power BI
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
Experience building end-to-end ML deployment and low-latency inference infra for real-time ad systems; handling large-scale data with Spark; forecasting ad metrics; building scalable simulations; cross-functional collaboration.
UCLA Health: Provides comprehensive hospital services and academic medical research.
5+ YOE5+ years data engineering experience; strong Python and SQL; experience with Databricks, Spark, data lakehouse, ETL/ELT, cloud platforms; bachelor's degree in a technical field.
Python, SQL Server, Oracle, PostgreSQL, Databricks, Spark, Delta Lake, Snowflake, Microsoft Fabric, Synapse, Azure, AWS, GCP, Azure Data Factory, Databricks Workflows, Airflow, MLflow, Git
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
3+ YOE3–5 years data engineering experience; strong SQL, Python, Spark/PySpark; experience with Databricks, AWS, Snowflake or Google Cloud; familiarity with AI tools and modern lakehouse architectures.
Python, PySpark, SQL, Spark, Claude Code, Codex, GitHub Copilot, Databricks Genie, Databricks, AWS, Snowflake, Google Cloud, SFTP, APIs
15+ YOEBachelor's degree or equivalent and 15 years software engineering experience; senior technical leadership, large-scale distributed systems, architectural design, and experience with agentic AI and large-scale data platforms.
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOE5+ years data engineering experience building large data pipelines; strong SQL, Python/PySpark; experience with Snowflake/Redshift, Databricks, Spark, Airflow, AWS; data modeling and performance tuning; Bachelor's degree or equivalent.
United States or Foster City or Orange County or Morristown
RemoteFull Time
Bridgepointe Technologies: Vendor-agnostic IT strategy and technology procurement services.
5+ YOERequires 5+ years in data engineering, advanced SQL, Python, Spark/PySpark, Microsoft Fabric, Azure data services, APIs, data modeling, CI/CD, Git, and Azure DevOps; bachelor's degree or equivalent experience.
Microsoft Fabric, Lakehouse, Warehouse, Data Pipelines, Notebooks, OneLake, Git, Azure DevOps, Spark, PySpark, SQL, Python, Azure, Delta Lake, Parquet, REST APIs, JSON, Power BI, DP-600, DP-700
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
Anduril Industries: Defense technology building autonomous military hardware and software.
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
Field AI: Develops autonomous software brains for robots in unstructured environments.
3+ YOE3+ years infrastructure/platform experience, bachelor's or master's in CS/Engineering, cloud (AWS/GCP), Kubernetes, Terraform, Python/Go, production operations, security and cost management experience.
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
13+ YOEBachelor's in CS or related, 13+ years data engineering with 6+ years building AWS cloud-native data platforms; expertise with AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
San Jose or Los Angeles County or Los Angeles or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo or Singapore
$128k-$256k/yrOnsiteFull Time
TikTok: Global short-form video hosting and social media platform.
Completing or recently completed a bachelor's or master's degree in computer science, computer engineering, or a related discipline; Java, Spring Boot, microservices, databases, Spark, OLAP, or Flink experience preferred.
TikTok USDS Joint Venture: Operates and secures TikTok services for U.S. users.
5+ YOEProficient in SQL and Python, experience with Hadoop/Spark, strong ML and data engineering skills, analytical problem-solving, and experience improving ad/recommendation systems.
San Francisco or New York City or Los Angeles or Seattle
$180k-$260k/yrRemoteFull Time
Whatnot: Social marketplace for buying and selling via live streams
5+ YOE5+ years building data warehouses or distributed/event-driven systems; skilled with data modeling, modern data tooling, cloud warehouses, Python/SQL, and cross-functional partnership.
Kafka, Debezium, dbt, Spark, Flink, Dagster, Airflow, Monte Carlo, Great Expectations, Snowflake, BigQuery, Redshift, Python, SQL, CI/CD
Boston ScientificNYSE: BSX: Developer and manufacturer of innovative medical devices and therapies.
13+ YOEBachelor's degree required; 13+ years data engineering experience including 6+ years designing cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise with AWS data services, Snowflake, Python, Terraform, Bash, Spark/Flink, and governance automation.