127 spark engineer jobs at 56 companies in Irvine, CA
1w
Save
Mark Applied
Hide
1w
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yrRemoteFull Time
SentiLink: Provides identity verification and fraud prevention for financial institutions.
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Tatari: A platform for buying and measuring TV advertising campaigns.
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOEExperience building and operating large-scale data/ML systems, strong distributed systems fundamentals, streaming/batch technologies (Kafka, Kinesis, Spark, Flink), Python, plus working knowledge of Java/Scala/Go/C++, cloud-native (AWS, containers, Kubernetes, IaC), observability, and collaboration skills; Bachelor's or Master's required.
SpaceX: Designs and launches advanced rockets and satellite internet constellations.
1+ YOE1+ years software or data engineering experience; bachelor's in CS/data/engineering/math/physics or 2+ years professional software experience; experience with big data systems and modern programming languages.
Scala, Java, C#, Python, Go, Angular, React, Apache Kafka, Spark, Flink, Hive, Delta Lake, PostgreSQL, CockroachDB, Grafana, Metabase, Microsoft Power BI
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
Experience building end-to-end ML deployment and low-latency inference infra for real-time ad systems; handling large-scale data with Spark; forecasting ad metrics; building scalable simulations; cross-functional collaboration.
UCLA Health: Provides comprehensive hospital services and academic medical research.
5+ YOE5+ years data engineering experience; strong Python and SQL; experience with Databricks, Spark, data lakehouse, ETL/ELT, cloud platforms; bachelor's degree in a technical field.
Python, SQL Server, Oracle, PostgreSQL, Databricks, Spark, Delta Lake, Snowflake, Microsoft Fabric, Synapse, Azure, AWS, GCP, Azure Data Factory, Databricks Workflows, Airflow, MLflow, Git
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOE5+ years data engineering experience building large data pipelines; strong SQL, Python/PySpark; experience with Snowflake/Redshift, Databricks, Spark, Airflow, AWS; data modeling and performance tuning; Bachelor's degree or equivalent.
Anduril Industries: Defense technology building autonomous military hardware and software.
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
United States or Foster City or Orange County or Morristown
RemoteFull Time
Bridgepointe Technologies: Vendor-agnostic IT strategy and technology procurement services.
5+ YOERequires 5+ years in data engineering, advanced SQL, Python, Spark/PySpark, Microsoft Fabric, Azure data services, APIs, data modeling, CI/CD, Git, and Azure DevOps; bachelor's degree or equivalent experience.
Microsoft Fabric, Lakehouse, Warehouse, Data Pipelines, Notebooks, OneLake, Git, Azure DevOps, Spark, PySpark, SQL, Python, Azure, Delta Lake, Parquet, REST APIs, JSON, Power BI, DP-600, DP-700
15+ YOEBachelor's degree or equivalent and 15 years software engineering experience; senior technical leadership, large-scale distributed systems, architectural design, and experience with agentic AI and large-scale data platforms.
Field AI: Develops autonomous software brains for robots in unstructured environments.
3+ YOE3+ years infrastructure/platform experience, bachelor's or master's in CS/Engineering, cloud (AWS/GCP), Kubernetes, Terraform, Python/Go, production operations, security and cost management experience.
San Jose or Los Angeles County or Los Angeles or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo or Singapore
$128k-$256k/yrOnsiteFull Time
TikTok: Global short-form video hosting and social media platform.
Completing or recently completed a bachelor's or master's degree in computer science, computer engineering, or a related discipline; Java, Spring Boot, microservices, databases, Spark, OLAP, or Flink experience preferred.
TikTok USDS Joint Venture: Operates and secures TikTok services for U.S. users.
5+ YOEProficient in SQL and Python, experience with Hadoop/Spark, strong ML and data engineering skills, analytical problem-solving, and experience improving ad/recommendation systems.
San Francisco or New York City or Los Angeles or Seattle
$180k-$260k/yrRemoteFull Time
Whatnot: Social marketplace for buying and selling via live streams
5+ YOE5+ years building data warehouses or distributed/event-driven systems; skilled with data modeling, modern data tooling, cloud warehouses, Python/SQL, and cross-functional partnership.
Kafka, Debezium, dbt, Spark, Flink, Dagster, Airflow, Monte Carlo, Great Expectations, Snowflake, BigQuery, Redshift, Python, SQL, CI/CD
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
2+ YOEB.S. in CS or related required; 2+ years Java experience; Unix and shell scripting; professional experience with Spring, Hibernate, Maven, Git; SQL and relational DB experience; Hadoop, Spark, Scala, Docker, Kubernetes, AWS are pluses.
Data Engineer, Prime Video - GSS Planning & Strategy
Culver City or Seattle
$132k-$179k/yrOnsiteFull Time
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOEBachelor's degree, 3+ years data engineering, experience with Hadoop/Hive/Spark/EMR, SQL and Python, data modeling, ETL/ELT pipelines, BI tools (Tableau/QuickSight), and strong cross-team communication.
Principal Data Engineer, Personalization - Central Product Insights
Los Angeles, California, United States
$210k-$293k/yrOnsiteFull Time
Riot Games: Developing and publishing competitive multiplayer video games.
8+ YOEBachelor's degree in CS or related,8+ years data engineering experience in publishing/marketing,expertise with Python,GoLang,Spark,Scala,SQL,Airflow,dbt,cloud (AWS/GCP),Databricks,mentoring and cross-functional collaboration.