HiringCafe
Join our community

141 spark engineer jobs at 63 companies in Arcadia, CA

1w
Save
Mark Applied
Hide
Senior AI Engineer
Irvine, California, United States
$90k-$150k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE5+ years software/data/AI engineering experience; hands-on AWS, Databricks/Apache Spark, graph databases, backend APIs, CI/CD; familiarity with LLM integrations and data governance.
AWS, Neptune, OpenSearch, DynamoDB, ElastiCache (Redis), IAM, CloudWatch, Databricks, Apache Spark, LangGraph, AutoGen, CrewAI, Java, Spring Boot, Node.js, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Glendale or San Francisco or New York
$142k-$199k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOEExperience building and operating large-scale data/ML systems, strong distributed systems fundamentals, streaming/batch technologies (Kafka, Kinesis, Spark, Flink), Python, plus working knowledge of Java/Scala/Go/C++, cloud-native (AWS, containers, Kubernetes, IaC), observability, and collaboration skills; Bachelor's or Master's required.
Kafka, Kinesis, Spark, Flink, Python, Java, Scala, Go, C++, AWS, Kubernetes, containers, IaC tools
Job PostingView all
1mo
Save
Mark Applied
Hide
Machine Learning Engineer 5 - Ads Inventory Management & Forecasting
Los Gatos or New York or Los Angeles
$466k-$750k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
Experience building end-to-end ML deployment and low-latency inference infra for real-time ad systems; handling large-scale data with Spark; forecasting ad metrics; building scalable simulations; cross-functional collaboration.
Spark, Lucene, VAST, OpenRTB, SSP, DSP
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Engineer
Irvine, California, United States
$150k-$170k/yr HybridFull Time
Commercial Bank of California: A private business bank providing personalized financial and lending services
10+ YOE10+ years in data engineering/analytics, BA or BS (Master’s preferred); strong SQL, Python/Spark; deep MS Fabric, Azure Databricks, Unity Catalog, Power BI experience; CI/CD and data governance focus.
Microsoft Fabric, Azure Databricks, Unity Catalog, Power BI, Azure Data Lake, Azure Synapse, Databricks, SQL, Python, Spark, Azure DevOps, Snowflake
Job PostingView all
4d
Save
Mark Applied
Hide
Principal Engineer, Agentic AI Data and Insights
Irvine or San Jose
$307k-$428k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
15+ YOEBachelor's degree or equivalent and 15 years software engineering experience; senior technical leadership, large-scale distributed systems, architectural design, and experience with agentic AI and large-scale data platforms.
Iceberg, Spark, GoogleSQL, ANSI SQL, Plx, Jetski
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica, California, United States
$142k-$190k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOE5+ years data engineering experience building large data pipelines; strong SQL, Python/PySpark; experience with Snowflake/Redshift, Databricks, Spark, Airflow, AWS; data modeling and performance tuning; Bachelor's degree or equivalent.
AWS, Databricks, Snowflake, Spark, Airflow, Python, PySpark, SQL, Redshift, EMR
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer
Costa Mesa, California, United States
$166k-$220k/yr OnsiteFull Time
Anduril Industries
Anduril Industries: Defense technology building autonomous military hardware and software.
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
Palantir Foundry, SQLMesh, Athena, Apache Iceberg, Flyte, Python, Spark, PySpark, SQL, dbt, AWS, Azure, GCP, Tableau
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
Versant
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
Job PostingView all
1w
Save
Mark Applied
Hide
Data Platform Engineer, Infrastructure
Irvine, California, United States
OnsiteFull Time
Field AI
Field AI: Develops autonomous software brains for robots in unstructured environments.
3+ YOE3+ years infrastructure/platform experience, bachelor's or master's in CS/Engineering, cloud (AWS/GCP), Kubernetes, Terraform, Python/Go, production operations, security and cost management experience.
Kubernetes, Terraform, Python, Go, AWS, GCP, Spark, Databricks, GitOps, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Data Platform Engineer
New York or Los Angeles or San Francisco
$190k-$240k/yr HybridFull Time
Tatari
Tatari: A platform for buying and measuring TV advertising campaigns.
3+ YOE3+ years cloud infrastructure/SRE/platform engineering; strong operational discipline; experience with HA architectures, workflow orchestration, Linux scripting, containers, distributed processing, streaming, IaC, observability, and managed data platforms.
AWS, GCP, Azure, Airflow, Bash, Python, Spark, PySpark, Kubernetes, Docker, Kafka, Flink, Terraform, Helm, ClickHouse, Postgres, Redshift, Datadog, Prometheus, Kibana, Databricks
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Temporary
Boston Scientific
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
13+ YOEBachelor's in CS or related, 13+ years data engineering with 6+ years building AWS cloud-native data platforms; expertise with AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer / Analyst - USA
New York City or Miami or Mountain View or Los Angeles or Chicago or Seattle or Dallas or United States
$122k-$162k/yr HybridFull Time
Cognify Analytics
Cognify Analytics: Independent analytics firm focused on data-driven solutions.
5+ YOE5–8+ years data engineering/analytics delivery; SQL, Snowflake/Databricks, dbt, Python, Spark; data governance; client collaboration.
Snowflake, Databricks, dbt, Python, Pandas, PySpark, Spark, Airflow, Dagster, Kafka, Kinesis, Tableau, Looker, Power BI, Sigma Computing, SQL, Data Governance, Alation, Atlan, DataHub, Unity Catalog
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal Software Engineer, AI Platform Engineering
El Segundo, California, United States
HybridFull Time
Saviynt
Saviynt: Provides AI-powered identity governance and cloud security platforms.
8+ YOE8+ years of data engineering at production scale; end-to-end data lake ownership; experience with Spark/Dataflow/Beam; strong in data governance and multi-tenant architectures.
GCS, Dataproc, Spark, Iceberg, Delta Lake, Beam, Dataflow, Flyte, Kubeflow Pipelines, Airflow, Prefect, Protobuf, Avro, dbt, Great Expectations, Feast, Tecton, S3, Redis, Pgvector, Qdrant, GKE, gRPC, HTTPS, mTLS, PySpark, Scala
Job PostingView all
3w
Save
Mark Applied
Hide
Principal Engineer - AI/ML
Frisco or San Jose or Newport Beach or New York or Toronto or Waterloo
$172k-$283k/yr HybridFull Time
McAfee
McAfee: Provides consumer cybersecurity, identity protection, and online privacy software.
10+ YOE10+ years software development experience with technical leadership; expertise in cloud-native architecture, agentic AI/ML, full-stack development, distributed systems, Kubernetes, and modern cloud platforms.
Python, Java, Go, Rust, C++, JavaScript, TypeScript, Dart, React, Flutter, gRPC, protobuf, AWS, Azure, GCP, Docker, Kubernetes, Helm, ArgoCD, Calico, OPA, Istio, Linkerd, eBPF, Cilium, Data Bricks, Snowflake, BigQuery, Spark, Hadoop, Kafka, GitHub Copilot, Claude Code, Claude, ChatGPT
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Machine Learning Engineer - USDS Shop Ads
Los Angeles, California, United States
$178k-$416k/yr OnsiteFull Time
TikTok USDS Joint Venture
TikTok USDS Joint Venture: Operates and secures TikTok services for U.S. users.
5+ YOEProficient in SQL and Python, experience with Hadoop/Spark, strong ML and data engineering skills, analytical problem-solving, and experience improving ad/recommendation systems.
SQL, Python, Hadoop, Spark
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Arden Hills or Valencia or Santa Clara
$107k-$203k/yr HybridFull Time, Contract
Boston Scientific
Boston ScientificNYSE: BSX: Developer and manufacturer of innovative medical devices and therapies.
13+ YOEBachelor's degree required; 13+ years data engineering experience including 6+ years designing cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise with AWS data services, Snowflake, Python, Terraform, Bash, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Apache Iceberg, Python, Terraform, Bash, Spark, Flink, Alation, Atlan, DataHub, Informatica, Databricks
Job PostingView all
4w
Save
Mark Applied
Hide
Software Engineer
Irving or San Francisco or Los Angeles
$74k-$137k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
2+ YOEB.S. in CS or related required; 2+ years Java experience; Unix and shell scripting; professional experience with Spring, Hibernate, Maven, Git; SQL and relational DB experience; Hadoop, Spark, Scala, Docker, Kubernetes, AWS are pluses.
Java, Unix, Unix Shell Scripts, Spring, Hibernate, Maven, Git, SQL, Hadoop, Spark, Scala, Docker, Kubernetes, AWS, HBase, Ansible, Postgres, Angular, HTML, JavaScript
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer, Prime Video - GSS Planning & Strategy
Culver City or Seattle
$132k-$179k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOEBachelor's degree, 3+ years data engineering, experience with Hadoop/Hive/Spark/EMR, SQL and Python, data modeling, ETL/ELT pipelines, BI tools (Tableau/QuickSight), and strong cross-team communication.
Hadoop, Hive, Spark, Amazon EMR, SQL, PL/SQL, DDL, HiveQL, SparkSQL, Scala, Python, Tableau, Amazon QuickSight, Informatica, Apache Airflow, ODI, SSIS, BODI, Datastage, Amazon S3, Amazon Redshift, Amazon SageMaker, Amazon Kinesis, AWS Lambda, Amazon EC2, R, SAS, Matlab
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer (Multiple Levels)
Alhambra or United States
$105k-$200k/yr RemoteFull Time
Astrana Health
Astrana HealthNASDAQ: ASTH: Operates technology-powered platforms to coordinate and deliver medical care.
2+ YOEBachelor's degree required; experience with relational databases, Python, Spark, SQL, Databricks, BI tools, cloud services (AWS/GCP/Azure), version control, and 2+ years in data/analytics landscape.
Python, Spark, SQL, Databricks, Tableau, Microsoft Power BI, Microsoft Excel, AWS, GCP, Azure
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Data Platform Engineer
Irvine, California, United States
$154k-$204k/yr HybridFull Time
Rivian and Volkswagen Group Technologies
Rivian and Volkswagen Group Technologies: A joint venture developing software, cloud, and connectivity solutions for next-generation electric vehicles.
3+ YOEBachelor's or Master's in CS/Data Science, 3+ years building large-scale data processing systems, Databricks and Terraform experience, cloud (AWS/GCP/Azure) familiarity, PySpark preferred, strong communication and problem-solving.
Databricks, Delta, Spark, Unity Catalog, Terraform, CI/CD, PySpark, Spark SQL, Spark Streaming, AWS, GCP, Azure, IAM, VPC, EC2, S3
Job PostingView all

Explore Jobs

Expand Your Job Search