HiringCafe
Join our community

150 spark engineer jobs at 67 companies in Pasadena, CA

1mo
Save
Mark Applied
Hide
Software Development Engineer II, AWS Analytics - Spark Engine
East Palo Alto or Los Angeles County
$165k-$224k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOE3+ years professional software development, 2+ years design/architecture experience, experience with large-scale distributed systems and object-oriented design, Bachelor's in CS/Engineering/Mathematics, programming in C#, C++, Java, or Perl.
EMR, Glue ETL, Athena, EKS, EC2, Serverless, Spark, AI, C#, C++, Java, Perl
Job PostingView all
1w
Save
Mark Applied
Hide
Senior AI Engineer
Irvine, California, United States
$90k-$150k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE5+ years software/data/AI engineering experience; hands-on AWS, Databricks/Apache Spark, graph databases, backend APIs, CI/CD; familiarity with LLM integrations and data governance.
AWS, Neptune, OpenSearch, DynamoDB, ElastiCache (Redis), IAM, CloudWatch, Databricks, Apache Spark, LangGraph, AutoGen, CrewAI, Java, Spring Boot, Node.js, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Glendale or San Francisco or New York
$142k-$199k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOEExperience building and operating large-scale data/ML systems, strong distributed systems fundamentals, streaming/batch technologies (Kafka, Kinesis, Spark, Flink), Python, plus working knowledge of Java/Scala/Go/C++, cloud-native (AWS, containers, Kubernetes, IaC), observability, and collaboration skills; Bachelor's or Master's required.
Kafka, Kinesis, Spark, Flink, Python, Java, Scala, Go, C++, AWS, Kubernetes, containers, IaC tools
Job PostingView all
1mo
Save
Mark Applied
Hide
Machine Learning Engineer 5 - Ads Inventory Management & Forecasting
Los Gatos or New York or Los Angeles
$466k-$750k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
Experience building end-to-end ML deployment and low-latency inference infra for real-time ad systems; handling large-scale data with Spark; forecasting ad metrics; building scalable simulations; cross-functional collaboration.
Spark, Lucene, VAST, OpenRTB, SSP, DSP
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles, California, United States
$185k-$208k/yr RemoteFull Time
VideoAmp
VideoAmp: Software and data for cross-platform advertising measurement and optimization.
5+ YOEBachelor's in CS/CE/Math or related and 5+ years in data engineering/production software; strong SQL and Python; experience with Snowflake, Spark, Databricks, Airflow, Git, CircleCI, and Bazel.
SQL, Python, Snowflake, Spark, Databricks, Airflow, Git, Jira, CircleCI, Bazel
Job PostingView all
2mo
Save
Mark Applied
Hide
Software Engineer (Backend, Python) - Content Understanding
San Francisco or Atlanta or Austin or Boston or Chicago or Dallas or Denver or Houston or Jacksonville or Los Angeles or Miami or New York City or Phoenix or Portland or Sacramento or Salt Lake City or San Diego or Seattle or Washington, D.C. or Ottawa or Toronto or Vancouver or Mexico City
HybridFull Time
Scribd
Scribd: Subscription-based digital library for e-books, audiobooks, and documents.
4+ YOE4+ years in software engineering; Python/Scala/Ruby; distributed systems; AWS; Terraform; Spark/Databricks; CS degree.
Python, Scala, Ruby, Airflow, Databricks, Spark, AWS, Terraform
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Engineer
Irvine, California, United States
$150k-$170k/yr HybridFull Time
Commercial Bank of California: A private business bank providing personalized financial and lending services
10+ YOE10+ years in data engineering/analytics, BA or BS (Master’s preferred); strong SQL, Python/Spark; deep MS Fabric, Azure Databricks, Unity Catalog, Power BI experience; CI/CD and data governance focus.
Microsoft Fabric, Azure Databricks, Unity Catalog, Power BI, Azure Data Lake, Azure Synapse, Databricks, SQL, Python, Spark, Azure DevOps, Snowflake
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica, California, United States
$142k-$190k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOE5+ years data engineering experience building large data pipelines; strong SQL, Python/PySpark; experience with Snowflake/Redshift, Databricks, Spark, Airflow, AWS; data modeling and performance tuning; Bachelor's degree or equivalent.
AWS, Databricks, Snowflake, Spark, Airflow, Python, PySpark, SQL, Redshift, EMR
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Costa Mesa, California, United States
$166k-$220k/yr OnsiteFull Time
Anduril Industries
Anduril Industries: Defense technology building autonomous military hardware and software.
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
Palantir Foundry, SQLMesh, Athena, Apache Iceberg, Flyte, Python, Spark, PySpark, SQL, dbt, AWS, Azure, GCP, Tableau
Job PostingView all
3d
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
Versant
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
Job PostingView all
6d
Save
Mark Applied
Hide
Data Platform Engineer, Infrastructure
Irvine, California, United States
OnsiteFull Time
Field AI
Field AI: Develops autonomous software brains for robots in unstructured environments.
3+ YOE3+ years infrastructure/platform experience, bachelor's or master's in CS/Engineering, cloud (AWS/GCP), Kubernetes, Terraform, Python/Go, production operations, security and cost management experience.
Kubernetes, Terraform, Python, Go, AWS, GCP, Spark, Databricks, GitOps, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Data Platform Engineer
New York or Los Angeles or San Francisco
$190k-$240k/yr HybridFull Time
Tatari
Tatari: A platform for buying and measuring TV advertising campaigns.
3+ YOE3+ years cloud infrastructure/SRE/platform engineering; strong operational discipline; experience with HA architectures, workflow orchestration, Linux scripting, containers, distributed processing, streaming, IaC, observability, and managed data platforms.
AWS, GCP, Azure, Airflow, Bash, Python, Spark, PySpark, Kubernetes, Docker, Kafka, Flink, Terraform, Helm, ClickHouse, Postgres, Redshift, Datadog, Prometheus, Kibana, Databricks
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Temporary
Boston Scientific
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
13+ YOEBachelor's in CS or related, 13+ years data engineering with 6+ years building AWS cloud-native data platforms; expertise with AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer / Analyst - USA
New York City or Miami or Mountain View or Los Angeles or Chicago or Seattle or Dallas or United States
$122k-$162k/yr HybridFull Time
Cognify Analytics
Cognify Analytics: Independent analytics firm focused on data-driven solutions.
5+ YOE5–8+ years data engineering/analytics delivery; SQL, Snowflake/Databricks, dbt, Python, Spark; data governance; client collaboration.
Snowflake, Databricks, dbt, Python, Pandas, PySpark, Spark, Airflow, Dagster, Kafka, Kinesis, Tableau, Looker, Power BI, Sigma Computing, SQL, Data Governance, Alation, Atlan, DataHub, Unity Catalog
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal Software Engineer, AI Platform Engineering
El Segundo, California, United States
HybridFull Time
Saviynt
Saviynt: Provides AI-powered identity governance and cloud security platforms.
8+ YOE8+ years of data engineering at production scale; end-to-end data lake ownership; experience with Spark/Dataflow/Beam; strong in data governance and multi-tenant architectures.
GCS, Dataproc, Spark, Iceberg, Delta Lake, Beam, Dataflow, Flyte, Kubeflow Pipelines, Airflow, Prefect, Protobuf, Avro, dbt, Great Expectations, Feast, Tecton, S3, Redis, Pgvector, Qdrant, GKE, gRPC, HTTPS, mTLS, PySpark, Scala
Job PostingView all
2w
Save
Mark Applied
Hide
Principal Engineer - AI/ML
Frisco or San Jose or Newport Beach or New York or Toronto or Waterloo
$172k-$283k/yr HybridFull Time
McAfee
McAfee: Provides consumer cybersecurity, identity protection, and online privacy software.
10+ YOE10+ years software development experience with technical leadership; expertise in cloud-native architecture, agentic AI/ML, full-stack development, distributed systems, Kubernetes, and modern cloud platforms.
Python, Java, Go, Rust, C++, JavaScript, TypeScript, Dart, React, Flutter, gRPC, protobuf, AWS, Azure, GCP, Docker, Kubernetes, Helm, ArgoCD, Calico, OPA, Istio, Linkerd, eBPF, Cilium, Data Bricks, Snowflake, BigQuery, Spark, Hadoop, Kafka, GitHub Copilot, Claude Code, Claude, ChatGPT
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal Data Engineer, Personalization - Publishing Platform
Los Angeles, California, United States
$210k-$293k/yr OnsiteFull Time
Riot Games
Riot Games: Developing and publishing competitive multiplayer video games.
8+ YOE8+ years in data engineering and tech-focused publishing/marketing; strong big-data, Python, Go, Spark, SQL; cloud and Databricks; cross-functional collaboration; mentoring.
Python, Go, Spark, Scala, SQL, Airflow, dbt, AWS, GCP, Databricks
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Arden Hills or Valencia or Santa Clara
$107k-$203k/yr HybridFull Time, Contract
Boston Scientific
Boston ScientificNYSE: BSX: Developer and manufacturer of innovative medical devices and therapies.
13+ YOEBachelor's degree required; 13+ years data engineering experience including 6+ years designing cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise with AWS data services, Snowflake, Python, Terraform, Bash, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Apache Iceberg, Python, Terraform, Bash, Spark, Flink, Alation, Atlan, DataHub, Informatica, Databricks
Job PostingView all
3w
Save
Mark Applied
Hide
Software Engineer
Irving or San Francisco or Los Angeles
$74k-$137k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
2+ YOEB.S. in CS or related required; 2+ years Java experience; Unix and shell scripting; professional experience with Spring, Hibernate, Maven, Git; SQL and relational DB experience; Hadoop, Spark, Scala, Docker, Kubernetes, AWS are pluses.
Java, Unix, Unix Shell Scripts, Spring, Hibernate, Maven, Git, SQL, Hadoop, Spark, Scala, Docker, Kubernetes, AWS, HBase, Ansible, Postgres, Angular, HTML, JavaScript
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
Irvine, California, United States
$87k-$123k/yr OnsiteFull Time
Edwards Lifesciences
Edwards LifesciencesNYSE: EW: Designs and manufactures medical devices for structural heart disease.
Bachelor's degree in a related field plus hands-on Databricks, Apache Spark, SQL, and Python experience; strong data engineering, CI/CD, cloud, governance, and PHI handling skills.
Databricks Lakehouse Platform, Databricks, Databricks Workflows, Databricks Repos, Databricks Jobs, Apache Spark, PySpark, Scala, SQL, Python, Delta Lake, Great Expectations, Deequ, Azure DevOps, GitHub Actions, GitLab CI, Git, AWS EC2, AWS S3, AWS Lambda, Azure, GCP
Job PostingView all

Explore Jobs

Expand Your Job Search