HiringCafe
Join our community

91 spark engineer jobs at 37 companies in Lancaster, CA

1d
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or San Francisco
$170k-$200k/yr HybridFull Time
Tatari
Tatari: A platform for buying and measuring TV advertising campaigns.
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Glendale or San Francisco or New York
$142k-$199k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOEExperience building and operating large-scale data/ML systems, strong distributed systems fundamentals, streaming/batch technologies (Kafka, Kinesis, Spark, Flink), Python, plus working knowledge of Java/Scala/Go/C++, cloud-native (AWS, containers, Kubernetes, IaC), observability, and collaboration skills; Bachelor's or Master's required.
Kafka, Kinesis, Spark, Flink, Python, Java, Scala, Go, C++, AWS, Kubernetes, containers, IaC tools
Job PostingView all
1mo
Save
Mark Applied
Hide
Machine Learning Engineer 5 - Ads Inventory Management & Forecasting
Los Gatos or New York or Los Angeles
$466k-$750k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
Experience building end-to-end ML deployment and low-latency inference infra for real-time ad systems; handling large-scale data with Spark; forecasting ad metrics; building scalable simulations; cross-functional collaboration.
Spark, Lucene, VAST, OpenRTB, SSP, DSP
Job PostingView all
1d
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles, California, United States
$110k-$244k/yr HybridFull Time
UCLA Health
UCLA Health: Provides comprehensive hospital services and academic medical research.
5+ YOE5+ years data engineering experience; strong Python and SQL; experience with Databricks, Spark, data lakehouse, ETL/ELT, cloud platforms; bachelor's degree in a technical field.
Python, SQL Server, Oracle, PostgreSQL, Databricks, Spark, Delta Lake, Snowflake, Microsoft Fabric, Synapse, Azure, AWS, GCP, Azure Data Factory, Databricks Workflows, Airflow, MLflow, Git
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
Versant
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Glendale or San Francisco or Seattle
$139k-$204k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOE5+ years data engineering experience (1+ year senior/lead), building streaming and batch pipelines, strong Python/Java/SQL, experience with Kafka/Flink/Spark/Kinesis, embedding/vector stores and orchestration tools, bachelor's in CS or equivalent.
Python, Java, SQL, Kafka, Flink, Spark, Kinesis, Pinecone, Weaviate, FAISS, pgvector, Airflow, Dagster, LangChain, LangGraph, Datadog, Prometheus, Databricks, S3, Glue, MWAA
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Temporary
Boston Scientific
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
13+ YOEBachelor's in CS or related, 13+ years data engineering with 6+ years building AWS cloud-native data platforms; expertise with AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer / Analyst - USA
New York City or Miami or Mountain View or Los Angeles or Chicago or Seattle or Dallas or United States
$122k-$162k/yr HybridFull Time
Cognify Analytics
Cognify Analytics: Independent analytics firm focused on data-driven solutions.
5+ YOE5–8+ years data engineering/analytics delivery; SQL, Snowflake/Databricks, dbt, Python, Spark; data governance; client collaboration.
Snowflake, Databricks, dbt, Python, Pandas, PySpark, Spark, Airflow, Dagster, Kafka, Kinesis, Tableau, Looker, Power BI, Sigma Computing, SQL, Data Governance, Alation, Atlan, DataHub, Unity Catalog
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Machine Learning Engineer - USDS Shop Ads
Los Angeles, California, United States
$178k-$416k/yr OnsiteFull Time
TikTok USDS Joint Venture
TikTok USDS Joint Venture: Operates and secures TikTok services for U.S. users.
5+ YOEProficient in SQL and Python, experience with Hadoop/Spark, strong ML and data engineering skills, analytical problem-solving, and experience improving ad/recommendation systems.
SQL, Python, Hadoop, Spark
Job PostingView all
2d
Save
Mark Applied
Hide
Data Engineer, Payments
San Francisco or New York City or Los Angeles or Seattle
$180k-$260k/yr HybridFull Time
Whatnot
Whatnot: Social marketplace for buying and selling via live streams
3+ YOE3+ years building data warehouses or distributed/event-driven systems; expertise in data modeling, pipelines, observability, cloud warehouses, Python/SQL; experience with payments/finance stakeholders.
Kafka, Debezium, dbt, Spark, Flink, Dagster, Airflow, Monte Carlo, Great Expectations, Snowflake, BigQuery, Redshift, Python, SQL, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Arden Hills or Valencia or Santa Clara
$107k-$203k/yr HybridFull Time, Contract
Boston Scientific
Boston ScientificNYSE: BSX: Developer and manufacturer of innovative medical devices and therapies.
13+ YOEBachelor's degree required; 13+ years data engineering experience including 6+ years designing cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise with AWS data services, Snowflake, Python, Terraform, Bash, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Apache Iceberg, Python, Terraform, Bash, Spark, Flink, Alation, Atlan, DataHub, Informatica, Databricks
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer
Irving or San Francisco or Los Angeles
$74k-$137k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
2+ YOEB.S. in CS or related required; 2+ years Java experience; Unix and shell scripting; professional experience with Spring, Hibernate, Maven, Git; SQL and relational DB experience; Hadoop, Spark, Scala, Docker, Kubernetes, AWS are pluses.
Java, Unix, Unix Shell Scripts, Spring, Hibernate, Maven, Git, SQL, Hadoop, Spark, Scala, Docker, Kubernetes, AWS, HBase, Ansible, Postgres, Angular, HTML, JavaScript
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer, Prime Video - GSS Planning & Strategy
Culver City or Seattle
$132k-$179k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOEBachelor's degree, 3+ years data engineering, experience with Hadoop/Hive/Spark/EMR, SQL and Python, data modeling, ETL/ELT pipelines, BI tools (Tableau/QuickSight), and strong cross-team communication.
Hadoop, Hive, Spark, Amazon EMR, SQL, PL/SQL, DDL, HiveQL, SparkSQL, Scala, Python, Tableau, Amazon QuickSight, Informatica, Apache Airflow, ODI, SSIS, BODI, Datastage, Amazon S3, Amazon Redshift, Amazon SageMaker, Amazon Kinesis, AWS Lambda, Amazon EC2, R, SAS, Matlab
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer (Multiple Levels)
Alhambra or United States
$105k-$200k/yr RemoteFull Time
Astrana Health
Astrana HealthNASDAQ: ASTH: Operates technology-powered platforms to coordinate and deliver medical care.
2+ YOEBachelor's degree required; experience with relational databases, Python, Spark, SQL, Databricks, BI tools, cloud services (AWS/GCP/Azure), version control, and 2+ years in data/analytics landscape.
Python, Spark, SQL, Databricks, Tableau, Microsoft Power BI, Microsoft Excel, AWS, GCP, Azure
Job PostingView all
3mo
Save
Mark Applied
Hide
Databricks Engineer
Atlanta or Austin or Boston or Charlotte or Chicago or Dallas or Denver or Detroit or Hartford or Houston or Los Angeles or Miami or Nashville or New Brunswick or New York or Raleigh or Seattle or Tampa or Washington
$90k-$147k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
5+ YOE5+ years data engineering experience, 2+ years building Databricks pipelines and platform features; proficiency with Spark, SQL, Python/Java, EMR/Redshift/Snowflake/BigQuery, orchestration (Airflow/dbt), and data quality tools.
Databricks, Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), Unity Catalog, Auto Loader, Airflow, dbt, Great Expectations, Collibra, Apache Spark, Presto, Amazon EMR, Amazon Redshift, Snowflake, Google BigQuery, SQL, Stored Procedures, Java, Python, PySpark, Databricks Asset Bundles, Terraform, NoSQL Databases, Container Management Systems, GitHub Copilot, Codex, Claude, Cursor, Windsurf
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer Data Pipelines and ETL (Burbank, CA, US, 91505)
Burbank, California, United States
$99k-$147k/yr OnsiteFull Time
Paramount
ParamountNASDAQ: PSKY: Produces and distributes media content across global entertainment platforms.
2+ YOEBuild and maintain scalable ETL/ELT and streaming pipelines; strong SQL, Python, Spark, Airflow; experience with Kafka/Pub‑Sub, cloud data architectures (GCP preferred); 2+ years data engineering and a relevant degree.
Airflow, Composer, SQL, Python, Spark, Vertex AI, Databricks ML, Kafka, Pub/Sub, Superset, GCP
Job PostingView all
2mo
Save
Mark Applied
Hide
Software Engineer 4 - Revenue Infrastructure
Los Gatos or Los Angeles or Seattle
$250k-$413k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Global video streaming and media production service.
3+ YOEBS/MS in Computer Science or equivalent; strong data structures, distributed processing, JVM languages; APIs (gRPC, GraphQL, REST); Kafka, Spark/Flink; scalable, secure distributed systems.
Java, Scala, GraalVM, gRPC, GraphQL, REST, Kafka, Spark, Flink, Distributed Systems
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer (Valencia, CA, US, 91355)
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Contract
Boston Scientific
Boston ScientificNYSE: BSX: Developing and manufacturing innovative medical devices for less-invasive treatments.
13+ YOEBachelor's degree required; 13+ years data engineering experience with 6+ years building cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise in AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD, IAM
Job PostingView all
3w
Save
Mark Applied
Hide
Machine Learning Engineer, Senior Manager
Southfield or San Francisco or Seattle or Boston or New York City or Los Angeles or San Diego or United States
$184k-$270k/yr RemoteFull Time
Credit Acceptance
Credit AcceptanceNASDAQ: CACC: Provides vehicle financing programs for subprime credit consumers.
8+ YOEPhD (8+ yrs) or MS (10+ yrs) in a relevant technical field; 8+ years designing, building, and deploying ML/DL/Gen-AI models; hands-on experience with production ML/LLM ops, scalable systems, and leading technical teams.
Kubeflow, DVC, Ray, gRPC, GraphQL, Databricks MLflow, Databricks Model Serving, MLflow, Apache Airflow, Spark, Flink, Kafka, Kinesis, Snowflake, Databricks, XGBoost, Transformers
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Seattle or Chicago or Los Angeles or New York
$160k-$220k/yr OnsiteFull Time
Metropolis
Metropolis: Computer vision technology for checkout-free parking and retail payments.
5+ YOEBachelor's in CS/Engineering; 5+ years in data engineering; Python; SQL; Snowflake/dbt; AWS; ETL/ELT; on-site 4 days/week.
Python, SQL, Snowflake, dbt, Airflow, MWAA, DMS, EKS, SNS, Glue, AWS, MySQL, MS SQL Server, Postgres, Spark, PySpark, Automic, CI/CD, ETL/ELT
Job PostingView all

Explore Jobs

Expand Your Job Search