HiringCafe
Join our community

101 spark data engineer jobs at 44 companies in Palmdale, CA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
1d
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles, California, United States
$110k-$244k/yr HybridFull Time
UCLA Health
UCLA Health: Provides comprehensive hospital services and academic medical research.
5+ YOE5+ years data engineering experience; strong Python and SQL; experience with Databricks, Spark, data lakehouse, ETL/ELT, cloud platforms; bachelor's degree in a technical field.
Python, SQL Server, Oracle, PostgreSQL, Databricks, Spark, Delta Lake, Snowflake, Microsoft Fabric, Synapse, Azure, AWS, GCP, Azure Data Factory, Databricks Workflows, Airflow, MLflow, Git
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
Versant
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica, California, United States
$142k-$190k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOE5+ years data engineering experience building large data pipelines; strong SQL, Python/PySpark; experience with Snowflake/Redshift, Databricks, Spark, Airflow, AWS; data modeling and performance tuning; Bachelor's degree or equivalent.
AWS, Databricks, Snowflake, Spark, Airflow, Python, PySpark, SQL, Redshift, EMR
Job PostingView all
2w
Save
Mark Applied
Hide
Sr Data Engineer
Glendale or San Francisco
$139k-$186k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOE5+ years data engineering experience (1+ year senior/lead), strong Python/Java/SQL, streaming pipeline experience (Kafka/Flink/Spark/Kinesis), embedding/vector store experience, workflow orchestration, and data architecture skills.
Python, Java, SQL, Kafka, Flink, Spark, Kinesis, Pinecone, Weaviate, FAISS, pgvector, Airflow, Dagster, Databricks, LangChain, LangGraph, S3, Glue, MWAA, Datadog, Prometheus
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Temporary
Boston Scientific
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
13+ YOEBachelor's in CS or related, 13+ years data engineering with 6+ years building AWS cloud-native data platforms; expertise with AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Arden Hills or Valencia or Santa Clara
$107k-$203k/yr HybridFull Time, Contract
Boston Scientific
Boston ScientificNYSE: BSX: Developer and manufacturer of innovative medical devices and therapies.
13+ YOEBachelor's degree required; 13+ years data engineering experience including 6+ years designing cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise with AWS data services, Snowflake, Python, Terraform, Bash, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Apache Iceberg, Python, Terraform, Bash, Spark, Flink, Alation, Atlan, DataHub, Informatica, Databricks
Job PostingView all
1d
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or San Francisco
$170k-$200k/yr HybridFull Time
Tatari
Tatari: A platform for buying and measuring TV advertising campaigns.
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer Data Pipelines and ETL
Burbank, California, United States
$100k-$147k/yr OnsiteFull Time
Paramount
ParamountNASDAQ: PSKY: Produces and distributes media content across global entertainment platforms.
2+ YOE2+ years building ETL/ELT pipelines, strong SQL and Python, experience with Airflow, Spark, Kafka/Pub-Sub, cloud-native (GCP preferred), data modeling, and observability for analytics/ML.
Airflow, Composer, SQL, Python, Spark, Vertex AI, Databricks ML, Kafka, Pub/Sub, Superset, GCP
Job PostingView all
1d
Save
Mark Applied
Hide
Data Engineer
Santa Barbara or Atlanta or Chicago or Agoura Hills
HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
3+ YOE3+ years data engineering experience with Python, SQL, cloud data platforms (Databricks,AWS,Snowflake,Google Cloud); familiarity with AI/automation tools and modern lakehouse architectures.
Python, PySpark, SQL, Spark, Claude Code, Codex, GitHub Copilot, Databricks Genie, Databricks, AWS, Snowflake, Google Cloud, SFTP, APIs
Job PostingView all
1d
Save
Mark Applied
Hide
Data Engineer
Santa Barbara or Atlanta or Chicago or Agoura Hills
HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
3+ YOE3–5 years in data/analytics engineering, strong SQL and Python, experience with Databricks/AWS/Snowflake/Google Cloud, familiarity with AI-assisted development and data ingestion frameworks.
Databricks, AWS, Snowflake, Google Cloud, GitHub Copilot, Claude Code, Codex, Databricks Genie, Python, PySpark, SQL, Spark, SFTP, APIs, CI/CD
Job PostingView all
8h
Save
Mark Applied
Hide
Senior Data Engineer
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer / Analyst - USA
New York City or Miami or Mountain View or Los Angeles or Chicago or Seattle or Dallas or United States
$122k-$162k/yr HybridFull Time
Cognify Analytics
Cognify Analytics: Independent analytics firm focused on data-driven solutions.
5+ YOE5–8+ years data engineering/analytics delivery; SQL, Snowflake/Databricks, dbt, Python, Spark; data governance; client collaboration.
Snowflake, Databricks, dbt, Python, Pandas, PySpark, Spark, Airflow, Dagster, Kafka, Kinesis, Tableau, Looker, Power BI, Sigma Computing, SQL, Data Governance, Alation, Atlan, DataHub, Unity Catalog
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer (Multiple Levels)
Alhambra or United States
$105k-$200k/yr RemoteFull Time
Astrana Health
Astrana HealthNASDAQ: ASTH: Operates technology-powered platforms to coordinate and deliver medical care.
2+ YOEBachelor's degree required; experience with relational databases, Python, Spark, SQL, Databricks, BI tools, cloud services (AWS/GCP/Azure), version control, and 2+ years in data/analytics landscape.
Python, Spark, SQL, Databricks, Tableau, Microsoft Power BI, Microsoft Excel, AWS, GCP, Azure
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer, Prime Video - GSS Planning & Strategy
Culver City or Seattle
$132k-$179k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOEBachelor's degree, 3+ years data engineering, experience with Hadoop/Hive/Spark/EMR, SQL and Python, data modeling, ETL/ELT pipelines, BI tools (Tableau/QuickSight), and strong cross-team communication.
Hadoop, Hive, Spark, Amazon EMR, SQL, PL/SQL, DDL, HiveQL, SparkSQL, Scala, Python, Tableau, Amazon QuickSight, Informatica, Apache Airflow, ODI, SSIS, BODI, Datastage, Amazon S3, Amazon Redshift, Amazon SageMaker, Amazon Kinesis, AWS Lambda, Amazon EC2, R, SAS, Matlab
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Seattle or Chicago or Los Angeles or New York
$160k-$220k/yr OnsiteFull Time
Metropolis
Metropolis: Computer vision technology for checkout-free parking and retail payments.
5+ YOEBachelor's in CS/Engineering; 5+ years in data engineering; Python; SQL; Snowflake/dbt; AWS; ETL/ELT; on-site 4 days/week.
Python, SQL, Snowflake, dbt, Airflow, MWAA, DMS, EKS, SNS, Glue, AWS, MySQL, MS SQL Server, Postgres, Spark, PySpark, Automic, CI/CD, ETL/ELT
Job PostingView all
1mo
Save
Mark Applied
Hide
LA Kings - Sr. Data Engineer
El Segundo, California, United States
$112k-$135k/yr OnsiteFull Time
AEG Worldwide
AEG Worldwide: Operates live entertainment venues and professional sports franchises worldwide.
4+ YOE4+ years building scalable data warehouses and ELT pipelines; expert SQL, Python, Spark; experience with Databricks, infrastructure as code, and git; strong communication and mentoring skills.
SQL, Python, Spark, Databricks, ELT, Infrastructure as code, git
Job PostingView all
20h
Save
Mark Applied
Hide
Associate Data Engineer
Los Angeles, California, United States
$75k-$90k/yr OnsiteFull Time
Cosm
Cosm: Operates immersive entertainment venues and develops shared reality technology.
0+ YOE0-2 years building data systems; experience with Apache Spark, Databricks, AWS; Bachelor's in CS or related or equivalent experience preferred; strong communication and critical thinking.
Databricks, AWS, Apache Spark, Python, SQL, PostHog, Mixpanel
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
Berkeley or Los Angeles
$111k-$166k/yr HybridFull Time
PBK
PBK: Provides architectural and engineering design for specialized facilities.
5+ YOE5+ years building production data pipelines and integrations; strong SQL (PostgreSQL), Python, Microsoft Azure and Microsoft Fabric experience; API and data governance knowledge; Bachelor's degree or equivalent experience.
Salesforce, Deltek Vantagepoint, Autodesk Forma, Microsoft Azure, Microsoft Fabric, Microsoft Fabric Data Pipelines, Microsoft Fabric notebooks, Microsoft Azure Data Factory, Microsoft Azure Logic Apps, Microsoft Azure Functions, Microsoft Azure Event Grid, Microsoft Azure Service Bus, Databricks, Snowflake, dbt, Apache Spark, Spark, Apache Kafka, MuleSoft, Microsoft 365, Microsoft Power BI, GitHub Enterprise, Microsoft Azure DevOps, REST, JSON, SOAP, PostgreSQL, Python, Apache Airflow
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer (Valencia, CA, US, 91355)
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Contract
Boston Scientific
Boston ScientificNYSE: BSX: Developing and manufacturing innovative medical devices for less-invasive treatments.
13+ YOEBachelor's degree required; 13+ years data engineering experience with 6+ years building cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise in AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD, IAM
Job PostingView all
3mo
Save
Mark Applied
Hide
Sr. Data Engineer Specialist
Brea, California, United States
$80k-$95k/yr OnsiteFull Time
Samyang America
Samyang America: Distributes and markets instant noodles and packaged food products.
3+ YOE3–6+ years in data engineering; SQL and Python; ETL/ELT pipelines; cloud platforms; data pipelines and analytics experience.
SQL, Python, ETL/ELT, Airflow, dbt, Spark, Snowflake, Databricks, AWS, Azure, GCP
Job PostingView all

Explore Jobs

Expand Your Job Search