HiringCafe
Join our community

97 spark data engineer jobs at 50 companies in Lake Forest, CA

2w
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles, California, United States
$110k-$244k/yr HybridFull Time
UCLA Health
UCLA Health: Provides comprehensive hospital services and academic medical research.
5+ YOE5+ years data engineering experience; strong Python and SQL; experience with Databricks, Spark, data lakehouse, ETL/ELT, cloud platforms; bachelor's degree in a technical field.
Python, SQL Server, Oracle, PostgreSQL, Databricks, Spark, Delta Lake, Snowflake, Microsoft Fabric, Synapse, Azure, AWS, GCP, Azure Data Factory, Databricks Workflows, Airflow, MLflow, Git
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Costa Mesa, California, United States
$166k-$220k/yr OnsiteFull Time
Anduril Industries
Anduril Industries: Defense technology building autonomous military hardware and software.
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
Palantir Foundry, SQLMesh, Athena, Apache Iceberg, Flyte, Python, Spark, PySpark, SQL, dbt, AWS, Azure, GCP, Tableau
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or Foster City or Orange County or Morristown
RemoteFull Time
Bridgepointe Technologies
Bridgepointe Technologies: Vendor-agnostic IT strategy and technology procurement services.
5+ YOERequires 5+ years in data engineering, advanced SQL, Python, Spark/PySpark, Microsoft Fabric, Azure data services, APIs, data modeling, CI/CD, Git, and Azure DevOps; bachelor's degree or equivalent experience.
Microsoft Fabric, Lakehouse, Warehouse, Data Pipelines, Notebooks, OneLake, Git, Azure DevOps, Spark, PySpark, SQL, Python, Azure, Delta Lake, Parquet, REST APIs, JSON, Power BI, DP-600, DP-700
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or San Francisco
$170k-$200k/yr HybridFull Time
Tatari
Tatari: A platform for buying and measuring TV advertising campaigns.
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
Job PostingView all
2d
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
K&L Gates
K&L Gates: Global law firm providing comprehensive legal and regulatory counsel.
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Carlsbad, California, United States
HybridFull Time
NTENT
NTENT: Develops semantic search and natural language processing technology platforms.
3+ YOEThree+ years in data engineering or data warehousing; SQL Server with T-SQL; Hadoop ecosystem; Python; data modeling and visualization.
T-SQL, Microsoft SQL Server, Hadoop, Hive, Pig, Oozie, Python, Tableau, Kafka, Spark
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Data Engineer - MSS
Irvine, California, United States
$110k-$140k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOEHands-on experience with Databricks, dbt, Python, PySpark, Spark, and SQL; 6+ years experience; proven track record in data platform migration to Databricks Lakehouse; leadership and mentoring experience.
Databricks, dbt, Python, PySpark, Spark, SQL, Delta Lake, Unity Catalog, Databricks Workflows, Structured Streaming, Medallion Architecture, Airflow, EBT
Job PostingView all
3d
Save
Mark Applied
Hide
Security Data Solutions Engineer
Quincy or Princeton or Irvine or Boston or Austin or Sacramento
$120k-$203k/yr HybridFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
8+ YOEDesign and implement enterprise security telemetry and data products; 8+ years in cybersecurity/data engineering; strong Python, SQL, Spark, Databricks, Snowflake, SIEM experience; product management skills.
Splunk, Microsoft Sentinel, QRadar, Elastic, Chronicle, Databricks, Snowflake, Kafka, Spark, Cribl, OpenTelemetry, FluentBit, Python, SQL, AWS, Azure, Google Cloud
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer (Multiple Levels)
Alhambra or United States
$105k-$200k/yr RemoteFull Time
Astrana Health
Astrana HealthNASDAQ: ASTH: Operates technology-powered platforms to coordinate and deliver medical care.
2+ YOEBachelor's degree required; experience with relational databases, Python, Spark, SQL, Databricks, BI tools, cloud services (AWS/GCP/Azure), version control, and 2+ years in data/analytics landscape.
Python, Spark, SQL, Databricks, Tableau, Microsoft Power BI, Microsoft Excel, AWS, GCP, Azure
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
Cotality
Cotality: Provides property data, analytics, and workflow intelligence solutions.
7+ YOE7+ years IT experience, bachelor's in CS/Engineering or equivalent, expertise in cloud data platforms, Python/PySpark, data modeling, big data technologies, graph DBs, orchestration tools, and enterprise data architecture.
AWS, Google Cloud Platform (GCP), Python, PySpark, Neo4j, Google Spanner, Hadoop, Spark, Elasticsearch, Google Cloud Dataflow, Apache Beam, Apache Airflow, BMAD, Spec Kit, SQL, NoSQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer, Prime Video - GSS Planning & Strategy
Culver City or Seattle
$132k-$179k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOEBachelor's degree, 3+ years data engineering, experience with Hadoop/Hive/Spark/EMR, SQL and Python, data modeling, ETL/ELT pipelines, BI tools (Tableau/QuickSight), and strong cross-team communication.
Hadoop, Hive, Spark, Amazon EMR, SQL, PL/SQL, DDL, HiveQL, SparkSQL, Scala, Python, Tableau, Amazon QuickSight, Informatica, Apache Airflow, ODI, SSIS, BODI, Datastage, Amazon S3, Amazon Redshift, Amazon SageMaker, Amazon Kinesis, AWS Lambda, Amazon EC2, R, SAS, Matlab
Job PostingView all
1mo
Save
Mark Applied
Hide
LA Kings - Sr. Data Engineer
El Segundo, California, United States
$112k-$135k/yr OnsiteFull Time
AEG Worldwide
AEG Worldwide: Operates live entertainment venues and professional sports franchises worldwide.
4+ YOE4+ years building scalable data warehouses and ELT pipelines; expert SQL, Python, Spark; experience with Databricks, infrastructure as code, and git; strong communication and mentoring skills.
SQL, Python, Spark, Databricks, ELT, Infrastructure as code, git
Job PostingView all
10h
Save
Mark Applied
Hide
Copy of Senior Data Engineer
Pasadena, California, United States
$143k-$175k/yr RemoteFull Time
Spokeo
Spokeo: People search engine that aggregates public records and data.
7+ YOE7+ years in production data engineering; 5+ years with AWS, EMR, Python, Spark, SQL, data modeling, and Airflow; 2+ years with non-relational databases; bachelor's degree required.
Amazon Web Services (AWS), Apache Airflow, PySpark, Apache Spark, Amazon EMR, Amazon S3, Amazon DynamoDB, Elasticsearch, Python, SQL
Job PostingView all
2w
Save
Mark Applied
Hide
Associate Data Engineer
Los Angeles, California, United States
$75k-$90k/yr OnsiteFull Time
Cosm
Cosm: Operates immersive entertainment venues and develops shared reality technology.
0+ YOE0-2 years building data systems; experience with Apache Spark, Databricks, AWS; Bachelor's in CS or related or equivalent experience preferred; strong communication and critical thinking.
Databricks, AWS, Apache Spark, Python, SQL, PostHog, Mixpanel
Job PostingView all
1w
Save
Mark Applied
Hide
Principal Data Engineer, Personalization - Central Product Insights
Los Angeles, California, United States
$210k-$293k/yr OnsiteFull Time
Riot Games
Riot Games: Developing and publishing competitive multiplayer video games.
8+ YOEBachelor's degree in CS or related,8+ years data engineering experience in publishing/marketing,expertise with Python,GoLang,Spark,Scala,SQL,Airflow,dbt,cloud (AWS/GCP),Databricks,mentoring and cross-functional collaboration.
Python, GoLang, Spark, Scala, SQL, Airflow, dbt, AWS, GCP, Databricks
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer III, Development
Carlsbad, California, United States
$181k-$186k/yr OnsiteFull Time
Thermo Fisher Scientific
Thermo Fisher ScientificNYSE: TMO: Sells equipment and chemicals for scientific research and healthcare.
4+ YOEMaster's in CS/IS (or Bachelor's +6 yrs); minimum 4 years as a Database Administrator or Data Engineer; experience with Databricks, Data lake/Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elasticsearch, Lambda, S3, RDS, MongoDB, DynamoDB, PySpark, Python, SQL, Git, Jenkins, Informatica, TCL/Unix shell, and Sybase.
Databricks, Data lake, Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elastic Search, Lambda, S3, Redshift, RDS, MongoDB, DynamoDB, PySpark, Python, Git, Jenkins, Informatica, TCL, Unix shell script, SQL, Sybase
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Los Angeles, California, United States
$130k-$170k/yr HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
6+ YOE2+ MgmtLead data engineering role requiring 6-8 years of experience, Databricks stack, SQL, Python, PySpark, data warehousing, Airflow, cloud platforms, and leadership responsibilities.
Databricks, SQL, Python, PySpark, Airflow, Cron, AWS, GCP, Azure, Tableau, Power BI, Hadoop, Hive, HBase, Pig, Spark
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yr RemoteFull Time
SentiLink
SentiLink: Provides identity verification and fraud prevention for financial institutions.
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Python, Golang, PostgreSQL (RDS), OpenSearch, Redshift, EMR, Spark, Docker, Lambda, AWS, EKS, SQS, SNS, S3, Kubernetes, Hadoop, Kafka, Microsoft Azure, GCP
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer, CX
San Francisco or New York City or Los Angeles or Seattle
$180k-$260k/yr RemoteFull Time
Whatnot
Whatnot: Social marketplace for buying and selling via live streams
5+ YOE5+ years building data warehouses or distributed/event-driven systems; skilled with data modeling, modern data tooling, cloud warehouses, Python/SQL, and cross-functional partnership.
Kafka, Debezium, dbt, Spark, Flink, Dagster, Airflow, Monte Carlo, Great Expectations, Snowflake, BigQuery, Redshift, Python, SQL, CI/CD
Job PostingView all

Explore Jobs

Expand Your Job Search