123 spark data engineer jobs at 51 companies in Shadow Hills, CA
1mo
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Costa Mesa, California, United States
$166k-$220k/yr OnsiteFull Time
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
Palantir Foundry, SQLMesh, Athena, Apache Iceberg, Flyte, Python, Spark, PySpark, SQL, dbt, AWS, Azure, GCP, Tableau
2mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica, California, United States
$142k-$190k/yr HybridFull Time
5+ YOE5+ years data engineering experience building large data pipelines; strong SQL, Python/PySpark; experience with Snowflake/Redshift, Databricks, Spark, Airflow, AWS; data modeling and performance tuning; Bachelor's degree or equivalent.
AWS, Databricks, Snowflake, Spark, Airflow, Python, PySpark, SQL, Redshift, EMR
1w
Save
Mark Applied
Hide
Data Engineer
Los Angeles, California, United States
$150k-$230k/yr OnsiteFull Time
Production data-model ownership, expert SQL, Spark, dbt, Dagster or equivalent, Python, data modeling, lake and warehouse internals, semantic layers, pipelines, testing, documentation, and CI/CD.
SQL, Spark, dbt, Dagster, Python, Snowflake, Databricks, ClickHouse, Airflow, Iceberg, CI/CD
3w
Save
Mark Applied
Hide
Data Engineer, Performance Marketing
Agoura Hills, California, United States
$89k-$136k/yr HybridFull Time
3+ YOE3–5 years data engineering experience; strong SQL, Python, Spark/PySpark; experience with Databricks, AWS, Snowflake or Google Cloud; familiarity with AI tools and modern lakehouse architectures.
Python, PySpark, SQL, Spark, Claude Code, Codex, GitHub Copilot, Databricks Genie, Databricks, AWS, Snowflake, Google Cloud, SFTP, APIs
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or San Francisco
$170k-$200k/yr HybridFull Time
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
1w
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Seattle or Toronto or Santa Barbara or San Diego
$127k-$190k/yr RemoteFull Time
5+ YOE5+ years in data or software engineering; advanced Python, SQL, Databricks, Spark, and data modeling; experience with orchestration, streaming, cloud infrastructure, data quality, ML datasets, and privacy; bachelor's degree or equivalent.
Python, PySpark, Pandas, Polars, PyArrow, SQL, MySQL, PostgreSQL, Databricks, Delta Lake, Unity Catalog, Workflows, Jobs/Compute, Snowflake, BigQuery, Apache Spark, Airflow, Dagster, Kafka, Kinesis, Spark Structured Streaming, AWS, S3, IAM, FastAPI, Databricks Model Serving, SageMaker endpoints
2w
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
2mo
Save
Mark Applied
Hide
Data Engineer Data Pipelines and ETL
Burbank, California, United States
$100k-$147k/yr OnsiteFull Time
2+ YOE2+ years building ETL/ELT pipelines, strong SQL and Python, experience with Airflow, Spark, Kafka/Pub-Sub, cloud-native (GCP preferred), data modeling, and observability for analytics/ML.
Airflow, Composer, SQL, Python, Spark, Vertex AI, Databricks ML, Kafka, Pub/Sub, Superset, GCP
4w
Save
Mark Applied
Hide
Senior Data Engineer
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yr HybridFull Time
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
3w
Save
Mark Applied
Hide
Lead Data Engineer - MSS
Irvine, California, United States
$110k-$140k/yr OnsiteFull Time
6+ YOEHands-on experience with Databricks, dbt, Python, PySpark, Spark, and SQL; 6+ years experience; proven track record in data platform migration to Databricks Lakehouse; leadership and mentoring experience.
Databricks, dbt, Python, PySpark, Spark, SQL, Delta Lake, Unity Catalog, Databricks Workflows, Structured Streaming, Medallion Architecture, Airflow, EBT
2w
Save
Mark Applied
Hide
Security Data Solutions Engineer
Quincy or Princeton or Irvine or Boston or Austin or Sacramento
$120k-$203k/yr HybridFull Time
8+ YOEDesign and implement enterprise security telemetry and data products; 8+ years in cybersecurity/data engineering; strong Python, SQL, Spark, Databricks, Snowflake, SIEM experience; product management skills.
Splunk, Microsoft Sentinel, QRadar, Elastic, Chronicle, Databricks, Snowflake, Kafka, Spark, Cribl, OpenTelemetry, FluentBit, Python, SQL, AWS, Azure, Google Cloud
2mo
Save
Mark Applied
Hide
Data Engineer (Multiple Levels)
Alhambra or United States
$105k-$200k/yr RemoteFull Time
2+ YOEBachelor's degree required; experience with relational databases, Python, Spark, SQL, Databricks, BI tools, cloud services (AWS/GCP/Azure), version control, and 2+ years in data/analytics landscape.
Python, Spark, SQL, Databricks, Tableau, Microsoft Power BI, Microsoft Excel, AWS, GCP, Azure
2w
Save
Mark Applied
Hide
Data Engineer, PDPO - Offense & Defense
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$162k-$388k/yr OnsiteFull Time
1+ YOERequires 1+ year in data warehouse design, production ETL with Hive, Spark, Hadoop, or SQL Server, production SQL, Python, or Java, distributed infrastructure debugging, and scalable data services.
Hive, Spark, Hadoop, SQL Server, SQL, Python, Java, HBase, Elasticsearch, ClickHouse
2mo
Save
Mark Applied
Hide
Data Engineer, Prime Video - GSS Planning & Strategy
Culver City or Seattle
$132k-$179k/yr OnsiteFull Time
3+ YOEBachelor's degree, 3+ years data engineering, experience with Hadoop/Hive/Spark/EMR, SQL and Python, data modeling, ETL/ELT pipelines, BI tools (Tableau/QuickSight), and strong cross-team communication.
Hadoop, Hive, Spark, Amazon EMR, SQL, PL/SQL, DDL, HiveQL, SparkSQL, Scala, Python, Tableau, Amazon QuickSight, Informatica, Apache Airflow, ODI, SSIS, BODI, Datastage, Amazon S3, Amazon Redshift, Amazon SageMaker, Amazon Kinesis, AWS Lambda, Amazon EC2, R, SAS, Matlab
3w
Save
Mark Applied
Hide
Data Engineer, Performance Marketing
Agoura Hills, California, United States
$89k-$136k/yr HybridFull Time
3+ YOE3–5 years in data/analytics engineering, strong SQL and Python, experience with Databricks/AWS/Snowflake/Google Cloud, Spark/PySpark, ETL/ELT pipelines, and modern lakehouse architectures.
Databricks, AWS, Snowflake, Google Cloud, GitHub Copilot, Claude Code, Codex, Databricks Genie, Python, PySpark, SQL
3w
Save
Mark Applied
Hide
Principal Data Engineer, Personalization - Central Product Insights
Los Angeles, California, United States
$210k-$293k/yr OnsiteFull Time
8+ YOEBachelor's or master's degree in a related field, 8+ years in data engineering and tech-focused publishing or marketing, expertise in Python, GoLang, Spark, Scala, SQL, Airflow, dbt, cloud infrastructure, and Databricks.
Python, GoLang, Spark, Scala, SQL, Airflow, dbt, AWS, GCP, Databricks
3w
Save
Mark Applied
Hide
Principal Data Engineer, Personalization - Central Product Insights
Los Angeles, California, United States
$210k-$293k/yr OnsiteFull Time
8+ YOEBachelor's degree in CS or related,8+ years data engineering experience in publishing/marketing,expertise with Python,GoLang,Spark,Scala,SQL,Airflow,dbt,cloud (AWS/GCP),Databricks,mentoring and cross-functional collaboration.
Python, GoLang, Spark, Scala, SQL, Airflow, dbt, AWS, GCP, Databricks
3mo
Save
Mark Applied
Hide
Lead Data Engineer
Los Angeles, California, United States
$130k-$170k/yr HybridFull Time
6+ YOE2+ MgmtLead data engineering role requiring 6-8 years of experience, Databricks stack, SQL, Python, PySpark, data warehousing, Airflow, cloud platforms, and leadership responsibilities.
Databricks, SQL, Python, PySpark, Airflow, Cron, AWS, GCP, Azure, Tableau, Power BI, Hadoop, Hive, HBase, Pig, Spark
3w
Save
Mark Applied
Hide
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yr RemoteFull Time
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Python, Golang, PostgreSQL (RDS), OpenSearch, Redshift, EMR, Spark, Docker, Lambda, AWS, EKS, SQS, SNS, S3, Kubernetes, Hadoop, Kafka, Microsoft Azure, GCP
Explore Jobs