68 pyspark data engineer jobs at 36 companies in Commerce, CA
1mo
Save
Mark Applied
Hide
Data Engineer
New York or Los Angeles or San Francisco
$140k-$175k/yr HybridFull Time
3+ YOEBS or equivalent, 3+ years data engineering experience, Python and SQL proficiency, experience with PySpark and distributed data processing, AWS experience preferred, LLM-assisted development familiarity, and willingness to participate in on-call support.
S3, Apache Iceberg, EMR, PySpark, Dagster, Kubernetes, ClickHouse, PostgreSQL, FastAPI, Metabase, Python, SQL, AWS, AWS Athena, EHR, OMOP CDM, HIPAA, LLM
1mo
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
7+ YOE7+ years IT experience, bachelor's in CS/Engineering or equivalent, expertise in cloud data platforms, Python/PySpark, data modeling, big data technologies, graph DBs, orchestration tools, and enterprise data architecture.
AWS, Google Cloud Platform (GCP), Python, PySpark, Neo4j, Google Spanner, Hadoop, Spark, Elasticsearch, Google Cloud Dataflow, Apache Beam, Apache Airflow, BMAD, Spec Kit, SQL, NoSQL
2mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica, California, United States
$142k-$190k/yr HybridFull Time
5+ YOE5+ years data engineering experience building large data pipelines; strong SQL, Python/PySpark; experience with Snowflake/Redshift, Databricks, Spark, Airflow, AWS; data modeling and performance tuning; Bachelor's degree or equivalent.
AWS, Databricks, Snowflake, Spark, Airflow, Python, PySpark, SQL, Redshift, EMR
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Costa Mesa, California, United States
$166k-$220k/yr OnsiteFull Time
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
Palantir Foundry, SQLMesh, Athena, Apache Iceberg, Flyte, Python, Spark, PySpark, SQL, dbt, AWS, Azure, GCP, Tableau
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Los Angeles, California, United States
$130k-$170k/yr HybridFull Time
6+ YOE2+ MgmtLead data engineering role requiring 6-8 years of experience, Databricks stack, SQL, Python, PySpark, data warehousing, Airflow, cloud platforms, and leadership responsibilities.
Databricks, SQL, Python, PySpark, Airflow, Cron, AWS, GCP, Azure, Tableau, Power BI, Hadoop, Hive, HBase, Pig, Spark
3d
Save
Mark Applied
Hide
Sr Data Engineer - Databricks
Irvine or Canada or United States
HybridFull Time, Contract
5+ YOEBachelor's degree in a related field and 5+ years of data engineering experience. Requires Databricks, PySpark, Spark SQL, SQL, Python, cloud, data modeling, ETL/ELT, Git, CI/CD, and testing expertise.
Databricks, Databricks Lakehouse Platform, PySpark, Spark SQL, Delta Lake, Databricks Workflows, Unity Catalog, SQL, Python, Git, CI/CD, AWS, Azure, GCP, Power BI, Structured Streaming, Auto Loader, Kafka, Kinesis, Braze
1w
Save
Mark Applied
Hide
Data Engineer, Performance Marketing
Agoura Hills, California, United States
$89k-$136k/yr HybridFull Time
3+ YOE3–5 years in data/analytics engineering, strong SQL and Python, experience with Databricks/AWS/Snowflake/Google Cloud, Spark/PySpark, ETL/ELT pipelines, and modern lakehouse architectures.
Databricks, AWS, Snowflake, Google Cloud, GitHub Copilot, Claude Code, Codex, Databricks Genie, Python, PySpark, SQL
1w
Save
Mark Applied
Hide
Data Engineer, Performance Marketing
Agoura Hills, California, United States
$89k-$136k/yr HybridFull Time
3+ YOE3–5 years data engineering experience; strong SQL, Python, Spark/PySpark; experience with Databricks, AWS, Snowflake or Google Cloud; familiarity with AI tools and modern lakehouse architectures.
Python, PySpark, SQL, Spark, Claude Code, Codex, GitHub Copilot, Databricks Genie, Databricks, AWS, Snowflake, Google Cloud, SFTP, APIs
4w
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
7+ YOE7+ years IT experience in data architecture; hands-on GCP, Dataflow, BigQuery, Python/PySpark, Airflow; experience with graph and SQL/NoSQL databases; strong communication and leadership skills.
Google Cloud Platform (GCP), Dataflow, BigQuery, Python, PySpark, Neo4j, Google Spanner, Apache Airflow, AWS, Hadoop, Spark, Elasticsearch, Apache Beam, BMAD, Spec Kit, SQL, NoSQL
2w
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or San Francisco
$170k-$200k/yr HybridFull Time
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
4w
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or New York City or United States or India
$185k-$200k/yr HybridFull Time
5+ YOE5+ years building production Databricks lakehouses; strong PySpark, Python, SQL; experience with Unity Catalog, Delta Lake, dbt, orchestrators (Dagster/Prefect/Workflows), and AWS data services.
Databricks, Unity Catalog, Delta Live Tables, Databricks SQL, Workflows, Delta Lake, dbt, PySpark, Python, MySQL, PostgreSQL, Dagster, Prefect, Databricks Workflows, Databricks Vector Search, pgvector, Amazon OpenSearch, Amazon Bedrock, AgentCore, Strands, OpenMetadata, S3, IAM, Databricks Asset Bundles, Terraform, Apache Iceberg, AWS Glue, Athena, DynamoDB, SQL
12h
Save
Mark Applied
Hide
Data Engineer
El Segundo, California, United States
$120k-$130k/yr OnsiteFull Time
Los Angeles Lakers: Operates the Los Angeles Lakers professional basketball team.
2+ YOEBachelor's in statistics, computer science, engineering, or related field or equivalent experience; 2–4 years in data engineering; strong Python, SQL, database, cloud pipeline, orchestration, and Spark skills.
SQL, PostgreSQL, SQL Server, AWS, Prefect, Airflow, Python, Spark, PySpark, Parquet, Iceberg, Kafka, Kinesis, Docker
2w
Save
Mark Applied
Hide
Lead Data Engineer - MSS
Irvine, California, United States
$110k-$140k/yr OnsiteFull Time
6+ YOEHands-on experience with Databricks, dbt, Python, PySpark, Spark, and SQL; 6+ years experience; proven track record in data platform migration to Databricks Lakehouse; leadership and mentoring experience.
Databricks, dbt, Python, PySpark, Spark, SQL, Delta Lake, Unity Catalog, Databricks Workflows, Structured Streaming, Medallion Architecture, Airflow, EBT
1w
Save
Mark Applied
Hide
Data Engineer - Data Architecture & Engineering
Los Angeles or Denver or Seattle or Orange County
$91k-$165k/yr OnsiteFull Time
4+ YOE4+ years building and optimizing production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java, strong communication and problem-solving skills.
Amazon Redshift, Snowflake, GoogleBigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
El Segundo, California, United States
$140k-$150k/yr OnsiteFull Time
6+ YOESenior data engineer with 6+ years in data pipelines, SQL, Python, Databricks; Airflow, Terraform; data governance; retail/e-commerce familiarity a plus.
Databricks, PySpark, SQL, Airflow, GitHub Actions, Terraform, Snowflake, CI/CD
1d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1mo
Save
Mark Applied
Hide
Principal Data Engineer, R&D
Irvine or California or United States
$121k-$171k/yr OnsiteFull Time
6+ YOEBachelor's in engineering/science plus 6+ years data engineering experience; experience with Databricks and Snowflake; data governance and validation experience in regulated environments.
Databricks, Snowflake, GCP, AWS, Apache Spark, Kafka, Flink, Delta Lake, Iceberg, Airflow, dbt, HL7, FHIR, IHE
9h
Save
Mark Applied
Hide
Data Engineer Intern (Monetization Data) - 2027 Summer
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
OnsiteInternship
Currently pursuing an undergraduate or master's degree in computer science, engineering, or related field; strong SQL, database, programming, data modeling, ETL/ELT, communication, and problem-solving skills.
SQL, Python, Java, Go, Apache Hadoop, Apache Spark, Apache Kafka, Apache Flink, Snowflake, Databricks, BigQuery
1w
Save
Mark Applied
Hide
Data Solutions Engineer
Cleveland or Cincinnati or Columbus or Philadelphia or Washington or Orlando or Atlanta or Austin or Dallas or Houston or Los Angeles or Seattle
$120k-$165k/yr OnsiteFull Time
5+ YOEBachelor's in CS/IT,5+ years building data solutions; expertise with Azure data platform, Microsoft Fabric, Power Platform, data modeling, medallion architecture, MDM, DevOps, and strong communication skills.
Azure Data Factory, Azure Data Lake, Azure Data Lake Storage, Azure Synapse Analytics, Azure SQL Database, PostgreSQL, Azure Blob Storage, Azure Databricks, Apache Spark, Apache Airflow, Azure Logic Apps, Azure DevOps, Power Automate, REST API, Azure OpenAI, Document Intelligence, Delta Lake, Microsoft Fabric, Lakehouse, Power Apps, Power BI, Git
Explore Jobs