51 pyspark data engineer jobs at 27 companies in Pedley, CA
1mo
Save
Mark Applied
Hide
Data Engineer
New York or Los Angeles or San Francisco
$140k-$175k/yr HybridFull Time
3+ YOEBS or equivalent, 3+ years data engineering experience, Python and SQL proficiency, experience with PySpark and distributed data processing, AWS experience preferred, LLM-assisted development familiarity, and willingness to participate in on-call support.
S3, Apache Iceberg, EMR, PySpark, Dagster, Kubernetes, ClickHouse, PostgreSQL, FastAPI, Metabase, Python, SQL, AWS, AWS Athena, EHR, OMOP CDM, HIPAA, LLM
1mo
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
7+ YOE7+ years IT experience, bachelor's in CS/Engineering or equivalent, expertise in cloud data platforms, Python/PySpark, data modeling, big data technologies, graph DBs, orchestration tools, and enterprise data architecture.
AWS, Google Cloud Platform (GCP), Python, PySpark, Neo4j, Google Spanner, Hadoop, Spark, Elasticsearch, Google Cloud Dataflow, Apache Beam, Apache Airflow, BMAD, Spec Kit, SQL, NoSQL
2mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or Foster City or Orange County or Morristown
RemoteFull Time
5+ YOERequires 5+ years in data engineering, advanced SQL, Python, Spark/PySpark, Microsoft Fabric, Azure data services, APIs, data modeling, CI/CD, Git, and Azure DevOps; bachelor's degree or equivalent experience.
Microsoft Fabric, Lakehouse, Warehouse, Data Pipelines, Notebooks, OneLake, Git, Azure DevOps, Spark, PySpark, SQL, Python, Azure, Delta Lake, Parquet, REST APIs, JSON, Power BI, DP-600, DP-700
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Costa Mesa, California, United States
$166k-$220k/yr OnsiteFull Time
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
Palantir Foundry, SQLMesh, Athena, Apache Iceberg, Flyte, Python, Spark, PySpark, SQL, dbt, AWS, Azure, GCP, Tableau
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Los Angeles, California, United States
$130k-$170k/yr HybridFull Time
6+ YOE2+ MgmtLead data engineering role requiring 6-8 years of experience, Databricks stack, SQL, Python, PySpark, data warehousing, Airflow, cloud platforms, and leadership responsibilities.
Databricks, SQL, Python, PySpark, Airflow, Cron, AWS, GCP, Azure, Tableau, Power BI, Hadoop, Hive, HBase, Pig, Spark
5d
Save
Mark Applied
Hide
Sr Data Engineer - Databricks
Irvine or Canada or United States
HybridFull Time, Contract
5+ YOEBachelor's degree in a related field and 5+ years of data engineering experience. Requires Databricks, PySpark, Spark SQL, SQL, Python, cloud, data modeling, ETL/ELT, Git, CI/CD, and testing expertise.
Databricks, Databricks Lakehouse Platform, PySpark, Spark SQL, Delta Lake, Databricks Workflows, Unity Catalog, SQL, Python, Git, CI/CD, AWS, Azure, GCP, Power BI, Structured Streaming, Auto Loader, Kafka, Kinesis, Braze
1mo
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
7+ YOE7+ years IT experience in data architecture; hands-on GCP, Dataflow, BigQuery, Python/PySpark, Airflow; experience with graph and SQL/NoSQL databases; strong communication and leadership skills.
Google Cloud Platform (GCP), Dataflow, BigQuery, Python, PySpark, Neo4j, Google Spanner, Apache Airflow, AWS, Hadoop, Spark, Elasticsearch, Apache Beam, BMAD, Spec Kit, SQL, NoSQL
2w
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or San Francisco
$170k-$200k/yr HybridFull Time
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
2w
Save
Mark Applied
Hide
Lead Data Engineer - MSS
Irvine, California, United States
$110k-$140k/yr OnsiteFull Time
6+ YOEHands-on experience with Databricks, dbt, Python, PySpark, Spark, and SQL; 6+ years experience; proven track record in data platform migration to Databricks Lakehouse; leadership and mentoring experience.
Databricks, dbt, Python, PySpark, Spark, SQL, Delta Lake, Unity Catalog, Databricks Workflows, Structured Streaming, Medallion Architecture, Airflow, EBT
1w
Save
Mark Applied
Hide
Data Engineer - Data Architecture & Engineering
Los Angeles or Denver or Seattle or Orange County
$91k-$165k/yr OnsiteFull Time
4+ YOE4+ years building and optimizing production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java, strong communication and problem-solving skills.
Amazon Redshift, Snowflake, GoogleBigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
7h
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Seattle or Toronto or Santa Barbara or San Diego
$127k-$190k/yr RemoteFull Time
5+ YOE5+ years in data or software engineering; advanced Python, SQL, Databricks, Spark, and data modeling; experience with orchestration, streaming, cloud infrastructure, data quality, ML datasets, and privacy; bachelor's degree or equivalent.
Python, PySpark, Pandas, Polars, PyArrow, SQL, MySQL, PostgreSQL, Databricks, Delta Lake, Unity Catalog, Workflows, Jobs/Compute, Snowflake, BigQuery, Apache Spark, Airflow, Dagster, Kafka, Kinesis, Spark Structured Streaming, AWS, S3, IAM, FastAPI, Databricks Model Serving, SageMaker endpoints
2d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
2mo
Save
Mark Applied
Hide
Staff Data Platform Engineer
Irvine, California, United States
$154k-$204k/yr HybridFull Time
3+ YOEBachelor's or Master's in CS/Data Science, 3+ years building large-scale data processing systems, Databricks and Terraform experience, cloud (AWS/GCP/Azure) familiarity, PySpark preferred, strong communication and problem-solving.
Databricks, Delta, Spark, Unity Catalog, Terraform, CI/CD, PySpark, Spark SQL, Spark Streaming, AWS, GCP, Azure, IAM, VPC, EC2, S3
1mo
Save
Mark Applied
Hide
Principal Data Engineer, R&D
Irvine or California or United States
$121k-$171k/yr OnsiteFull Time
6+ YOEBachelor's in engineering/science plus 6+ years data engineering experience; experience with Databricks and Snowflake; data governance and validation experience in regulated environments.
Databricks, Snowflake, GCP, AWS, Apache Spark, Kafka, Flink, Delta Lake, Iceberg, Airflow, dbt, HL7, FHIR, IHE
1d
Save
Mark Applied
Hide
Data Engineer Intern (Monetization Data) - 2027 Summer
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
OnsiteInternship
Currently pursuing an undergraduate or master's degree in computer science, engineering, or related field; strong SQL, database, programming, data modeling, ETL/ELT, communication, and problem-solving skills.
SQL, Python, Java, Go, Apache Hadoop, Apache Spark, Apache Kafka, Apache Flink, Snowflake, Databricks, BigQuery
6d
Save
Mark Applied
Hide
Senior Data Engineer (Python)
Irvine, California, United States
$97k-$138k/yr OnsiteFull Time
7+ YOEBachelor's degree required; 7+ years in data warehouse or MDM applications, strong SQL, Python and PL/SQL, relational databases, ETL/ELT pipelines, and production data workload experience.
Python, Apache Airflow, SQL, PL/SQL, Azure Data Lake, AWS, GCP, Spark, PySpark, Git, CI/CD, DevOps
1mo
Save
Mark Applied
Hide
Data/Analytics Engineer
Los Angeles, California, United States
$10k-$13k/mo OnsiteFull Time
2+ YOE2+ MgmtLead Databricks architect building governed Medallion Lakehouse, automated ETL/ELT pipelines, Terraform and GitHub CI/CD, strong Python and SQL, experience with regulated PHI/CJI data and public-sector integrations.
Databricks, Terraform, GitHub, GitHub Actions, Unity Catalog, SQL, Python, Pandas, PySpark, Tableau, Power BI
1w
Save
Mark Applied
Hide
Data Engineer
Pasadena, California, United States
$106k-$143k/yr OnsiteFull Time
Implement and manage scalable data infrastructure; build ETL/ELT pipelines; strong Python and SQL; cloud and Spark experience; Docker/Kubernetes, Airflow, Databricks, Fabric, BI tools; data governance and security.
Python, SQL, Docker, Kubernetes, AWS, Azure, Google Cloud, Apache Spark, Databricks, Apache Airflow, Fabric, Power BI, Tableau, LLMs
2mo
Save
Mark Applied
Hide
Enterprise Data Engineering Manager, FVP
San Diego or Irvine or Los Angeles or Centennial or Las Vegas or Kansas City or Edison or Omaha
$145k-$180k/yr OnsiteFull Time
10+ YOE7+ Mgmt10+ years in data engineering leadership; SQL Server; cloud data ecosystems (GCP/AWS/Azure); Databricks and Spark; PySpark; Python; SQL; ETL/ELT tools (Fivetran, dbt); leadership and collaboration skills.
Databricks, Spark, PySpark, Python, SQL, Fivetran, dbt, GCP, Azure, AWS, BigQuery, Snowflake, SQL Server
20h
Save
Mark Applied
Hide
Data Architect
Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington
$152k-$206k/yr HybridFull Time
10+ YOE3+ MgmtBachelor's or master's degree; 10+ years in data engineering or architecture and 3+ years in leadership. Requires cloud, data modeling, ETL, programming, and team leadership expertise.
Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Databricks, Snowflake, Delta Lake, Apache Spark, Python, SQL, Java, Scala, Hadoop, Kafka, Amazon Redshift, Azure Synapse, Google BigQuery, Docker, Kubernetes
Explore Jobs