30 pyspark data engineer jobs at 15 companies in Sun City, CA
1mo
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
7+ YOE7+ years IT experience, bachelor's in CS/Engineering or equivalent, expertise in cloud data platforms, Python/PySpark, data modeling, big data technologies, graph DBs, orchestration tools, and enterprise data architecture.
AWS, Google Cloud Platform (GCP), Python, PySpark, Neo4j, Google Spanner, Hadoop, Spark, Elasticsearch, Google Cloud Dataflow, Apache Beam, Apache Airflow, BMAD, Spec Kit, SQL, NoSQL
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Costa Mesa, California, United States
$166k-$220k/yr OnsiteFull Time
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
Palantir Foundry, SQLMesh, Athena, Apache Iceberg, Flyte, Python, Spark, PySpark, SQL, dbt, AWS, Azure, GCP, Tableau
2mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or Foster City or Orange County or Morristown
RemoteFull Time
5+ YOERequires 5+ years in data engineering, advanced SQL, Python, Spark/PySpark, Microsoft Fabric, Azure data services, APIs, data modeling, CI/CD, Git, and Azure DevOps; bachelor's degree or equivalent experience.
Microsoft Fabric, Lakehouse, Warehouse, Data Pipelines, Notebooks, OneLake, Git, Azure DevOps, Spark, PySpark, SQL, Python, Azure, Delta Lake, Parquet, REST APIs, JSON, Power BI, DP-600, DP-700
1mo
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
7+ YOE7+ years IT experience in data architecture; hands-on GCP, Dataflow, BigQuery, Python/PySpark, Airflow; experience with graph and SQL/NoSQL databases; strong communication and leadership skills.
Google Cloud Platform (GCP), Dataflow, BigQuery, Python, PySpark, Neo4j, Google Spanner, Apache Airflow, AWS, Hadoop, Spark, Elasticsearch, Apache Beam, BMAD, Spec Kit, SQL, NoSQL
1mo
Save
Mark Applied
Hide
Data Engineer III, Development
Carlsbad, California, United States
$181k-$186k/yr OnsiteFull Time
4+ YOEMaster's in CS/IS (or Bachelor's +6 yrs); minimum 4 years as a Database Administrator or Data Engineer; experience with Databricks, Data lake/Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elasticsearch, Lambda, S3, RDS, MongoDB, DynamoDB, PySpark, Python, SQL, Git, Jenkins, Informatica, TCL/Unix shell, and Sybase.
Databricks, Data lake, Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elastic Search, Lambda, S3, Redshift, RDS, MongoDB, DynamoDB, PySpark, Python, Git, Jenkins, Informatica, TCL, Unix shell script, SQL, Sybase
2w
Save
Mark Applied
Hide
Lead Data Engineer - MSS
Irvine, California, United States
$110k-$140k/yr OnsiteFull Time
6+ YOEHands-on experience with Databricks, dbt, Python, PySpark, Spark, and SQL; 6+ years experience; proven track record in data platform migration to Databricks Lakehouse; leadership and mentoring experience.
Databricks, dbt, Python, PySpark, Spark, SQL, Delta Lake, Unity Catalog, Databricks Workflows, Structured Streaming, Medallion Architecture, Airflow, EBT
2w
Save
Mark Applied
Hide
Data Engineer - Data Architecture & Engineering
Los Angeles or Denver or Seattle or Orange County
$91k-$165k/yr OnsiteFull Time
4+ YOE4+ years building and optimizing production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java, strong communication and problem-solving skills.
Amazon Redshift, Snowflake, GoogleBigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
2mo
Save
Mark Applied
Hide
Staff Data Platform Engineer
Irvine, California, United States
$154k-$204k/yr HybridFull Time
3+ YOEBachelor's or Master's in CS/Data Science, 3+ years building large-scale data processing systems, Databricks and Terraform experience, cloud (AWS/GCP/Azure) familiarity, PySpark preferred, strong communication and problem-solving.
Databricks, Delta, Spark, Unity Catalog, Terraform, CI/CD, PySpark, Spark SQL, Spark Streaming, AWS, GCP, Azure, IAM, VPC, EC2, S3
1mo
Save
Mark Applied
Hide
Principal Data Engineer, R&D
Irvine or California or United States
$121k-$171k/yr OnsiteFull Time
6+ YOEBachelor's in engineering/science plus 6+ years data engineering experience; experience with Databricks and Snowflake; data governance and validation experience in regulated environments.
Databricks, Snowflake, GCP, AWS, Apache Spark, Kafka, Flink, Delta Lake, Iceberg, Airflow, dbt, HL7, FHIR, IHE
1w
Save
Mark Applied
Hide
Senior Data Engineer (Python)
Irvine, California, United States
$97k-$138k/yr OnsiteFull Time
7+ YOEBachelor's degree required; 7+ years in data warehouse or MDM applications, strong SQL, Python and PL/SQL, relational databases, ETL/ELT pipelines, and production data workload experience.
Python, Apache Airflow, SQL, PL/SQL, Azure Data Lake, AWS, GCP, Spark, PySpark, Git, CI/CD, DevOps
2mo
Save
Mark Applied
Hide
Enterprise Data Engineering Manager, FVP
San Diego or Irvine or Los Angeles or Centennial or Las Vegas or Kansas City or Edison or Omaha
$145k-$180k/yr OnsiteFull Time
10+ YOE7+ Mgmt10+ years in data engineering leadership; SQL Server; cloud data ecosystems (GCP/AWS/Azure); Databricks and Spark; PySpark; Python; SQL; ETL/ELT tools (Fivetran, dbt); leadership and collaboration skills.
Databricks, Spark, PySpark, Python, SQL, Fivetran, dbt, GCP, Azure, AWS, BigQuery, Snowflake, SQL Server
4d
Save
Mark Applied
Hide
Database Engineer - Databricks
Irvine, California, United States
$130k-$150k/yr HybridFull Time
3+ YOERequires 3+ years of production data engineering, deep Databricks, Python, PySpark, SQL, MSSQL, and Apache Airflow experience, plus Databricks certification and strong documentation skills.
Databricks Lakehouse, Databricks, Delta Lake, Apache Spark, Auto Loader, Structured Streaming, Databricks Workflows, Apache Airflow, Microsoft SQL Server, Unity Catalog, Python, PySpark, SQL, Salesforce
1w
Save
Mark Applied
Hide
Software Engineer II, Data Platform
Aliso Viejo or San Diego
$150k-$225k/yr HybridFull Time
3+ YOEBachelor's degree in Computer Science, 3+ years developing scalable distributed systems, proficiency in Scala, Java, or Python, cloud application experience, and familiarity with data streaming and processing platforms.
Scala, Java, Python, Amazon Web Services (AWS), Google Cloud Platform (GCP), Kafka, Kinesis, SQS, Apache Spark, Apache Flink, Databricks, CI/CD
1mo
Save
Mark Applied
Hide
Business Intelligence Developer (Onsite)
Oceanside, California, United States
$35-$52/hr OnsiteFull Time
2+ YOEBachelor's in STEM preferred; SQL database and query knowledge required; 2+ years SQL/database experience preferred; experience with cloud data warehouses, Python (PySpark), and performance tuning; strong communication and problem-solving skills.
Databricks, Microsoft SQL Server, Azure, DB2, SQL, Python (PySpark)
1w
Save
Mark Applied
Hide
Software Engineer II, Data Platform
Aliso Viejo or San Diego
$150k-$225k/yr HybridFull Time
3+ YOEBachelor's in Computer Science,3+ years building scalable distributed systems,proficiency in Scala/Java/Python,AWS or GCP experience,knowledge of event streaming and distributed processing,CI/CD and on-call experience.
Scala, Java, Python, AWS, GCP, Kafka, Kinesis, SQS, Apache Spark, Apache Flink, Databricks
3w
Save
Mark Applied
Hide
Machine Learning Engineer II
Diamond Bar, California, United States
$100k-$146k/yr OnsiteFull Time
5+ YOEBachelor's in a quantitative field required (Master/PhD preferred); strong Python and ML framework experience (PyTorch/TensorFlow); production MLOps, cloud, and industrial data experience; preferred 5+ years in ML/industrial AI.
Azure Machine Learning Studio, Azure Machine Learning, XGBoost, Random Forests, LSTMs, Autoencoders, Isolation Forests, One-Class SVMs, Dynamic Time Warping, PCA, MLflow, Kubeflow, Docker, Kubernetes, PySpark, Databricks, Python, C++, C#, JavaScript, R, PyTorch, TensorFlow, Scikit-Learn, NumPy, Pandas, SciPy, SQL, NoSQL, InfluxDB, TimescaleDB, Google Cloud Platform, AWS, GCP, LangChain, LlamaIndex, Microsoft Semantic Kernel, AutoGen, CrewAI, Azure AI Foundry, OpenAI API, Hive, Pig, MATLAB, Weka, Matplotlib
3d
Save
Mark Applied
Hide
Senior Specialist - Quality Engineering
Irvine, California, United States
$103k-$152k/yr OnsiteFull Time
8+ YOERequires 8–12 years of experience in data testing, SQL, database and ETL testing, data quality, Agile methodologies, automation, and cloud data platforms; Python or PySpark experience required.
SQL, Oracle, SQL Server, PostgreSQL, Snowflake, Informatica, Talend, DataStage, SSIS, Azure Data Factory, Databricks, AWS Glue, JIRA, Azure DevOps, HP ALM, Python, PySpark, Hadoop, Spark, GenAI
Explore Jobs