Scotts Valley • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Scotts Valley • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Scotts Valley • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Scotts Valley • 50 milesRemote · Hybrid · Onsite · Field · All Environments
115 pyspark data engineer jobs at 64 companies in Scotts Valley, CA
2mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or Foster City or Orange County or Morristown
RemoteFull Time
5+ YOERequires 5+ years in data engineering, advanced SQL, Python, Spark/PySpark, Microsoft Fabric, Azure data services, APIs, data modeling, CI/CD, Git, and Azure DevOps; bachelor's degree or equivalent experience.
Microsoft Fabric, Lakehouse, Warehouse, Data Pipelines, Notebooks, OneLake, Git, Azure DevOps, Spark, PySpark, SQL, Python, Azure, Delta Lake, Parquet, REST APIs, JSON, Power BI, DP-600, DP-700
1w
Save
Mark Applied
Hide
Data Engineer
Santa Clara or United States
$110k-$120k/yr RemoteFull Time
Requires Python and PySpark, cloud data platform experience with Snowflake or Databricks, pipeline design and orchestration, Spark tuning, CI/CD, DevOps, version control, and scalable data solution collaboration.
Python, PySpark, Snowflake, Databricks, Terraform, CI/CD, DevOps, QCraft, Microsoft Azure
3mo
Save
Mark Applied
Hide
Sr. Data Engineer
Foster City, California, United States
$123k-$191k/yr HybridFull Time
2+ YOE2+ years experience with a bachelor’s degree or advanced degree; strong Python, SQL, PySpark; Hadoop ecosystem; AWS data services; Airflow; CI/CD; data quality and observability; ability to collaborate with stakeholders.
Python, SQL, PySpark, Hadoop, Spark, Pandas, Airflow, Snowflake, Databricks, AWS, S3, EMR, Glue Catalog, Claude Code
2mo
Save
Mark Applied
Hide
Data Science Engineer
San Jose or California or United States
$109k-$201k/yr OnsiteFull Time
8+ YOESenior data engineer with 8+ years experience, distributed data and cloud technologies (Hadoop, Spark, Databricks, S3, EMR), streaming (Kafka/Kinesis), strong SQL and Python/PySpark/Scala skills, CI/CD and orchestration experience, and strong communication.
Hadoop, Hive, Presto, Spark, Databricks, S3, Azure Blob Storage, Notebooks, AWS EMR, Athena, Glue, Delta, Parquet, ORC, Kafka, Kinesis, SQL, Python, PySpark, Scala, Pandas, NumPy, Koalas, APIs, GitHub, Jenkins, Apache Air Flow, Azkaban, AEP, AJO, CJA, Adobe Experience Platform, Adobe Analytics, Customer Journey Analytics, Adobe Journey Optimizer, Collibra, JIRA, Confluence, Copilot, Claude, LLAMA, Databricks Genie, n8n, RAG, MCPs, GenStudio, Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud
3w
Save
Mark Applied
Hide
Staff Data Engineer
Sunnyvale, California, United States
$200k-$260k/yr OnsiteFull Time
8+ YOE8+ years data/analytics engineering experience, strong SQL and Python, experience with batch and streaming pipelines, data modeling, data quality, testing, monitoring, and mentoring engineers.
Airflow, Apache Beam, Python, SQL, Apache Spark, Dagster, dbt, Kafka Streams, Flink, Looker, Tableau, Git, Snowflake, Databricks, BigQuery, Docker
3w
Save
Mark Applied
Hide
GCP Data Engineer
San Jose, California, United States
RemoteFull Time
4+ YOERequires 4+ years in data engineering, big data, or cloud data platforms; Scala, Apache Spark, GCP, SQL, ETL/ELT, Git, CI/CD, and DevOps expertise; bachelor's or master's degree preferred.
Scala, Apache Spark, Spark SQL, Spark Streaming, DataFrames, Datasets, Google Cloud Platform (GCP), BigQuery, Cloud Storage, Dataproc, Dataflow, Pub/Sub, Composer (Airflow), Cloud Functions, Cloud Run, SQL, Git, Kafka, Python, Docker, Kubernetes, GKE, Terraform, AWS, Azure
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Mateo or New York City
$140k-$160k/yr HybridFull Time
6+ YOE6+ years building production data systems; expert in Python, PostgreSQL, Airflow, Clickhouse, Snowflake, Elasticsearch, Spark, and AWS; Bachelor's in CS/Data Engineering or equivalent experience.
Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, AWS, AWS RDS
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Redwood City, California, United States
$185k-$240k/yr HybridFull Time
5+ YOE5+ years building production data pipelines; strong Python (PySpark) and SQL; experience with Spark/EMR, Kinesis, Lambda, Step Functions; Postgres; Iceberg/Trino; Java/Spring; CI/CD and Terraform; AI tooling; cross-team collaboration.
PySpark, SQL, Java, Spring Boot, Kinesis, EMR, S3, Postgres, Iceberg, Trino, Terraform, CI/CD
1mo
Save
Mark Applied
Hide
Sr. Data Engineer
Palo Alto, California, United States
$145k-$220k/yr RemoteFull Time
5+ YOE5+ years data engineering experience; strong AWS (S3, EC2, EKS, Redshift, Glue, Athena) and cloud skills; SQL, Python, data modeling, ETL/ELT, and pipeline production experience; familiarity with vector DBs and ML data workflows.
S3, EC2, ECS, EKS, Athena, Redshift, Glue, Step Functions, Terraform, CloudFormation, SQL, Snowflake, Databricks Delta Lake, Neo4j, AWS Neptune, Python, pandas, PySpark, TypeScript, Node.js, C#, Postgres pgvector, Chroma, Pinecone, LangChain, LlamaIndex, Docker, Kubernetes, Kafka, Kinesis, Airflow, Prefect, dbt
1mo
Save
Mark Applied
Hide
AI Data Engineer
Palo Alto or Atlanta or Washington
$160k-$200k/yr HybridFull Time
4+ YOEUS citizen with 4+ years' experience, technical education, strong Python and AWS skills, experience with large-scale ETL, Spark/PySpark, PostgreSQL/RDS, Neo4j, and hands-on AI coding tools; must be able to meet in person.
Claude Code, GPT/Codex, Cursor, Windsurf, PostgreSQL, RDS, Python, Spark/PySpark, Scala, AWS, Neo4j
2mo
Save
Mark Applied
Hide
Sr. Enterprise Data Engineer
Palo Alto, California, United States
$67-$88/hr HybridFull Time
3+ YOEBS/BA required. 7+ years in reporting/analytics/BI/healthcare tech OR 3+ years developing cloud data lake solutions (PySpark on Databricks) with DevOps/CI/CD. Advanced SQL, data modeling, Azure, and GitHub experience.
Databricks, PySpark, Notebooks, GitHub, Microsoft Azure, SQL, DevOps, CI/CD
5d
Save
Mark Applied
Hide
Principal Data Engineer - CoreAI
Redmond or Mountain View
$143k-$275k/yr HybridFull Time
4+ YOEMaster's and 4+ years or bachelor's and 6+ years in data engineering, software development, analytics, data science, or modeling; security screening required.
Azure, Azure Data Lake, Spark, Synapse, SQL, Azure Data Explorer, PySpark
6d
Save
Mark Applied
Hide
Data Engineer/Senior Data Engineer
Santa Clara, California, United States
$130k-$200k/yr HybridFull Time
BS, MS, PhD, or equivalent experience; Python proficiency; scalable data processing or evaluation frameworks; large-scale time-series, event, or geospatial analysis; LLM-powered workflows; strong problem-solving and communication.
Python, Apache Spark, Airflow, Argo Workflows, LangChain, LangGraph, PostGIS, GeoPandas
2mo
Save
Mark Applied
Hide
Data & Analytics Engineer
San Leandro, California, United States
$105k-$125k/yr OnsiteFull Time
3+ YOEBachelor's in a related field or equivalent, 3+ years data engineering or analytics experience, strong SQL, cloud data platform experience (Snowflake, Microsoft Fabric), Python, Microsoft Power BI, SSIS/Azure Data Factory, and experience building ETL/ELT pipelines and analytics-ready datasets.
Snowflake, Microsoft Fabric, SQL Server Integration Services (SSIS), Microsoft Azure Data Factory, SQL, Python, Microsoft Power BI, Microsoft Dynamics, Spark, PySpark, Microsoft 365
6d
Save
Mark Applied
Hide
Data Engineer Intern (Monetization Data) - 2027 Summer
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
OnsiteInternship
Currently pursuing an undergraduate or master's degree in computer science, engineering, or related field; strong SQL, database, programming, data modeling, ETL/ELT, communication, and problem-solving skills.
SQL, Python, Java, Go, Apache Hadoop, Apache Spark, Apache Kafka, Apache Flink, Snowflake, Databricks, BigQuery
6d
Save
Mark Applied
Hide
Data Engineer - USDS (Multiple Positions)
San Jose, California, United States
$150k-$259k/yr OnsiteFull Time
1+ YOEMaster's degree plus 1 year, or bachelor's degree plus 3 years, in a quantitative field; experience with data warehousing, ETL, SQL/Python/Java, data pipelines, and query engines.
Hive, Apache Spark, Hadoop, SQL Server, SQL, Python, Java, HBase, Elasticsearch, ClickHouse
1mo
Save
Mark Applied
Hide
Associate Data Engineer
Redwood City, California, United States
$138k-$164k/yr HybridFull Time
5+ YOEBachelor's degree plus 5 years relevant experience. Expertise in SQL, Python/PySpark, cloud data services, data modeling, ETL/ELT, and strong communication skills.
Advanced SQL, Advanced Python, SQL, Python, PySpark, S3, Redshift, Glue ETL, IAM, DMS, Appflow, VPC, AWS Services, SnowFlake, FiveTran, KAFKA, Airflow, Oracle Cloud, Scala, R
2d
Save
Mark Applied
Hide
Staff Data Engineer, AI Platform
San Jose, California, United States
$175k-$215k/yr OnsiteFull Time
5+ YOE5+ years of data engineering experience; BS, MS, or PhD in a related field; production pipeline expertise with Spark, Flink, Airflow, dbt, or similar; strong SQL and AWS experience.
Apache Spark, Apache Flink, Apache Airflow, dbt, Apache Iceberg, Apache Paimon, Parquet, Amazon S3, Apache Pulsar, Kafka, SQL, StarRocks, AWS Glue, Amazon EMR, Docker, Kubernetes, Prefect, Dagster, PostgreSQL, Debezium, Airbyte, MLflow
3w
Save
Mark Applied
Hide
Data DevOps Engineer
Santa Clara, California, United States
$200k-$220k/yr OnsiteFull Time
8+ YOE8+ years experience building and operating multitenant Spark and Kafka clusters; infrastructure automation with Jenkins/Ansible/Terraform; strong Python/Scala/Java skills; data processing and database experience.
Apache Spark, Apache Kafka, Jenkins, Ansible, Terraform, Python, Scala, Java
3d
Save
Mark Applied
Hide
Data Infrastructure Engineer (Query Engine)
San Mateo, California, United States
OnsiteFull Time
Experience with query engines, distributed systems, parallel query processing, big data technologies, SQL optimization, and scalable petabyte-scale systems; proficiency in Java, Scala, Rust, or C++.
Java, Scala, Rust, C++, Apache Iceberg, Delta Lake, Hudi, Apache Spark, Presto, Trino, Parquet, ORC, Avro, SQL, Linux, Docker
Explore Jobs