Pacific Grove • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Pacific Grove • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Pacific Grove • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Pacific Grove • 50 milesRemote · Hybrid · Onsite · Field · All Environments
22 pyspark data engineer jobs at 14 companies in Pacific Grove, CA
2mo
Save
Mark Applied
Hide
Data Science Engineer
San Jose or California or United States
$109k-$201k/yr OnsiteFull Time
8+ YOESenior data engineer with 8+ years experience, distributed data and cloud technologies (Hadoop, Spark, Databricks, S3, EMR), streaming (Kafka/Kinesis), strong SQL and Python/PySpark/Scala skills, CI/CD and orchestration experience, and strong communication.
Hadoop, Hive, Presto, Spark, Databricks, S3, Azure Blob Storage, Notebooks, AWS EMR, Athena, Glue, Delta, Parquet, ORC, Kafka, Kinesis, SQL, Python, PySpark, Scala, Pandas, NumPy, Koalas, APIs, GitHub, Jenkins, Apache Air Flow, Azkaban, AEP, AJO, CJA, Adobe Experience Platform, Adobe Analytics, Customer Journey Analytics, Adobe Journey Optimizer, Collibra, JIRA, Confluence, Copilot, Claude, LLAMA, Databricks Genie, n8n, RAG, MCPs, GenStudio, Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud
3w
Save
Mark Applied
Hide
GCP Data Engineer
San Jose, California, United States
RemoteFull Time
4+ YOERequires 4+ years in data engineering, big data, or cloud data platforms; Scala, Apache Spark, GCP, SQL, ETL/ELT, Git, CI/CD, and DevOps expertise; bachelor's or master's degree preferred.
Scala, Apache Spark, Spark SQL, Spark Streaming, DataFrames, Datasets, Google Cloud Platform (GCP), BigQuery, Cloud Storage, Dataproc, Dataflow, Pub/Sub, Composer (Airflow), Cloud Functions, Cloud Run, SQL, Git, Kafka, Python, Docker, Kubernetes, GKE, Terraform, AWS, Azure
6d
Save
Mark Applied
Hide
Data Engineer Intern (Monetization Data) - 2027 Summer
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
OnsiteInternship
Currently pursuing an undergraduate or master's degree in computer science, engineering, or related field; strong SQL, database, programming, data modeling, ETL/ELT, communication, and problem-solving skills.
SQL, Python, Java, Go, Apache Hadoop, Apache Spark, Apache Kafka, Apache Flink, Snowflake, Databricks, BigQuery
6d
Save
Mark Applied
Hide
Data Engineer - USDS (Multiple Positions)
San Jose, California, United States
$150k-$259k/yr OnsiteFull Time
1+ YOEMaster's degree plus 1 year, or bachelor's degree plus 3 years, in a quantitative field; experience with data warehousing, ETL, SQL/Python/Java, data pipelines, and query engines.
Hive, Apache Spark, Hadoop, SQL Server, SQL, Python, Java, HBase, Elasticsearch, ClickHouse
1d
Save
Mark Applied
Hide
Staff Data Engineer, AI Platform
San Jose, California, United States
$175k-$215k/yr OnsiteFull Time
5+ YOE5+ years of data engineering experience; BS, MS, or PhD in a related field; production pipeline expertise with Spark, Flink, Airflow, dbt, or similar; strong SQL and AWS experience.
Apache Spark, Apache Flink, Apache Airflow, dbt, Apache Iceberg, Apache Paimon, Parquet, Amazon S3, Apache Pulsar, Kafka, SQL, StarRocks, AWS Glue, Amazon EMR, Docker, Kubernetes, Prefect, Dagster, PostgreSQL, Debezium, Airbyte, MLflow
2mo
Save
Mark Applied
Hide
Senior Software Engineer - Data Insights
San Jose, California, United States
$323k-$428k/yr HybridFull Time
8+ YOE8+ years software/data engineering; big data tech; Spark/Airflow; distributed systems; SQL; cloud and containers; Python/Java/Scala; AdTech experience preferred.
Apache Spark, Apache Airflow, Druid, StarRocks, Trino, Spring Boot, Looker, Python, Java, Scala, AWS, GCP, Azure, Docker, Kubernetes, Hadoop, Kafka
2mo
Save
Mark Applied
Hide
Senior DevOps Engineer - Data Infra
San Jose or Austin
$144k-$213k/yr HybridFull Time
3+ YOE3+ years experience in software/dev or operating distributed systems; bachelor’s/master’s in CS or related; hands-on with AWS, message streaming (Kafka, SQS), SQL/NoSQL, IaC, Python/Java/Bash; strong troubleshooting and communication.
AWS SQS, Apache Kafka, AWS CLI, AWS CloudFormation, Terraform, Ansible, Puppet, Lambda, API GW, Python, Java, Bash, AWS S3, AWS DMS, Luigi, AWS EKS, Apache Spark, AWS Glue, SQL, NoSQL
3d
Save
Mark Applied
Hide
Senior Cloud Data Architect – Azure / Databricks
San Jose, California, United States
OnsiteContract
15+ YOERequires 15+ years of experience, including 7+ years in data engineering or architecture and 3+ years in cloud data architecture, plus a bachelor's degree in computer science.
Azure Data Lake, Azure Data Factory (ADF), Azure Synapse Analytics, Databricks, Apache Spark, Python, SQL
1mo
Save
Mark Applied
Hide
Sr. Data Platform Architect
San Jose or Durham or Mexico City or Bengaluru or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$179k-$299k/yr HybridFull Time
12+ YOE12+ years in data architecture/engineering with 5+ years on large-scale data platforms; expertise in SQL, Apache Spark, Kubernetes, Trino, Dremio, Informatica, CI/CD, security controls, and cloud platforms; Bachelor's required, advanced degree preferred.
SQL, Apache Spark, ETL/ELT, Kubernetes, Trino, Dremio, Informatica, CI/CD
5d
Save
Mark Applied
Hide
Capacity Engineer
Cupertino, California, United States
$60k-$149k/yr OnsiteFull Time
5+ YOERequires 5–8 years of experience in data engineering and SRE, with capacity planning, forecasting, scaling, pipeline development, data modeling, automation, monitoring, and resilience testing skills.
Python, SQL, Apache Spark, Apache Airflow, Terraform, Ansible, Harness, Prometheus, Grafana, Datadog
2mo
Save
Mark Applied
Hide
Lead Machine Learning Engineer (Manager IC)
McLean or Cambridge or New York City or San Jose
$197k-$246k/yr OnsiteFull Time
6+ YOE2+ MgmtBachelor's degree, 6+ years building data-intensive distributed systems, 4+ years programming in Python, Scala, or Java, and 2+ years building scalable ML systems. People leadership preferred.
Python, Scala, Java, scikit-learn, PyTorch, Dask, Apache Spark, TensorFlow, AWS, Microsoft Azure, Google Cloud Platform
3mo
Save
Mark Applied
Hide
Engineering Manager, Data Platform Orchestration
Los Gatos, California, United States
$436k-$791k/yr OnsiteFull Time
Experienced engineering leader with platform engineering background; experience running highly reliable, high-scale systems, building teams, partnering cross-functionally, and making technical trade-offs. Knowledge of orchestration and big data technologies desirable.
Maestro, Iceberg, Apache Spark, Trino/Presto, Snowflake, BigQuery, Amazon RedShift, Druid, LanceDB, Pensive, Nightingale
1w
Save
Mark Applied
Hide
Software Engineer
San Jose, California, United States
$138k-$199k/yr HybridFull Time
Master’s degree in computer science, engineering, or related field; experience building scalable microservices, APIs, distributed systems, databases, cloud deployments, security, data processing, and machine learning.
Java 21, Spring Boot 3.x, Spring Data JPA, Python 3.10+, Django REST Framework, Flask RESTful, REST, GraphQL, gRPC, Git, Google Kubernetes Engine, Google Pub/Sub, GCP, MySQL, PostgreSQL, Cloud Spanner, OAuth2, JWT, Hadoop, Apache Spark
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Ads Measurement Signal (Multiple Positions)
San Jose, California, United States
$265k-$450k/yr OnsiteFull Time
2+ YOEMaster's (+2yrs) or Bachelor's (+5yrs) in CS/Engineering/Data Science/Mathematics or related; 2+ yrs experience designing RCTs, C++, Apache Spark, and Go for large-scale ad measurement; strong communication and analytical skills.
C++, Apache Spark, Go
1w
Save
Mark Applied
Hide
Senior Full Stack Software Engineer
San Jose, California, United States
$182k-$226k/yr HybridFull Time
Significant professional software development experience; proficiency with JavaScript/Node.js/React/TypeScript and Python; experience with data pipelines, relational databases, AWS, and on-call support.
JavaScript, Node.js, React, TypeScript, Python, Pandas, PySpark, REST APIs, PostgreSQL, MySQL, Microsoft SQL Server, AWS, Ignition SCADA, CI/CD
Explore Jobs