70 pyspark data engineer jobs at 46 companies in Soquel, CA

2mo
Save
Mark Applied
Hide
Sr. Data Engineer
Foster City, California, United States
$123k-$191k/yr HybridFull Time
Visa
VisaNYSE: V: Global payment technology facilitating electronic funds transfers.
2+ YOE2+ years experience with a bachelor’s degree or advanced degree; strong Python, SQL, PySpark; Hadoop ecosystem; AWS data services; Airflow; CI/CD; data quality and observability; ability to collaborate with stakeholders.
Python, SQL, PySpark, Hadoop, Spark, Pandas, Airflow, Snowflake, Databricks, AWS, S3, EMR, Glue Catalog, Claude Code
1mo
Save
Mark Applied
Hide
Data Science Engineer
San Jose or California or United States
$109k-$201k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
8+ YOESenior data engineer with 8+ years experience, distributed data and cloud technologies (Hadoop, Spark, Databricks, S3, EMR), streaming (Kafka/Kinesis), strong SQL and Python/PySpark/Scala skills, CI/CD and orchestration experience, and strong communication.
Hadoop, Hive, Presto, Spark, Databricks, S3, Azure Blob Storage, Notebooks, AWS EMR, Athena, Glue, Delta, Parquet, ORC, Kafka, Kinesis, SQL, Python, PySpark, Scala, Pandas, NumPy, Koalas, APIs, GitHub, Jenkins, Apache Air Flow, Azkaban, AEP, AJO, CJA, Adobe Experience Platform, Adobe Analytics, Customer Journey Analytics, Adobe Journey Optimizer, Collibra, JIRA, Confluence, Copilot, Claude, LLAMA, Databricks Genie, n8n, RAG, MCPs, GenStudio, Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud
1w
Save
Mark Applied
Hide
Staff Data Engineer
Sunnyvale, California, United States
$200k-$260k/yr OnsiteFull Time
RADAR
RADAR: Real-time inventory tracking using RFID and computer vision technology.
8+ YOE8+ years data/analytics engineering experience, strong SQL and Python, experience with batch and streaming pipelines, data modeling, data quality, testing, monitoring, and mentoring engineers.
Airflow, Apache Beam, Python, SQL, Apache Spark, Dagster, dbt, Kafka Streams, Flink, Looker, Tableau, Git, Snowflake, Databricks, BigQuery, Docker
3w
Save
Mark Applied
Hide
Senior, Data Engineer
Sunnyvale or Bentonville
$90k-$234k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
2+ YOEDesign and operate large-scale data pipelines on GCP using Spark, Airflow, BigQuery; optimize cloud cost; build automation and AI-driven engineering tools; 2+ years data engineering experience.
Spark, Scala, PySpark, Airflow, BigQuery, GCP, Python, Kafka, GCS
3w
Save
Mark Applied
Hide
Staff Data Engineer
Mountain View or San Diego
$189k-$259k/yr OnsiteFull Time
Intuit
IntuitNASDAQ: INTU: Provides financial software for accounting, tax, and personal finance.
7+ YOE7+ years experience in data analytics/engineering, bachelor's in a quantitative field, proficiency in Java or Python, ETL/data modeling, big data frameworks, and visualization tools; strong communication skills.
Java, Python, Tableau, Qlik, PowerBI, Apache Spark, Hadoop, Databricks
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Mateo or New York City
$140k-$160k/yr HybridFull Time
Chartmetric
Chartmetric: Provides a global music data analytics platform for professionals.
6+ YOE6+ years building production data systems; expert in Python, PostgreSQL, Airflow, Clickhouse, Snowflake, Elasticsearch, Spark, and AWS; Bachelor's in CS/Data Engineering or equivalent experience.
Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, AWS, AWS RDS
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Redwood City, California, United States
$185k-$240k/yr HybridFull Time
NimbleRx
NimbleRx: Digital platform for on-demand prescription delivery and pharmacy management.
5+ YOE5+ years building production data pipelines; strong Python (PySpark) and SQL; experience with Spark/EMR, Kinesis, Lambda, Step Functions; Postgres; Iceberg/Trino; Java/Spring; CI/CD and Terraform; AI tooling; cross-team collaboration.
PySpark, SQL, Java, Spring Boot, Kinesis, EMR, S3, Postgres, Iceberg, Trino, Terraform, CI/CD
3w
Save
Mark Applied
Hide
Sr. Data Engineer
Palo Alto, California, United States
$145k-$220k/yr RemoteFull Time
Allocate
Allocate: A fintech providing a data-rich platform for discovering, modeling, and managing private market investments.
5+ YOE5+ years data engineering experience; strong AWS (S3, EC2, EKS, Redshift, Glue, Athena) and cloud skills; SQL, Python, data modeling, ETL/ELT, and pipeline production experience; familiarity with vector DBs and ML data workflows.
S3, EC2, ECS, EKS, Athena, Redshift, Glue, Step Functions, Terraform, CloudFormation, SQL, Snowflake, Databricks Delta Lake, Neo4j, AWS Neptune, Python, pandas, PySpark, TypeScript, Node.js, C#, Postgres pgvector, Chroma, Pinecone, LangChain, LlamaIndex, Docker, Kubernetes, Kafka, Kinesis, Airflow, Prefect, dbt
1mo
Save
Mark Applied
Hide
AI Data Engineer
Palo Alto or Atlanta or Washington
$160k-$200k/yr HybridFull Time
Quantifind
Quantifind: AI-driven platform for financial risk and fraud detection.
4+ YOEUS citizen with 4+ years' experience, technical education, strong Python and AWS skills, experience with large-scale ETL, Spark/PySpark, PostgreSQL/RDS, Neo4j, and hands-on AI coding tools; must be able to meet in person.
Claude Code, GPT/Codex, Cursor, Windsurf, PostgreSQL, RDS, Python, Spark/PySpark, Scala, AWS, Neo4j
2mo
Save
Mark Applied
Hide
Sr. Enterprise Data Engineer
Palo Alto, California, United States
$67-$88/hr HybridFull Time
Stanford Health Care
Stanford Health Care: Provides comprehensive medical care, specialized treatments, and clinical research.
3+ YOEBS/BA required. 7+ years in reporting/analytics/BI/healthcare tech OR 3+ years developing cloud data lake solutions (PySpark on Databricks) with DevOps/CI/CD. Advanced SQL, data modeling, Azure, and GitHub experience.
Databricks, PySpark, Notebooks, GitHub, Microsoft Azure, SQL, DevOps, CI/CD
3w
Save
Mark Applied
Hide
Senior Databricks Developer, SAP S/4 Data Products and Governance
Santa Clara, California, United States
$184k-$288k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
12+ YOE12+ years in data engineering or analytics engineering with strong Databricks, PySpark/Apache Spark, SQL, Delta Lake, and SAP S/4HANA or ECC experience; governance and mentoring experience.
Databricks, PySpark, Apache Spark, SQL, Delta Lake, Unity Catalog, Immuta, SAP S/4HANA, SAP ECC, CDS views, ODP/ODQ, SLT, SAP Datasphere, SAP BW, BODS, APIs/OData, Tableau, Power BI, Alteryx, Dataiku, Git, Databricks Asset Bundles
1w
Save
Mark Applied
Hide
Senior Data Engineering Manager
United States or New York City or Austin or Miami or Mountain View
$215k/yr RemoteFull Time
YipitData
YipitData: Providing alternative data and research for institutional investors.
8+ YOE3+ Mgmt8+ years data engineering experience, 3+ years people management, hands-on with SQL, PySpark, Databricks, Airflow, strong data modeling and observability skills, experience scaling production data systems.
Claude Code, Codex, Cursor, Databricks, Airflow, SQL, PySpark
2w
Save
Mark Applied
Hide
Part-Time Student Worker - Data Analyst
Foster City, California, United States
$30/hr OnsiteContract, Part Time
Zoox
ZooxNASDAQ: AMZN: Developing autonomous robotaxis for urban ride-hailing services.
Proficiency with SQL, PySpark, Python and Databricks; experience with time-series or sensor data; currently enrolled in B.S. or M.S. in CS/Data Science/Engineering or related; available ≥20 hrs/week for ≥6 months; onsite in Foster City.
SQL, PySpark, Python, Databricks
3w
Save
Mark Applied
Hide
Senior Software Engineer, Server Fleet Infrastructure
Livingston or New York or Sunnyvale or San Francisco or Bellevue
$153k-$204k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
4+ YOEBachelor's degree, 4+ years data engineering experience, strong SQL, Python/Java/Scala, experience with data lakes, ETL pipelines, orchestration and observability tools (Airflow, Spark), and cloud platforms.
Apache Iceberg, Trino, Apache Airflow, Apache Spark, Apache Superset, SQL, Python, Java, Scala, AWS, GCP, Azure
2mo
Save
Mark Applied
Hide
Senior Software Engineer - Data Insights
San Jose, California, United States
$323k-$428k/yr HybridFull Time
Roku
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
8+ YOE8+ years software/data engineering; big data tech; Spark/Airflow; distributed systems; SQL; cloud and containers; Python/Java/Scala; AdTech experience preferred.
Apache Spark, Apache Airflow, Druid, StarRocks, Trino, Spring Boot, Looker, Python, Java, Scala, AWS, GCP, Azure, Docker, Kubernetes, Hadoop, Kafka
4d
Save
Mark Applied
Hide
Senior Software Engineer, Data Engineering
San Mateo, California, United States
$243k-$295k/yr HybridFull Time
Roblox
RobloxNYSE: RBLX: Platform for creating and playing user-generated 3D digital experiences.
8+ YOE3+ Mgmt8+ years building scalable ETL pipelines, expertise in SQL/PySpark/Scala, experience with cloud platforms and ETL orchestration, 3+ years leading data engineering, strong debugging and collaboration skills.
Airflow, Dagster, Luigi, Google Cloud Composer, SQL, PySpark, Scala, AWS, GCP, Azure
4d
Save
Mark Applied
Hide
Principal Data Architect
Pleasanton, California, United States
$114k-$228k/yr OnsiteFull Time
Abbott
AbbottNYSE: ABT: Manufactures medical devices, diagnostics, and nutritional health products.
8+ YOE8+ years in data architecture/engineering, 5+ years building enterprise cloud data platforms; deep Databricks, AWS, Azure, SQL and Python experience; data governance, security, and healthcare data knowledge preferred.
Databricks, Delta Lake, Unity Catalog, Databricks Workflows, Databricks SQL, Spark, PySpark, AWS, S3, Glue, IAM, Redshift, Lambda, Kinesis, Lake Formation, Microsoft Azure, Azure Data Lake Storage (ADLS), Azure Data Factory, Synapse, Azure Key Vault, Microsoft Purview, SQL, Python, Kafka, Spark Structured Streaming, EMR/EHR, FHIR, HL7, MLOps
1mo
Save
Mark Applied
Hide
Research Scientist, Data
Palo Alto, California, United States
$185k-$400k/yr HybridFull Time
Pika
Pika: AI-powered platform for generating and editing professional videos
5+ YOE5+ years building and scaling ML data pipelines; expertise in data engineering for multimodal models; experience with distributed data systems, Python/SQL/PySpark, and cloud platforms; strong collaboration and data-ethics knowledge.
Spark, Hadoop, Ray, Python, SQL, PySpark, AWS, GCP, Azure
2w
Save
Mark Applied
Hide
Senior Director, Data Engineering
Pleasanton, California, United States
$219k-$297k/yr OnsiteFull Time
Albertsons Companies
Albertsons CompaniesNew York Stock Exchange: ACI: Operates supermarkets and pharmacies across the United States.
15+ YOE8+ Mgmt15+ years in data engineering, 8+ years leading teams, bachelor’s degree required (master's preferred), expert cloud and data platform experience, strong stakeholder and people leadership skills.
GCP, BigQuery, Dataflow, Pub/Sub, Composer, Airflow, Kafka, Flink, Python, SQL, Apache Spark, Power BI, Looker, LangChain, LangGraph, Google GenAI
1w
Save
Mark Applied
Hide
Staff Software Engineer, Data
Sunnyvale, California, United States
$224k-$322k/yr OnsiteFull Time
Intuitive
IntuitiveNASDAQ: ISRG: Robotic-assisted systems for minimally invasive surgery.
8+ YOEBachelor's or Master's degree, minimum 8 years software engineering experience building data-intensive services, expertise in Java/Go/Python, stream and batch processing, data pipelines, APIs, CI/CD, containers, and AWS.
Java, Go, Python, Apache Flink, Apache Spark, Apache Airflow, REST, GRPC, Postgres, DynamoDB, Gitlab CI/CD, AWS, Docker, Kubernetes, Amazon ECS, Amazon EKS