70 pyspark data engineer jobs at 46 companies in Soquel, CA
2mo
Save
Mark Applied
Hide
2mo
Sr. Data Engineer
Foster City, California, United States
$123k-$191k/yrHybridFull Time
VisaNYSE: V: Global payment technology facilitating electronic funds transfers.
2+ YOE2+ years experience with a bachelor’s degree or advanced degree; strong Python, SQL, PySpark; Hadoop ecosystem; AWS data services; Airflow; CI/CD; data quality and observability; ability to collaborate with stakeholders.
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
8+ YOESenior data engineer with 8+ years experience, distributed data and cloud technologies (Hadoop, Spark, Databricks, S3, EMR), streaming (Kafka/Kinesis), strong SQL and Python/PySpark/Scala skills, CI/CD and orchestration experience, and strong communication.
RADAR: Real-time inventory tracking using RFID and computer vision technology.
8+ YOE8+ years data/analytics engineering experience, strong SQL and Python, experience with batch and streaming pipelines, data modeling, data quality, testing, monitoring, and mentoring engineers.
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
2+ YOEDesign and operate large-scale data pipelines on GCP using Spark, Airflow, BigQuery; optimize cloud cost; build automation and AI-driven engineering tools; 2+ years data engineering experience.
IntuitNASDAQ: INTU: Provides financial software for accounting, tax, and personal finance.
7+ YOE7+ years experience in data analytics/engineering, bachelor's in a quantitative field, proficiency in Java or Python, ETL/data modeling, big data frameworks, and visualization tools; strong communication skills.
Chartmetric: Provides a global music data analytics platform for professionals.
6+ YOE6+ years building production data systems; expert in Python, PostgreSQL, Airflow, Clickhouse, Snowflake, Elasticsearch, Spark, and AWS; Bachelor's in CS/Data Engineering or equivalent experience.
NimbleRx: Digital platform for on-demand prescription delivery and pharmacy management.
5+ YOE5+ years building production data pipelines; strong Python (PySpark) and SQL; experience with Spark/EMR, Kinesis, Lambda, Step Functions; Postgres; Iceberg/Trino; Java/Spring; CI/CD and Terraform; AI tooling; cross-team collaboration.
Allocate: A fintech providing a data-rich platform for discovering, modeling, and managing private market investments.
5+ YOE5+ years data engineering experience; strong AWS (S3, EC2, EKS, Redshift, Glue, Athena) and cloud skills; SQL, Python, data modeling, ETL/ELT, and pipeline production experience; familiarity with vector DBs and ML data workflows.
Quantifind: AI-driven platform for financial risk and fraud detection.
4+ YOEUS citizen with 4+ years' experience, technical education, strong Python and AWS skills, experience with large-scale ETL, Spark/PySpark, PostgreSQL/RDS, Neo4j, and hands-on AI coding tools; must be able to meet in person.
Stanford Health Care: Provides comprehensive medical care, specialized treatments, and clinical research.
3+ YOEBS/BA required. 7+ years in reporting/analytics/BI/healthcare tech OR 3+ years developing cloud data lake solutions (PySpark on Databricks) with DevOps/CI/CD. Advanced SQL, data modeling, Azure, and GitHub experience.
Databricks, PySpark, Notebooks, GitHub, Microsoft Azure, SQL, DevOps, CI/CD
Senior Databricks Developer, SAP S/4 Data Products and Governance
Santa Clara, California, United States
$184k-$288k/yrOnsiteFull Time
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
12+ YOE12+ years in data engineering or analytics engineering with strong Databricks, PySpark/Apache Spark, SQL, Delta Lake, and SAP S/4HANA or ECC experience; governance and mentoring experience.
Databricks, PySpark, Apache Spark, SQL, Delta Lake, Unity Catalog, Immuta, SAP S/4HANA, SAP ECC, CDS views, ODP/ODQ, SLT, SAP Datasphere, SAP BW, BODS, APIs/OData, Tableau, Power BI, Alteryx, Dataiku, Git, Databricks Asset Bundles
United States or New York City or Austin or Miami or Mountain View
$215k/yrRemoteFull Time
YipitData: Providing alternative data and research for institutional investors.
8+ YOE3+ Mgmt8+ years data engineering experience, 3+ years people management, hands-on with SQL, PySpark, Databricks, Airflow, strong data modeling and observability skills, experience scaling production data systems.
Claude Code, Codex, Cursor, Databricks, Airflow, SQL, PySpark
ZooxNASDAQ: AMZN: Developing autonomous robotaxis for urban ride-hailing services.
Proficiency with SQL, PySpark, Python and Databricks; experience with time-series or sensor data; currently enrolled in B.S. or M.S. in CS/Data Science/Engineering or related; available ≥20 hrs/week for ≥6 months; onsite in Foster City.
Senior Software Engineer, Server Fleet Infrastructure
Livingston or New York or Sunnyvale or San Francisco or Bellevue
$153k-$204k/yrOnsiteFull Time
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
4+ YOEBachelor's degree, 4+ years data engineering experience, strong SQL, Python/Java/Scala, experience with data lakes, ETL pipelines, orchestration and observability tools (Airflow, Spark), and cloud platforms.
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
8+ YOE8+ years software/data engineering; big data tech; Spark/Airflow; distributed systems; SQL; cloud and containers; Python/Java/Scala; AdTech experience preferred.
RobloxNYSE: RBLX: Platform for creating and playing user-generated 3D digital experiences.
8+ YOE3+ Mgmt8+ years building scalable ETL pipelines, expertise in SQL/PySpark/Scala, experience with cloud platforms and ETL orchestration, 3+ years leading data engineering, strong debugging and collaboration skills.
AbbottNYSE: ABT: Manufactures medical devices, diagnostics, and nutritional health products.
8+ YOE8+ years in data architecture/engineering, 5+ years building enterprise cloud data platforms; deep Databricks, AWS, Azure, SQL and Python experience; data governance, security, and healthcare data knowledge preferred.
Databricks, Delta Lake, Unity Catalog, Databricks Workflows, Databricks SQL, Spark, PySpark, AWS, S3, Glue, IAM, Redshift, Lambda, Kinesis, Lake Formation, Microsoft Azure, Azure Data Lake Storage (ADLS), Azure Data Factory, Synapse, Azure Key Vault, Microsoft Purview, SQL, Python, Kafka, Spark Structured Streaming, EMR/EHR, FHIR, HL7, MLOps
Pika: AI-powered platform for generating and editing professional videos
5+ YOE5+ years building and scaling ML data pipelines; expertise in data engineering for multimodal models; experience with distributed data systems, Python/SQL/PySpark, and cloud platforms; strong collaboration and data-ethics knowledge.
Albertsons CompaniesNew York Stock Exchange: ACI: Operates supermarkets and pharmacies across the United States.
15+ YOE8+ Mgmt15+ years in data engineering, 8+ years leading teams, bachelor’s degree required (master's preferred), expert cloud and data platform experience, strong stakeholder and people leadership skills.
GCP, BigQuery, Dataflow, Pub/Sub, Composer, Airflow, Kafka, Flink, Python, SQL, Apache Spark, Power BI, Looker, LangChain, LangGraph, Google GenAI
IntuitiveNASDAQ: ISRG: Robotic-assisted systems for minimally invasive surgery.
8+ YOEBachelor's or Master's degree, minimum 8 years software engineering experience building data-intensive services, expertise in Java/Go/Python, stream and batch processing, data pipelines, APIs, CI/CD, containers, and AWS.