85 pyspark data engineer jobs at 48 companies in Freedom, CA

2d
Save
Mark Applied
Hide
Data Engineer
Santa Clara or United States
$110k-$120k/yr RemoteFull Time
Qualitest
Qualitest: AI-powered software testing and quality engineering services.
Requires Python and PySpark, cloud data platform experience with Snowflake or Databricks, pipeline design and orchestration, Spark tuning, CI/CD, DevOps, version control, and scalable data solution collaboration.
Python, PySpark, Snowflake, Databricks, Terraform, CI/CD, DevOps, QCraft, Microsoft Azure
1mo
Save
Mark Applied
Hide
Data Science Engineer
San Jose or California or United States
$109k-$201k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
8+ YOESenior data engineer with 8+ years experience, distributed data and cloud technologies (Hadoop, Spark, Databricks, S3, EMR), streaming (Kafka/Kinesis), strong SQL and Python/PySpark/Scala skills, CI/CD and orchestration experience, and strong communication.
Hadoop, Hive, Presto, Spark, Databricks, S3, Azure Blob Storage, Notebooks, AWS EMR, Athena, Glue, Delta, Parquet, ORC, Kafka, Kinesis, SQL, Python, PySpark, Scala, Pandas, NumPy, Koalas, APIs, GitHub, Jenkins, Apache Air Flow, Azkaban, AEP, AJO, CJA, Adobe Experience Platform, Adobe Analytics, Customer Journey Analytics, Adobe Journey Optimizer, Collibra, JIRA, Confluence, Copilot, Claude, LLAMA, Databricks Genie, n8n, RAG, MCPs, GenStudio, Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud
3w
Save
Mark Applied
Hide
Staff Data Engineer
Sunnyvale, California, United States
$200k-$260k/yr OnsiteFull Time
RADAR
RADAR: Real-time inventory tracking using RFID and computer vision technology.
8+ YOE8+ years data/analytics engineering experience, strong SQL and Python, experience with batch and streaming pipelines, data modeling, data quality, testing, monitoring, and mentoring engineers.
Airflow, Apache Beam, Python, SQL, Apache Spark, Dagster, dbt, Kafka Streams, Flink, Looker, Tableau, Git, Snowflake, Databricks, BigQuery, Docker
1mo
Save
Mark Applied
Hide
Senior, Data Engineer
Sunnyvale or Bentonville
$90k-$234k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
2+ YOEDesign and operate large-scale data pipelines on GCP using Spark, Airflow, BigQuery; optimize cloud cost; build automation and AI-driven engineering tools; 2+ years data engineering experience.
Spark, Scala, PySpark, Airflow, BigQuery, GCP, Python, Kafka, GCS
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Redwood City, California, United States
$185k-$240k/yr HybridFull Time
NimbleRx
NimbleRx: Digital platform for on-demand prescription delivery and pharmacy management.
5+ YOE5+ years building production data pipelines; strong Python (PySpark) and SQL; experience with Spark/EMR, Kinesis, Lambda, Step Functions; Postgres; Iceberg/Trino; Java/Spring; CI/CD and Terraform; AI tooling; cross-team collaboration.
PySpark, SQL, Java, Spring Boot, Kinesis, EMR, S3, Postgres, Iceberg, Trino, Terraform, CI/CD
1mo
Save
Mark Applied
Hide
Sr. Data Engineer
Palo Alto, California, United States
$145k-$220k/yr RemoteFull Time
Allocate
Allocate: A fintech providing a data-rich platform for discovering, modeling, and managing private market investments.
5+ YOE5+ years data engineering experience; strong AWS (S3, EC2, EKS, Redshift, Glue, Athena) and cloud skills; SQL, Python, data modeling, ETL/ELT, and pipeline production experience; familiarity with vector DBs and ML data workflows.
S3, EC2, ECS, EKS, Athena, Redshift, Glue, Step Functions, Terraform, CloudFormation, SQL, Snowflake, Databricks Delta Lake, Neo4j, AWS Neptune, Python, pandas, PySpark, TypeScript, Node.js, C#, Postgres pgvector, Chroma, Pinecone, LangChain, LlamaIndex, Docker, Kubernetes, Kafka, Kinesis, Airflow, Prefect, dbt
1mo
Save
Mark Applied
Hide
AI Data Engineer
Palo Alto or Atlanta or Washington
$160k-$200k/yr HybridFull Time
Quantifind
Quantifind: AI-driven platform for financial risk and fraud detection.
4+ YOEUS citizen with 4+ years' experience, technical education, strong Python and AWS skills, experience with large-scale ETL, Spark/PySpark, PostgreSQL/RDS, Neo4j, and hands-on AI coding tools; must be able to meet in person.
Claude Code, GPT/Codex, Cursor, Windsurf, PostgreSQL, RDS, Python, Spark/PySpark, Scala, AWS, Neo4j
2mo
Save
Mark Applied
Hide
Sr. Enterprise Data Engineer
Palo Alto, California, United States
$67-$88/hr HybridFull Time
Stanford Health Care
Stanford Health Care: Provides comprehensive medical care, specialized treatments, and clinical research.
3+ YOEBS/BA required. 7+ years in reporting/analytics/BI/healthcare tech OR 3+ years developing cloud data lake solutions (PySpark on Databricks) with DevOps/CI/CD. Advanced SQL, data modeling, Azure, and GitHub experience.
Databricks, PySpark, Notebooks, GitHub, Microsoft Azure, SQL, DevOps, CI/CD
18h
Save
Mark Applied
Hide
Principal Data Engineer - CoreAI
Redmond or Mountain View
$143k-$275k/yr HybridFull Time
Microsoft
MicrosoftNASDAQ: MSFT: Develops software, services, devices, and cloud computing solutions.
4+ YOEMaster's and 4+ years or bachelor's and 6+ years in data engineering, software development, analytics, data science, or modeling; security screening required.
Azure, Azure Data Lake, Spark, Synapse, SQL, Azure Data Explorer, PySpark
1d
Save
Mark Applied
Hide
Data Engineer/Senior Data Engineer
Santa Clara, California, United States
$130k-$200k/yr HybridFull Time
PlusAI
PlusAI: AI-based virtual driver software for factory-built autonomous trucks.
BS, MS, PhD, or equivalent experience; Python proficiency; scalable data processing or evaluation frameworks; large-scale time-series, event, or geospatial analysis; LLM-powered workflows; strong problem-solving and communication.
Python, Apache Spark, Airflow, Argo Workflows, LangChain, LangGraph, PostGIS, GeoPandas
1d
Save
Mark Applied
Hide
Data Engineer Intern (Monetization Data) - 2027 Summer
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
OnsiteInternship
TikTok
TikTok: Global short-form video hosting and social media platform.
Currently pursuing an undergraduate or master's degree in computer science, engineering, or related field; strong SQL, database, programming, data modeling, ETL/ELT, communication, and problem-solving skills.
SQL, Python, Java, Go, Apache Hadoop, Apache Spark, Apache Kafka, Apache Flink, Snowflake, Databricks, BigQuery
1mo
Save
Mark Applied
Hide
Associate Data Engineer
Redwood City, California, United States
$138k-$164k/yr HybridFull Time
Stanford University
Stanford University: A private research university providing higher education and research.
5+ YOEBachelor's degree plus 5 years relevant experience. Expertise in SQL, Python/PySpark, cloud data services, data modeling, ETL/ELT, and strong communication skills.
Advanced SQL, Advanced Python, SQL, Python, PySpark, S3, Redshift, Glue ETL, IAM, DMS, Appflow, VPC, AWS Services, SnowFlake, FiveTran, KAFKA, Airflow, Oracle Cloud, Scala, R
2w
Save
Mark Applied
Hide
Data DevOps Engineer
Santa Clara, California, United States
$200k-$220k/yr OnsiteFull Time
Versa Networks
Versa Networks: Provides secure SD-WAN and cloud-native security software.
8+ YOE8+ years experience building and operating multitenant Spark and Kafka clusters; infrastructure automation with Jenkins/Ansible/Terraform; strong Python/Scala/Java skills; data processing and database experience.
Apache Spark, Apache Kafka, Jenkins, Ansible, Terraform, Python, Scala, Java
3w
Save
Mark Applied
Hide
Staff Data Engineer - Quickbooks Capital and Lending
Mountain View, California, United States
$203k-$274k/yr OnsiteFull Time
Intuit
IntuitNASDAQ: INTU: Provides financial software for accounting, tax, and personal finance.
7+ YOE7+ years data engineering experience with Python, PySpark, Spark, SQL, Data Bricks/DataBricks, AWS, Elastic Search, Kafka; BS/MS in CS or equivalent; production support and on-call experience; SDLC familiarity.
Python, PySpark, Spark, SQL, Data Bricks, DataBricks, AWS, Elastic Search, Kafka
1mo
Save
Mark Applied
Hide
Senior Databricks Developer, SAP S/4 Data Products and Governance
Santa Clara, California, United States
$184k-$288k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
12+ YOE12+ years in data engineering or analytics engineering with strong Databricks, PySpark/Apache Spark, SQL, Delta Lake, and SAP S/4HANA or ECC experience; governance and mentoring experience.
Databricks, PySpark, Apache Spark, SQL, Delta Lake, Unity Catalog, Immuta, SAP S/4HANA, SAP ECC, CDS views, ODP/ODQ, SLT, SAP Datasphere, SAP BW, BODS, APIs/OData, Tableau, Power BI, Alteryx, Dataiku, Git, Databricks Asset Bundles
1mo
Save
Mark Applied
Hide
Senior Databricks Developer, SAP S/4 Data Products and Governance
Santa Clara, California, United States
$184k-$288k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
12+ YOE12+ years data engineering experience; bachelor's or master's in computer science/IS/business or equivalent; strong Databricks, PySpark, SQL, Delta Lake skills; SAP S/4HANA data experience; Unity Catalog and governance experience.
Databricks, Apache Spark, PySpark, SQL, Delta Lake, Unity Catalog, Immuta, SAP Business Data Cloud, SAP Datasphere, SAP BW, SAP SLT, ODP/ODQ, CDS views, BODS, APIs/OData, Tableau, Power BI, Alteryx, Dataiku, Git, Databricks Asset Bundles
2w
Save
Mark Applied
Hide
Senior Data Engineering Manager
United States or New York City or Austin or Miami or Mountain View
$215k/yr RemoteFull Time
YipitData
YipitData: Providing alternative data and research for institutional investors.
8+ YOE3+ Mgmt8+ years data engineering experience, 3+ years people management, hands-on with SQL, PySpark, Databricks, Airflow, strong data modeling and observability skills, experience scaling production data systems.
Claude Code, Codex, Cursor, Databricks, Airflow, SQL, PySpark
2mo
Save
Mark Applied
Hide
Senior Software Engineer - Data Insights
San Jose, California, United States
$323k-$428k/yr HybridFull Time
Roku
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
8+ YOE8+ years software/data engineering; big data tech; Spark/Airflow; distributed systems; SQL; cloud and containers; Python/Java/Scala; AdTech experience preferred.
Apache Spark, Apache Airflow, Druid, StarRocks, Trino, Spring Boot, Looker, Python, Java, Scala, AWS, GCP, Azure, Docker, Kubernetes, Hadoop, Kafka
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Server Fleet Infrastructure
Livingston or New York or Sunnyvale or San Francisco or Bellevue
$153k-$204k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
4+ YOEBachelor's degree, 4+ years data engineering experience, strong SQL, Python/Java/Scala, experience with data lakes, ETL pipelines, orchestration and observability tools (Airflow, Spark), and cloud platforms.
Apache Iceberg, Trino, Apache Airflow, Apache Spark, Apache Superset, SQL, Python, Java, Scala, AWS, GCP, Azure
2d
Save
Mark Applied
Hide
Senior Data Scientist
Santa Clara, California, United States
$125k-$201k/yr HybridFull Time
Johnson & Johnson
Johnson & JohnsonNYSE: JNJ: Develops and manufactures pharmaceutical drugs and medical devices.
5+ YOEBachelor's or master's degree in a technical field and 5+ years in data science, engineering, or analytics. Requires Python, SQL, distributed data frameworks, data modeling, cloud platforms, machine learning, and cross-functional communication.
Python, SQL, Apache Spark, Databricks, AWS, Microsoft Azure, Power BI, Delta Lake, ERP, CRM