HiringCafe
Join our community

415 pyspark jobs at 149 companies in San Jose, CA

1mo
Save
Mark Applied
Hide
Sr. Software Engineer - PySpark
Scottsdale or San Francisco or Chicago or New York City
$118k-$152k/yr HybridFull Time
Early Warning Services
Early Warning Services: U.S. bank-owned fintech and consumer reporting agency providing identity, fraud-risk, and real-time payment solutions to financial institutions.
5+ YOEBachelor's-level education typical; minimum 5 years software engineering experience; strong with Git, Spring/Spring Boot, SQL, REST, Docker/Kubernetes, Kafka, automated testing and DevOps practices.
Git, Git flow, Spring, Spring Boot, SQL, Confluence, CI/CD, Docker, Kubernetes, Kafka, Hadoop, Hive, XML, JSON, YAML, Redis, HBASE, AeroSpike, REST
Job PostingView all
5d
Save
Mark Applied
Hide
Senior Data Analyst (MedTech)
United States or New York City or Austin or Miami or Denver or Mountain View or Seattle or Hong Kong or Shanghai or Beijing or Guangzhou or Singapore
$73k-$90k/yr RemoteFull Time
YipitData
YipitData: Private market intelligence and alternative-data analytics firm serving institutional investors, retailers, brands, and enterprises.
Strong analytical, problem-solving, communication, attention-to-detail, prioritization, and ownership skills; willingness to learn SQL, PySpark, and Python.
SQL, Python, PySpark
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer
Santa Clara, California, United States
$110k-$120k/yr RemoteFull Time
QualityAI
QualityAI: AI-first quality engineering and software testing firm.
Build scalable batch and streaming data pipelines using Python, PySpark, Databricks, Snowflake, orchestration, monitoring, CI/CD, DevOps, and cloud optimization practices.
Python, PySpark, Databricks, Snowflake, Terraform, CI/CD, DevOps, QCraft, Microsoft HSA
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Quantitative Scientist, Implementation
San Francisco or Knoxville or New York City or United States
$141k-$177k/yr HybridFull Time
Verana Health
Verana Health: Digital health providing real-world data, analytics, and clinical research services to clinicians and life sciences companies.
5+ YOEMaster’s or doctorate in a quantitative field or equivalent experience; 5+ years with healthcare datasets and advanced analytics; expertise in R, Python, PySpark, AWS, Databricks, and Git workflows.
R, Python, PySpark, AWS, Databricks, GitHub, Git
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Data Engineer
San Francisco or New York City
$185k-$195k/yr HybridFull Time
Butterfly Network
Butterfly NetworkNew York Stock Exchange: BFLY: Public U.S. medical technology making handheld point-of-care ultrasound hardware and AI-powered clinical software for healthcare professionals.
5+ YOE5+ years data engineering experience, strong dbt and Databricks skills, Python/PySpark, streaming and CDC ingestion, data quality and observability, experience with operational integrations.
dbt, Databricks, Python, PySpark, Delta Lake, Delta Live Tables, Airflow, Cloud Run, Cloud Functions, BigQuery, GCP, AWS, Salesforce, NetSuite, Stripe, Mulesoft, Great Expectations, Unity Catalog, Terraform, Spacelift, Boomi
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Engineer
San Francisco, California, United States
$140k-$230k/yr OnsiteFull Time
ReadyOn
ReadyOn: ReadyOn is a private SaaS providing AI-powered labor operations software for frontline enterprises.
5+ YOE5+ years data engineering experience; strong SQL; Python; TypeScript; Airflow; AWS Glue; PySpark; Snowflake/PostgreSQL; backend frameworks; observability and data quality mechanisms.
Python, TypeScript, Apache Airflow, PySpark, AWS Glue, Snowflake, PostgreSQL, NestJS, GraphQL, AWS
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco, California, United States
$133k-$236k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Empowering everyone to create through innovative digital experiences.
5+ YOE5+ years data engineering experience; proficiency in SQL, Python, PySpark, Airflow, Databricks; experience with high-volume telemetry, AI/ML data pipelines, and data governance.
SQL, Python, PySpark, Airflow, Databricks, Unity Catalog, Azure
Job PostingView all
1w
Save
Mark Applied
Hide
AI Software Engineer (KBase Project)
Berkeley, California, United States
$117k-$146k/yr OnsiteFull Time, Contract
Environmental Genomics and Systems Biology
Environmental Genomics and Systems Biology: A national laboratory conducting scientific research for the U.S. Department of Energy.
5+ YOEBachelor's degree or equivalent and 5+ years in AI agent frameworks, data engineering, and scientific software development; proficiency in Python, LangChain, LangGraph, CrewAI, PySpark, and Delta Lake.
Python, LangChain, LangGraph, CrewAI, KBase, KBase Datastore, Delta Lake, PySpark, PyTorch, TensorFlow, Scikit-learn, GitHub, Agile
Job PostingView all
19h
Save
Mark Applied
Hide
Sr. Azure Databricks Data Engineer / Architect
San Francisco or Irvine
$100k-$117k/yr HybridFull Time
Cognizant
CognizantNASDAQ: CTSH: Global professional services providing technology and consulting services.
Strong Azure Databricks, PySpark, ADF, SQL, PL/SQL, Azure DevOps, data lake, governance, and security experience; bachelor's degree or equivalent professional experience required.
Azure Databricks, Azure Data Services, Python, PySpark, Azure Data Factory (ADF), Oracle Data Integrator (ODI), SQL, PL/SQL, Microsoft Azure, Azure DevOps, Azure Key Vault, Microsoft Fabric, Databricks Workflows
Job PostingView all
1w
Save
Mark Applied
Hide
Databricks Developer
San Jose or United States or Canada
OnsiteFull Time
Tredence
Tredence: Private data science and AI consultancy helping enterprises turn insights into realized business value.
4+ YOEBachelor's or master's degree in a relevant field; 4–8 years in data engineering and analytics; 3+ years with Databricks and PySpark; Agile experience; advanced Python and SQL skills.
Databricks, Databricks Lakehouse Architecture, PySpark, Python, SQL, Delta Lake, Unity Catalog, Azure Databricks, Azure Data Lake Storage (ADLS), Azure Data Factory, Azure Synapse Analytics, Azure DevOps, GitHub Actions
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Product Analyst, Corporate
New York City or Austin or Miami or Mountain View or United States or India or Asia
$150k/yr RemoteFull Time
YipitData
YipitData: Private market intelligence and alternative-data analytics firm serving institutional investors, retailers, brands, and enterprises.
4+ YOE4+ years in data analytics or operations; strong SQL, Python, and PySpark skills; familiarity with GitHub and Databricks; experience with sample/panel data, data QA, and client communication.
SQL, Python, PySpark, GitHub, Databricks
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or San Francisco
$170k-$200k/yr HybridFull Time
Tatari
Tatari: Private ad-tech helping brands and agencies buy, measure, and optimize ads across linear and streaming TV.
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Denver or San Francisco
$190k-$264k/yr HybridFull Time
Checkr
Checkr: AI verification platform providing background, identity, employment, mortgage, tenant, and trust checks for businesses and individuals.
10+ YOE10+ years building scalable data platforms; expert PySpark, Python, SQL; experience with Kafka, Spark, Iceberg, data lakes, AWS; strong data modeling and security awareness.
PySpark, Python, SQL, MongoDB, Kafka, Spark, Iceberg, EKS, EMR, Serverless, Glue, Athena, S3, Databricks, Snowflake
Job PostingView all
3w
Save
Mark Applied
Hide
Staff, Data Scientist (Recommendation)
Sunnyvale, California, United States
$143k-$286k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Global retail, e-commerce, and supply chain.
2+ YOEBachelor's degree and 4 years, master's degree and 2 years, or 6 years of analytics experience; expertise in machine learning, recommendation systems, Python, Java, PySpark, TensorFlow, and PyTorch.
Java, Python, PySpark, TensorFlow, PyTorch, scikit-learn, Spark, Scala, R, Large Language Model (LLM), Graph Neural Network, Web Content Accessibility Guidelines (WCAG) 2.2 AA
Job PostingView all
1d
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services delivering 360° value.
3+ YOERequires 3+ years in data engineering, cloud platforms, and Python, PySpark, or Java; 1+ year with Palantir Foundry, prompt engineering, and applied AI; bachelor's degree or equivalent experience.
Palantir Foundry, Palantir Artificial Intelligence Platform (AIP), Palantir Gotham, Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Microsoft GitHub, GitLab, Jenkins, JavaScript
Job PostingView all
2w
Save
Mark Applied
Hide
Customer Success Insights Engineer
Santa Clara, California, United States
$168k-$322k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Computing platform for AI and accelerated graphics.
8+ YOEBS or equivalent experience; 8+ years in data or analytics engineering; expertise in Spark, PySpark, Delta Lake, Databricks Workflows, SQL, Python, LLM agents, APIs, and executive dashboards.
Databricks, Apache Spark, PySpark, Delta Lake, Databricks Workflows, Unity Catalog, SQL, Python, Salesforce, GitHub, GitLab, Claude Code, Codex, Cursor, Nemotron
Job PostingView all
1w
Save
Mark Applied
Hide
Optimization Data Analyst
San Francisco, California, United States
$132k-$178k/yr OnsiteFull Time
Adyen
AdyenEuronext Amsterdam: ADYEN: Global financial technology platform for payments and financial services.
3+ YOERequires 3–5 years of analytics or data science experience, Python, SQL, PySpark, scalable ETL and data pipelines, Spark, Airflow, Git, visualization tools, statistics, and stakeholder management.
Python, SQL, PySpark, Spark, Airflow, Git, Looker, Tableau
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Forward Deployment Engineer
New York City or San Francisco or Princeton
RemoteFull Time
Quantiphi
Quantiphi: AI-first digital engineering helping enterprises solve complex business problems with artificial intelligence, cloud, and data engineering.
9+ YOERequires 9+ years of software engineering experience, expertise in full-stack development, data architecture, React, JavaScript/TypeScript, Python, FastAPI, PostgreSQL, Redis, PySpark, AWS, and technical leadership.
React, JavaScript, TypeScript, Python, FastAPI, PostgreSQL, RDS, Aurora, Redis, PySpark, Kestra, AWS, EKS, Kubernetes, GitHub Copilot, Cursor, LLM
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Scientist II
San Francisco or Ottawa or Phoenix or Toronto or Los Angeles or Denver or Salt Lake City or Atlanta or Chicago or Houston or Portland or New York City or Vancouver or San Diego or Washington, D.C. or Sacramento or Jacksonville or Seattle or Mexico City or Austin or Miami or Boston or Dallas
$97k-$184k/yr HybridFull Time
Scribd, Inc.
Scribd, Inc.: AI-powered knowledge serving global readers, professionals, and learners through document, presentation, reading, and social book platforms.
3+ YOE3+ years building and deploying ML models at scale, proficiency in Python, SQL/PySpark, Spark/Databricks, experience with NLP, deep learning and generative models, BS/MS in quantitative field.
Scikit-learn, NumPy, PyTorch, Python, SQL, Apache Spark, Databricks, PySpark
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Databricks Developer, SAP S/4 Data Products and Governance
Santa Clara, California, United States
$184k-$288k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Computing platform for AI and accelerated graphics.
12+ YOE12+ years in data or enterprise platform engineering; strong Databricks, PySpark, SQL, Delta Lake, SAP S/4HANA or ECC, Unity Catalog, data governance, quality, and mentoring experience.
Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Immuta, SAP S/4HANA, SAP ECC, CDS views, ODP/ODQ, SLT, SAP Datasphere, SAP BW extractors, BODS, APIs/OData, SAP Business Data Cloud, Tableau, Power BI, Alteryx, Dataiku, CI/CD, Git, Databricks Asset Bundles
Job PostingView all

Explore Jobs

Expand Your Job Search