HiringCafe
Join our community

227 pyspark developer jobs at 106 companies in Mountain View, CA

1mo
Save
Mark Applied
Hide
Software Development Engineer – Data & Cloud Engineering
San Jose, California, United States
$139k-$258k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
3+ YOE3+ years software development experience (Java, C++), experience with PySpark/Spark and cloud platforms (AWS or Azure); BS in CS/Engineering or equivalent experience; strong problem-solving and communication skills.
Java, C++, PySpark, Spark, Hadoop, Databricks, AWS, Azure, Docker, Kubernetes
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Software Engineer II
San Mateo or Ottawa
$126k-$158k/yr HybridFull Time
SurveyMonkey
SurveyMonkey: Provides online survey software and data collection tools.
8+ YOE8+ years ML development; AWS infrastructure; Python (Pandas/NumPy); NLP/LLMs; PySpark; Unix/Linux; real-time applications; Bachelor’s in CS/DS/SE/Math/Stats.
Python, Pandas, NumPy, PyTorch, transformers, AWS, Spark, PySpark, Unix/Linux
Job PostingView all
3w
Save
Mark Applied
Hide
(USA) Senior, Software Engineer
Bentonville or Sunnyvale
$90k-$234k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
6+ YOE6+ years data/software engineering experience with strong Python/PySpark/SQL skills, 4+ years on GCP, experience with data pipelines, CI/CD, LangChain/LangGraph and RAG/Agentic AI architectures.
Python, Scala, Apache Spark, PySpark, Airflow, Dataproc, Cloud Scheduler, Cloud Storage, BigQuery, Apache Hudi, GitHub Actions, Terraform, LangChain, LangGraph, Vertex AI, Cloud Functions, Cloud Dataflow, Jenkins, GitHub, Azure DevOps, SQL, shell scripting
Job PostingView all
6d
Save
Mark Applied
Hide
Staff Data Engineer - Quickbooks Capital and Lending
Mountain View, California, United States
$203k-$274k/yr OnsiteFull Time
Intuit
IntuitNASDAQ: INTU: Provides financial software for accounting, tax, and personal finance.
7+ YOE7+ years data engineering experience with Python, PySpark, Spark, SQL, Data Bricks/DataBricks, AWS, Elastic Search, Kafka; BS/MS in CS or equivalent; production support and on-call experience; SDLC familiarity.
Python, PySpark, Spark, SQL, Data Bricks, DataBricks, AWS, Elastic Search, Kafka
Job PostingView all
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
New York or Los Angeles or San Francisco
$140k-$175k/yr HybridFull Time
Regard
Regard: A that builds AI-powered software to improve clinical documentation and advance patient care.
3+ YOEBS or equivalent, 3+ years data engineering experience, Python and SQL proficiency, experience with PySpark and distributed data processing, AWS experience preferred, LLM-assisted development familiarity, and willingness to participate in on-call support.
S3, Apache Iceberg, EMR, PySpark, Dagster, Kubernetes, ClickHouse, PostgreSQL, FastAPI, Metabase, Python, SQL, AWS, AWS Athena, EHR, OMOP CDM, HIPAA, LLM
Job PostingView all
3mo
Save
Mark Applied
Hide
Staff II Software Engineer AI/ML Ops
Pleasanton, California, United States
$245k-$307k/yr OnsiteFull Time
BlackLine
BlackLineNasdaq: BL: Cloud platform for automating financial close and accounting processes.
Lead data pipelines and ML/AI integration; design and maintain PySpark ETL, CI/CD, governance guardrails, and collaboration with data science teams.
PySpark, FiveTran, Plaid, MLflow, TensorFlow, PyTorch, LangChain, LangGraph, Airflow, Kubeflow, Kubernetes, Docker, CI/CD, Git
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Machine Learning Engineer - LMTS
San Francisco or Palo Alto or Bellevue
$173k-$286k/yr HybridFull Time
Salesforce
SalesforceNYSE: CRM: Sells cloud-based customer relationship management and business software solutions.
3+ YOE3+ years data science (3-5+ preferred) with 2+ years in cybersecurity; hands-on with Spark/PySpark, Snowflake, Flink, Apache Kafka; Docker, Kubernetes, Apache Airflow; Python, TensorFlow, PyTorch; MLOps/CI/CD, feature stores, ML governance; strong communication and stakeholder management.
Spark, PySpark, Snowflake, Flink, Apache Kafka, Docker, Kubernetes, Apache Airflow, Python, TensorFlow, PyTorch, CI/CD
Job PostingView all
2mo
Save
Mark Applied
Hide
Machine Learning Software Engineer Intern - Winter 2027
San Francisco or New York City
HybridInternship, Temporary
Rippling
Rippling: Unified platform managing workforce HR, IT, and finance operations
Currently enrolled in an M.Sc. or Ph.D. in computer science or related field; strong backend programming skills (Python, PySpark, PyTorch); ML experience, LLM familiarity preferred; excellent communication and learning mindset.
Python, PySpark, PyTorch, LLMs
Job PostingView all
3mo
Save
Mark Applied
Hide
Software Engineer II
San Francisco, California, United States
$151k-$227k/yr HybridFull Time
The Trade Desk
The Trade DeskNASDAQ: TTD: Cloud-based programmatic advertising platform for data-driven media buying.
Backend software engineer responsible for designing, developing, and maintaining services and data processing pipelines.
Java, Scala, Python, Kubernetes, Docker, GitLab CI, Apache Spark
Job PostingView all
1w
Save
Mark Applied
Hide
Senior System Software Engineer
Santa Clara or Champaign or Redmond
$184k-$357k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
9+ YOE9+ years software development experience, 5+ years data platform development, proficiency in C++, Java, Scala, CUDA; BS/MS/PhD in computer science or equivalent; experience with Apache Spark and supporting enterprise customers.
C++, CUDA, Java, Scala, Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion, RAPIDS, CCCL, UCX
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
San Francisco, California, United States
$140k-$230k/yr OnsiteFull Time
ReadyOn
ReadyOn: AI-native labor operating system for frontline enterprise workforces.
5+ YOE5+ years data engineering experience; strong SQL; Python; TypeScript; Airflow; AWS Glue; PySpark; Snowflake/PostgreSQL; backend frameworks; observability and data quality mechanisms.
Python, TypeScript, Apache Airflow, PySpark, AWS Glue, Snowflake, PostgreSQL, NestJS, GraphQL, AWS
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Quality Engineer
Palo Alto, California, United States
$67-$88/hr HybridFull Time
Stanford Health Care
Stanford Health Care: Provides comprehensive medical care, specialized treatments, and clinical research.
3+ YOEBS/BA required. 7+ years reporting/analytics/BI/healthcare tech OR 3+ years cloud datalake development (PySpark on Databricks) with DevOps/CI/CD. Strong SQL, data modeling, metadata, MDM and governance experience.
Databricks Unity Catalog, Databricks, PySpark, Notebooks, GitHub, SQL, Azure, CI/CD, DevOps
Job PostingView all
5d
Save
Mark Applied
Hide
Principal Engineer, AWS Athena and Glue ETL
Bellevue or New York or East Palo Alto
$200k-$311k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
15+ YOE15+ years software development, BS in CS or equivalent, deep distributed systems and multi-tenant compute experience, leadership on cross-functional initiatives, expertise in latency and utilization optimization.
Apache Spark, Trino, Presto, Spark SQL, Apache Iceberg, Hive Metastore, VPC, Linux
Job PostingView all
3mo
Save
Mark Applied
Hide
Software Engineer (Python) - Supply Chain Integration
Sunnyvale or California or United States
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
4+ YOE4+ years of Python software development, REST APIs, data processing, distributed computing, and unit/integration testing.
FastAPI, Django REST Framework, Flask, Pandas, NumPy, Polars, PySpark, Celery, Dask, Docker, Kubernetes, Redis, Apache Airflow, ORMs
Job PostingView all
4w
Save
Mark Applied
Hide
Software Engineer, Web Products
Mountain View, California, United States
$136k-$205k/yr OnsiteFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
4+ YOE4+ years software engineering experience building production web systems; strong web stack fundamentals; experience with CMS (Drupal, Contentful); comfort with AI-native development tools; familiarity with headless CMS, edge delivery, or modern frontend frameworks.
Drupal, Contentful, Apache Spark, Delta Lake, MLflow
Job PostingView all
1d
Save
Mark Applied
Hide
Staff Data Engineer
San Francisco or New York City
$185k-$195k/yr HybridFull Time
Butterfly Network
Butterfly NetworkNYSE: BFLY: Handheld whole-body ultrasound scanners powered by semiconductor technology.
5+ YOE5+ years data engineering experience, strong dbt and Databricks skills, Python/PySpark, streaming and CDC ingestion, data quality and observability, experience with operational integrations.
dbt, Databricks, Python, PySpark, Delta Lake, Delta Live Tables, Airflow, Cloud Run, Cloud Functions, BigQuery, GCP, AWS, Salesforce, NetSuite, Stripe, Mulesoft, Great Expectations, Unity Catalog, Terraform, Spacelift, Boomi
Job PostingView all
3mo
Save
Mark Applied
Hide
Principal Software Engineer - Search
Seattle or San Francisco
$193k-$328k/yr HybridFull Time
DocuSign
DocuSignNASDAQ: DOCU: Provides electronic signature and agreement management software solutions.
15+ YOE15+ years in software development with OO languages; large-scale data systems, search engines; cloud experience; Agile/CI/CD; leadership of complex projects.
Elasticsearch, Solr, Apache Spark, Kafka, Azure, AWS, GCP, C#/.NET, Java, SQL Server, React, OCR, VectorDBs, LLMs
Job PostingView all
1w
Save
Mark Applied
Hide
Senior System Software Engineer
Santa Clara or Champaign or Redmond
$184k-$357k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
9+ YOE9+ years software development experience; proficiency in C++, Java, Scala and CUDA; experience with data platform and distributed systems; enterprise customer support and open source contributions.
C++, Java, Scala, CUDA, Apache Spark, RAPIDS, CCCL, UCX, Apache Arrow, Velox, Presto, Apache DataFusion, Parquet, ORC, JSON
Job PostingView all
2w
Save
Mark Applied
Hide
Sr. Data Engineer
San Francisco, California, United States
$120k-$160k/yr HybridFull Time
SS&C Technologies
SS&C TechnologiesNasdaq: SSNC: Provides software and technology for financial and healthcare sectors.
Experienced in data modeling, large-scale data pipelines, ETL/ELT, Python and PySpark, machine learning/NLP, data warehousing, and collaboration across engineering and product teams.
Python, numpy, pandas, scikit-learn, nltk, TensorFlow, matplotlib, PySpark
Job PostingView all

Explore Jobs

Expand Your Job Search