HiringCafe
Join our community

126 pyspark developer jobs at 63 companies in Fairfield, CA

2mo
Save
Mark Applied
Hide
Senior Software Engineer II
San Mateo or Ottawa
$126k-$158k/yr HybridFull Time
SurveyMonkey
SurveyMonkey: Provides online survey software and data collection tools.
8+ YOE8+ years ML development; AWS infrastructure; Python (Pandas/NumPy); NLP/LLMs; PySpark; Unix/Linux; real-time applications; Bachelor’s in CS/DS/SE/Math/Stats.
Python, Pandas, NumPy, PyTorch, transformers, AWS, Spark, PySpark, Unix/Linux
Job PostingView all
3mo
Save
Mark Applied
Hide
AI Engineer
Rancho Cordova, California, United States
$110k-$150k/yr HybridFull Time
GEI Consultants
GEI Consultants: Provides multi-disciplinary engineering and environmental consulting services.
4+ YOE4+ years software engineering; Generative AI with LLMs; Azure experience; Python/PySpark/R/SQL; data integration; Azure/Databricks tooling; security and ethics in AI.
Python, PySpark, R, SQL, Azure, Azure Functions, Azure AI Platform, Databricks, TensorFlow, PyTorch, Copilot Studio, Power BI, GPT, Codex, DALL·E
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior, Software Engineer
Sunnyvale or Bentonville or San Francisco or New York or New Jersey
$117k-$234k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
8+ YOE8+ years building highly available Java backend systems, RESTful microservices, SQL/NoSQL, caching, Kafka, unit/integration testing (JUnit, Mockito), and experience with Spark/Scala/PySpark/Python and API design.
Java, RESTful microservices, Cosmos DB, Microsoft Azure SQL, BigQuery, Redis, Memcached, Kafka, JUnit, Mockito, Mock MVC, Apache Spark, Scala, PySpark, Python, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
New York or Los Angeles or San Francisco
$140k-$175k/yr HybridFull Time
Regard
Regard: A that builds AI-powered software to improve clinical documentation and advance patient care.
3+ YOEBS or equivalent, 3+ years data engineering experience, Python and SQL proficiency, experience with PySpark and distributed data processing, AWS experience preferred, LLM-assisted development familiarity, and willingness to participate in on-call support.
S3, Apache Iceberg, EMR, PySpark, Dagster, Kubernetes, ClickHouse, PostgreSQL, FastAPI, Metabase, Python, SQL, AWS, AWS Athena, EHR, OMOP CDM, HIPAA, LLM
Job PostingView all
3mo
Save
Mark Applied
Hide
Staff II Software Engineer AI/ML Ops
Pleasanton, California, United States
$245k-$307k/yr OnsiteFull Time
BlackLine
BlackLineNasdaq: BL: Cloud platform for automating financial close and accounting processes.
Lead data pipelines and ML/AI integration; design and maintain PySpark ETL, CI/CD, governance guardrails, and collaboration with data science teams.
PySpark, FiveTran, Plaid, MLflow, TensorFlow, PyTorch, LangChain, LangGraph, Airflow, Kubeflow, Kubernetes, Docker, CI/CD, Git
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Machine Learning Engineer - LMTS
San Francisco or Palo Alto or Bellevue
$173k-$286k/yr HybridFull Time
Salesforce
SalesforceNYSE: CRM: Sells cloud-based customer relationship management and business software solutions.
3+ YOE3+ years data science (3-5+ preferred) with 2+ years in cybersecurity; hands-on with Spark/PySpark, Snowflake, Flink, Apache Kafka; Docker, Kubernetes, Apache Airflow; Python, TensorFlow, PyTorch; MLOps/CI/CD, feature stores, ML governance; strong communication and stakeholder management.
Spark, PySpark, Snowflake, Flink, Apache Kafka, Docker, Kubernetes, Apache Airflow, Python, TensorFlow, PyTorch, CI/CD
Job PostingView all
2mo
Save
Mark Applied
Hide
Machine Learning Software Engineer Intern - Winter 2027
San Francisco or New York City
HybridInternship, Temporary
Rippling
Rippling: Unified platform managing workforce HR, IT, and finance operations
Currently enrolled in an M.Sc. or Ph.D. in computer science or related field; strong backend programming skills (Python, PySpark, PyTorch); ML experience, LLM familiarity preferred; excellent communication and learning mindset.
Python, PySpark, PyTorch, LLMs
Job PostingView all
3mo
Save
Mark Applied
Hide
Software Engineer II
San Francisco, California, United States
$151k-$227k/yr HybridFull Time
The Trade Desk
The Trade DeskNASDAQ: TTD: Cloud-based programmatic advertising platform for data-driven media buying.
Backend software engineer responsible for designing, developing, and maintaining services and data processing pipelines.
Java, Scala, Python, Kubernetes, Docker, GitLab CI, Apache Spark
Job PostingView all
1mo
Save
Mark Applied
Hide
Part-Time Student Worker Automation & Behavioral Science Engineer
Foster City, California, United States
$30/hr OnsiteContract, Full Time
Zoox
ZooxNASDAQ: AMZN: Developing autonomous robotaxis for urban ride-hailing services.
Currently pursuing a B.S. or M.S. in a quantitative field; strong Python, SQL, Pyspark or Scala, and ML/statistics skills; ability to run experiments, work independently on ambiguous problems, and commute to Foster City for a 6-month contract.
Python, SQL, Pyspark, Scala, RAG, LLMs, vision-language models (VLMs)
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
San Francisco, California, United States
$140k-$230k/yr OnsiteFull Time
ReadyOn
ReadyOn: AI-native labor operating system for frontline enterprise workforces.
5+ YOE5+ years data engineering experience; strong SQL; Python; TypeScript; Airflow; AWS Glue; PySpark; Snowflake/PostgreSQL; backend frameworks; observability and data quality mechanisms.
Python, TypeScript, Apache Airflow, PySpark, AWS Glue, Snowflake, PostgreSQL, NestJS, GraphQL, AWS
Job PostingView all
3mo
Save
Mark Applied
Hide
Software Engineer, ML platform and Infrastructure
Austin Metro Area or San Francisco Bay Area
HybridFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
5+ YOE5+ years backend software development; 2+ years with LLMs/Agent Frameworks; 5+ years cloud (AWS/GCP)
AWS, Google Cloud Platform, Apache Spark, Apache Flink, Apache Iceberg, Snowflake, APIs, Distributed systems
Job PostingView all
3mo
Save
Mark Applied
Hide
Principal Software Engineer - Search
Seattle or San Francisco
$193k-$328k/yr HybridFull Time
DocuSign
DocuSignNASDAQ: DOCU: Provides electronic signature and agreement management software solutions.
15+ YOE15+ years in software development with OO languages; large-scale data systems, search engines; cloud experience; Agile/CI/CD; leadership of complex projects.
Elasticsearch, Solr, Apache Spark, Kafka, Azure, AWS, GCP, C#/.NET, Java, SQL Server, React, OCR, VectorDBs, LLMs
Job PostingView all
1w
Save
Mark Applied
Hide
Sr. Data Engineer
San Francisco, California, United States
$120k-$160k/yr HybridFull Time
SS&C Technologies
SS&C TechnologiesNasdaq: SSNC: Provides software and technology for financial and healthcare sectors.
Experienced in data modeling, large-scale data pipelines, ETL/ELT, Python and PySpark, machine learning/NLP, data warehousing, and collaboration across engineering and product teams.
Python, numpy, pandas, scikit-learn, nltk, TensorFlow, matplotlib, PySpark
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior BI & Analytics Developer
San Ramon or Atlanta or Century City or Los Angeles or El Segundo or Duluth
$119k-$162k/yr OnsiteFull Time
Armanino
Armanino: Provides accounting, tax, and consulting services to diverse organizations.
3+ YOE3+ years in analytics/BI/data engineering; hands-on Microsoft Fabric, Microsoft Power BI, SQL, Python/PySpark, and Git; strong dimensional modeling, governance, and stakeholder collaboration skills.
Microsoft Fabric, Microsoft Power BI, SQL, Python, PySpark, DAX, Git
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Denver or San Francisco or Nashville or Santiago
$157k-$218k/yr OnsiteFull Time
Checkr
Checkr: AI-powered platform for background checks and identity verification.
5+ YOE5+ years engineering experience building scalable data platforms; proficiency in Python, PySpark, SQL; experience with ETL/ELT, batch and stream processing; familiarity with Kafka, Spark, Iceberg, AWS services.
Python, PySpark, SQL, MongoDB, Kafka, Spark, Iceberg, AWS, EKS, EMR, Glue, Athena, S3, Databricks, Snowflake
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
Foster City, California, United States
$123k-$191k/yr HybridFull Time
Visa
VisaNYSE: V: Global payment technology facilitating electronic funds transfers.
2+ YOE2+ years experience with a bachelor’s degree or advanced degree; strong Python, SQL, PySpark; Hadoop ecosystem; AWS data services; Airflow; CI/CD; data quality and observability; ability to collaborate with stakeholders.
Python, SQL, PySpark, Hadoop, Spark, Pandas, Airflow, Snowflake, Databricks, AWS, S3, EMR, Glue Catalog, Claude Code
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yr RemoteFull Time
Samsara
SamsaraNYSE: IOT: Connected Operations Cloud platform for physical operations and IoT.
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
Spark, PySpark, Databricks, Python, SQL, Snowflake, Google BigQuery, Apache Iceberg, Fivetran, dbt, NetSuite, Salesforce, MySQL, AWS RDS/Aurora, PostgreSQL, Oracle, Microsoft SQL Server, AWS, Azure, GCP, Splunk, Datadog, AWS CloudWatch, API Gateway, Lambda, S3, SNS, SQS, SecretsManager, MCP (Model Context Protocol)
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City
$120k-$235k/yr OnsiteFull Time
Microsoft
MicrosoftNASDAQ: MSFT: Develops software, services, devices, and cloud computing solutions.
3+ YOEMaster's (3+ yrs) or Bachelor's (4+ yrs) in CS/Math/Engineering or equivalent experience; experience building production data systems, instrumentation/telemetry, experimentation, PySpark/SQL, and mentoring engineers; must pass Microsoft background checks.
ADLS, Azure Synapse, Microsoft Fabric, Databricks, PySpark, SQL, Cosmos, Scope, Conform, Aria
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Data Engineer - Data & ML Platform
San Francisco, California, United States
$198k-$296k/yr HybridFull Time
Hinge Health
Hinge HealthNYSE: HNGE: Digital provider of musculoskeletal care and physical therapy
8+ YOE8+ years data engineering; strong Python and SQL; distributed processing (PySpark/Flink); cloud pipelines; mentoring.
Python, SQL, Flink, PySpark, Kafka, Delta Lake, dbt, Airflow, Aurora PostgreSQL, AWS
Job PostingView all

Explore Jobs

Expand Your Job Search