133 pyspark developer jobs at 59 companies in Soquel, CA
1mo
Save
Mark Applied
Hide
Associate Data Engineer
Redwood City, California, United States
$138k-$164k/yr HybridFull Time
5+ YOEBachelor's degree plus 5 years relevant experience. Expertise in SQL, Python/PySpark, cloud data services, data modeling, ETL/ELT, and strong communication skills.
Advanced SQL, Advanced Python, SQL, Python, PySpark, S3, Redshift, Glue ETL, IAM, DMS, Appflow, VPC, AWS Services, SnowFlake, FiveTran, KAFKA, Airflow, Oracle Cloud, Scala, R
1mo
Save
Mark Applied
Hide
(USA) Senior, Software Engineer
Bentonville or Sunnyvale
$90k-$234k/yr OnsiteFull Time
6+ YOE6+ years data/software engineering experience with strong Python/PySpark/SQL skills, 4+ years on GCP, experience with data pipelines, CI/CD, LangChain/LangGraph and RAG/Agentic AI architectures.
Python, Scala, Apache Spark, PySpark, Airflow, Dataproc, Cloud Scheduler, Cloud Storage, BigQuery, Apache Hudi, GitHub Actions, Terraform, LangChain, LangGraph, Vertex AI, Cloud Functions, Cloud Dataflow, Jenkins, GitHub, Azure DevOps, SQL, shell scripting
2w
Save
Mark Applied
Hide
Software Engineer AI/ML Ops
Pleasanton or New York City or Los Angeles
$145k-$182k/yr HybridFull Time
2+ YOE2+ years in Python/Java/Scala, experience building PySpark ETL, ML/LLM production pipelines, cloud (GCP/AWS/Azure), ML frameworks, orchestration, containerization, and observability.
PySpark, FiveTran, Plaid, TensorFlow, PyTorch, scikit-learn, Airflow, Kubeflow, Vertex AI, MLflow, GCP, AWS, Azure, LangChain, LangGraph, ADK, Prometheus, Grafana, Newrelic, Docker, Kubernetes, Bash, Python, Java, Scala
1w
Save
Mark Applied
Hide
Senior Software Engineer, Data Engineering
San Mateo, California, United States
$243k-$295k/yr HybridFull Time
8+ YOE3+ Mgmt8+ years building scalable ETL pipelines, expertise in SQL/PySpark/Scala, experience with cloud platforms and ETL orchestration, 3+ years leading data engineering, strong debugging and collaboration skills.
Airflow, Dagster, Luigi, Google Cloud Composer, SQL, PySpark, Scala, AWS, GCP, Azure
3w
Save
Mark Applied
Hide
Staff Data Engineer - Quickbooks Capital and Lending
Mountain View, California, United States
$203k-$274k/yr OnsiteFull Time
7+ YOE7+ years data engineering experience with Python, PySpark, Spark, SQL, Data Bricks/DataBricks, AWS, Elastic Search, Kafka; BS/MS in CS or equivalent; production support and on-call experience; SDLC familiarity.
Python, PySpark, Spark, SQL, Data Bricks, DataBricks, AWS, Elastic Search, Kafka
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
1mo
Save
Mark Applied
Hide
Machine Learning Engineer III
Pleasanton or Santa Clara or San Francisco
$160k-$240k/yr HybridFull Time
3+ YOE3+ years building and deploying production ML systems with deep learning, NLP, information retrieval, recommender systems; 2+ years Python; experience with PyTorch or TensorFlow, MLOps (Kubeflow, Docker/K8s), cloud (AWS/GCP), PySpark/SQL; advanced degree or strong research record preferred.
PyTorch, TensorFlow, LangChain, LangGraph, PySpark, SQL, Kubeflow, Docker, K8s, AWS, GCP, Python, PEFT, DeepEval, RAGAS, DSPy
1mo
Save
Mark Applied
Hide
Lead Machine Learning Engineer - LMTS
San Francisco or Palo Alto or Bellevue
$173k-$286k/yr HybridFull Time
3+ YOE3+ years data science (3-5+ preferred) with 2+ years in cybersecurity; hands-on with Spark/PySpark, Snowflake, Flink, Apache Kafka; Docker, Kubernetes, Apache Airflow; Python, TensorFlow, PyTorch; MLOps/CI/CD, feature stores, ML governance; strong communication and stakeholder management.
Spark, PySpark, Snowflake, Flink, Apache Kafka, Docker, Kubernetes, Apache Airflow, Python, TensorFlow, PyTorch, CI/CD
4w
Save
Mark Applied
Hide
Senior System Software Engineer
Santa Clara or Champaign or Redmond
$184k-$357k/yr OnsiteFull Time
9+ YOE9+ years software development experience, 5+ years data platform development, proficiency in C++, Java, Scala, CUDA; BS/MS/PhD in computer science or equivalent; experience with Apache Spark and supporting enterprise customers.
C++, CUDA, Java, Scala, Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion, RAPIDS, CCCL, UCX
3mo
Save
Mark Applied
Hide
Senior Data Quality Engineer
Palo Alto, California, United States
$67-$88/hr HybridFull Time
3+ YOEBS/BA required. 7+ years reporting/analytics/BI/healthcare tech OR 3+ years cloud datalake development (PySpark on Databricks) with DevOps/CI/CD. Strong SQL, data modeling, metadata, MDM and governance experience.
Databricks Unity Catalog, Databricks, PySpark, Notebooks, GitHub, SQL, Azure, CI/CD, DevOps
1w
Save
Mark Applied
Hide
Informatica PowerCenter & IDMC (IICS) Developer – Migration Specialist
Pleasanton, California, United States
OnsiteContract
13+ YOE13+ years experience with Informatica PowerCenter and IDMC (IICS), ETL development and migration, SQL/Oracle/SQL Server, CDI, performance tuning, testing, troubleshooting, deployment and production support.
Informatica PowerCenter, Informatica IDMC (IICS), Cloud Data Integration (CDI), ETL, SQL, Oracle, SQL Server, Azure Data Factory, Databricks, Azure Synapse, Python, PySpark, Agile/Scrum
1mo
Save
Mark Applied
Hide
Software Engineer, Web Products
Mountain View, California, United States
$136k-$205k/yr OnsiteFull Time
4+ YOE4+ years software engineering experience building production web systems; strong web stack fundamentals; experience with CMS (Drupal, Contentful); comfort with AI-native development tools; familiarity with headless CMS, edge delivery, or modern frontend frameworks.
Drupal, Contentful, Apache Spark, Delta Lake, MLflow
4w
Save
Mark Applied
Hide
Senior System Software Engineer
Santa Clara or Champaign or Redmond
$184k-$357k/yr OnsiteFull Time
9+ YOE9+ years software development experience; proficiency in C++, Java, Scala and CUDA; experience with data platform and distributed systems; enterprise customer support and open source contributions.
C++, Java, Scala, CUDA, Apache Spark, RAPIDS, CCCL, UCX, Apache Arrow, Velox, Presto, Apache DataFusion, Parquet, ORC, JSON
2mo
Save
Mark Applied
Hide
Software Development Engineer, Open Data Analytics - Engines
Redmond or East Palo Alto
$168k-$262k/yr OnsiteFull Time
5+ YOE5+ years professional software development and programming experience, 5+ years leading design/architecture, experience as a mentor or tech lead; bachelor's in computer science preferred.
EMR, Athena, Apache Spark, Trino, Apache Iceberg, Hudi, Delta, S3, EC2
3d
Save
Mark Applied
Hide
Sr Machine Learning Engineer
San Jose, California, United States
$170k-$244k/yr HybridFull Time
3+ YOEMaster's degree plus 3 years or bachelor's degree plus 5 years in computer science, engineering, or related work; Java, Python, big data, ML, CI/CD, containers, cloud, LLMs, and agent development.
Java, Python, Apache Spark, MapReduce, CI/CD, Docker, Kubernetes, GCP, AWS, Azure
3w
Save
Mark Applied
Hide
Senior Software Engineer, Infrastructure, Google Cloud
Sunnyvale, California, United States
$174k-$253k/yr OnsiteFull Time
5+ YOEBachelor's or equivalent,5+ years software development,3+ years building large-scale infrastructure or distributed systems,proficiency in C++, Java, Go, or Python,SQL and data analysis, BSc/advanced degree preferred.
C++, Java, Go, Python, SQL, Flume, Colossus, Spanner, Plx, IDX, Google Compute Engine (GCE), Apache Spark, Apache Beam
3d
Save
Mark Applied
Hide
Senior Software Engineer (10387, 10388, 10389)
Seattle or San Jose
$170k-$200k/yr HybridFull Time
5+ YOE5+ years software development experience, proficiency in Python/Java/Go/C++, experience designing large-scale distributed systems and cloud platforms, bachelor\u0002s degree or equivalent, strong problem-solving and leadership experience.
Python, Java, Go, C++, AWS, Azure, Google Cloud, Kafka, Spark, Flink, PySpark, MapReduce
1mo
Save
Mark Applied
Hide
Machine Learning Engineer - Demand Forecasting (TikTok Global E-commerce Supply Chain and Logistics)
San Jose, California, United States
$150k-$388k/yr OnsiteFull Time
Master's degree in CS/ML/Statistics, proven ML experience in demand forecasting, time series methods, big-data preprocessing (e.g., pyspark), model deployment and monitoring, strong analytical and communication skills.
pyspark
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
Foster City, California, United States
$123k-$191k/yr HybridFull Time
2+ YOE2+ years experience with a bachelor’s degree or advanced degree; strong Python, SQL, PySpark; Hadoop ecosystem; AWS data services; Airflow; CI/CD; data quality and observability; ability to collaborate with stakeholders.
Python, SQL, PySpark, Hadoop, Spark, Pandas, Airflow, Snowflake, Databricks, AWS, S3, EMR, Glue Catalog, Claude Code
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or Foster City or Orange County or Morristown
RemoteFull Time
5+ YOERequires 5+ years in data engineering, advanced SQL, Python, Spark/PySpark, Microsoft Fabric, Azure data services, APIs, data modeling, CI/CD, Git, and Azure DevOps; bachelor's degree or equivalent experience.
Microsoft Fabric, Lakehouse, Warehouse, Data Pipelines, Notebooks, OneLake, Git, Azure DevOps, Spark, PySpark, SQL, Python, Azure, Delta Lake, Parquet, REST APIs, JSON, Power BI, DP-600, DP-700
Explore Jobs