San Francisco • 50 milesRemote · Hybrid · Onsite · Field · All Environments
San Francisco • 50 milesRemote · Hybrid · Onsite · Field · All Environments
San Francisco • 50 milesRemote · Hybrid · Onsite · Field · All Environments
San Francisco • 50 milesRemote · Hybrid · Onsite · Field · All Environments
945 spark jobs at 273 companies in San Francisco, CA
3mo
Save
Mark Applied
Hide
Spark Engineer
Sunnyvale, California, United States
OnsiteFull Time
5+ YOE5+ years in software development; data engineering with pipelines; Python/Perl/Shell; Java; Oracle/MySQL; real-time pipelines with Kafka/Storm.
Python, Perl, Shell, Java, Oracle, MySQL, Kafka, Storm, HDFS, Hive, Pig, Oozie, HBase, Spark
2w
Save
Mark Applied
Hide
Software Engineer, Spark Platform
San Francisco or Seattle or Sunnyvale or New York City
$131k-$285k/yr HybridFull Time
24+ YOERequires a CS degree or equivalent, 24+ years operating production distributed systems, Spark at scale, Kubernetes, cloud infrastructure, observability, and professional Python, Go, Scala, or Java with SQL fluency.
Apache Spark, Kubernetes, YuniKorn, Volcano, Kueue, Prometheus, OpenTelemetry, AWS, Python, Go, Scala, Java, SQL, Databricks, Amazon EMR
1mo
Save
Mark Applied
Hide
Software Engineer, Spark Platform
San Francisco or Sunnyvale or Seattle or New York City
$131k-$285k/yr HybridFull Time
24+ YOEExperience operating production distributed systems and Apache Spark at scale, Kubernetes production experience, familiarity with schedulers and observability stacks, cloud (AWS) experience, programming in Python/Go/Scala/Java, and SQL fluency. BS/MS/PhD in CS or equivalent.
Apache Spark, Amazon EMR, Databricks, Kubernetes, YuniKorn, Volcano, Kueue, Spark-on-Kubernetes operator, Prometheus, OpenTelemetry, Python, Go, Scala, Java, SQL, VPC
3mo
Save
Mark Applied
Hide
Principal Machine Learning Engineer, Accelerated Apache Spark
Santa Clara, California, United States
$272k-$431k/yr OnsiteFull Time
12+ YOESenior ML/DS engineer with 12+ years of experience; 5+ years leading ML model development; strong Python and ML tooling; experience with GPU-accelerated Spark; expertise in ML methods and feature engineering.
Python, numpy, pandas, scikit-learn, scipy, pytorch, tensorflow, Apache Spark, Scala, Java, C++, XGBoost
3mo
Save
Mark Applied
Hide
Principal Machine Learning Engineer, Accelerated Apache Spark
Santa Clara, California, United States
$272k-$431k/yr OnsiteFull Time
12+ YOEBS/MS/PhD or equivalent; 12+ years ML/DL experience; 5+ years as technical lead; 2+ years with Apache Spark; strong Python and data-science libraries experience; expertise in LLM/GenAI, RL, XGBoost; leadership and deployment experience.
Apache Spark, Python, numpy, pandas, scikit-learn, scipy, PyTorch, TensorFlow, XGBoost, CUDA, Scala, Java, C++
2w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
McLean or New York City or Richmond or San Francisco or Philadelphia or Canada or United Kingdom or Philippines
$179k-$246k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, and 1+ year cloud computing; Python, SQL, data pipelines, and cloud technologies required.
Python, Amazon Web Services (AWS), Apache Spark, Apache Kafka, SQL, Snowflake, Databricks, Generative AI (GenAI), Open Source RDBMS, NoSQL, MapReduce, Hadoop, Hive, Amazon EMR, MySQL, Mongo, Cassandra, Redshift, UNIX, Linux, Claude Code, GitHub Copilot, AWS Glue, ETL
2mo
Save
Mark Applied
Hide
Applied AI/ML Senior Associate - Payments
New York or Palo Alto or Seattle
$128k-$195k/yr OnsiteFull Time
3+ YOEMaster’s in a quantitative field; 3+ years in industry; AWS, PySpark, SQL; Python ML; NLP/LLM; Spark; TensorFlow/PyTorch; strong communication.
Shell Scripting, Jupyter, SQL, PySpark, AWS, SageMaker, Python, TensorFlow, PyTorch, NumPy, Scikit-Learn, Pandas, Spark
2mo
Save
Mark Applied
Hide
Data Engineer
San Francisco, California, United States
$160k-$180k/yr OnsiteFull Time
Proficient in production-quality Python/Scala, Spark, AWS, REST APIs; data platform design; remote work experience; strong database skills.
Python, Scala, Spark, AWS, REST API, Athena, Glue, EMR, Lambda, API Gateway
1w
Save
Mark Applied
Hide
Practice Customer Engineer, Data Analytics, Google Cloud
Sunnyvale or Atlanta or Austin or Boulder or Chicago or Kirkland or Los Angeles or New York City or Seattle or San Francisco or Portland or Phoenix or Playa Vista
$192k-$267k/yr OnsiteFull Time
10+ YOEBachelor's degree or equivalent, 10 years in cloud-native architecture, Big Data expertise, technical stakeholder engagement, and programming experience with Python, Spark, or SQL.
Google Cloud, Python, Spark, SQL, Informatica, Talend, Alooma, SAP, Data Services, Java, JavaScript, C++, Scala, R, Go, DNS, TCP, Linux, Microsoft Windows, VPN, VPC
2mo
Save
Mark Applied
Hide
Senior Data Scientist
San Francisco or Mountain View
$123k-$218k/yr OnsiteFull Time
Experience applying Data Science/ML in production; strong Python/Scala, SQL; knowledge of Spark/Hadoop; BS/MS/PhD in CS or related field.
Python, Scala, Spark, Hadoop, SQL, R
2w
Save
Mark Applied
Hide
Senior Software Engineer, Data Lake
Bellevue or Menlo Park or New York or Toronto
$196k-$230k/yr HybridFull Time
5+ YOE5+ years building backend or distributed data systems; proficiency with Java/Scala/Python, Kafka/Flink/Spark, Postgres and CDC, AWS S3, and Kubernetes.
Java, Scala, Python, Postgres, Kafka, Flink, Spark, AWS S3, Kubernetes, Rocket CDC
3mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer – GeoAI Platform
San Francisco or Bellevue
$185k-$275k/yr HybridFull Time
5+ YOE5+ years building distributed data or ML systems; experience with Ray/Spark/Dask, GPU inference, Python and scientific stack; geospatial and object-storage expertise.
Ray, Spark, Dask, Python, PyTorch, PyArrow, NumPy, Xarray, Zarr, Cloud-Optimized GeoTIFF (COG), GeoParquet, Parquet, S3, CUDA
3mo
Save
Mark Applied
Hide
(USA) Senior, Software Engineer
Sunnyvale, California, United States
$117k-$234k/yr OnsiteFull Time
3+ YOEBachelor's degree or equivalent experience, strong Java and scalable systems experience, familiarity with Kafka/Spark/Hadoop/GCP/Scala, experience designing high-throughput microservices.
Java, Kafka, Spark, Cassandra, Solr, Elastic, Hadoop, Hive, Google Cloud Platform (GCP), Spark Streaming, Scala
1mo
Save
Mark Applied
Hide
Site Reliability Engineer, Compute Platform
San Jose, California, United States
OnsiteFull Time
Experience with Linux, networking, databases, Kubernetes, ClickHouse/Hadoop/Doris/Spark/Presto, scripting or programming (Python, Shell, Java, Go), incident management, and capacity planning.
ClickHouse, Spark, Presto, Doris, Hadoop, Kubernetes, Linux, Python, Shell, Java, Go
3mo
Save
Mark Applied
Hide
Senior Staff Data Engineer - Data & ML Platform
San Francisco, California, United States
$240k-$360k/yr HybridFull Time
10+ YOE10+ years data engineering experience; platform/infrastructure focus; Kafka, Flink, Spark, Python, SQL; ML platform infrastructure; mentoring; growth-stage experience.
Python, SQL, Spark, dbt, Kafka, Flink, Databricks, AWS
1w
Save
Mark Applied
Hide
Senior/Staff Machine Learning Engineer, Data Infrastructure
Mountain View or Bellevue
$200k-$261k/yr OnsiteFull Time
Strong Python and distributed-systems experience with Flink, Spark, or Ray; expertise in training data, ML feature pipelines, orchestration, scalability, reliability, performance, and cost optimization.
Flink, Spark, Ray, Flyte, Airflow, Python
1mo
Save
Mark Applied
Hide
Foundry Support Desk Engineer
Houston or New York City or San Francisco or Seattle
$80k-$100k/yr OnsiteFull Time
2+ YOE2+ years with Foundry or similar platforms, hands-on Spark and data-pipeline troubleshooting, experience with support triage/escalation, strong written and verbal communication, and documentation skills.
Foundry, Spark, Palantir
2mo
Save
Mark Applied
Hide
Machine Learning Engineer - USDS (Multiple Positions)
San Jose, California, United States
$174k-$259k/yr OnsiteFull Time
1+ YOEMaster's+1yr or Bachelor's+3yrs in a quantitative field. Experience with Python or C++, PyTorch or TensorFlow, Linux, and Spark/Hadoop/Flink; building and deploying large-scale ML systems.
Python, C++, PyTorch, TensorFlow, Linux, Spark, Hadoop, Flink
1w
Save
Mark Applied
Hide
Senior Data Scientist – Commerce Supply Chain Optimization
San Mateo, California, United States
$170k-$210k/yr HybridFull Time
6+ YOERequires 6+ years building predictive models, Python, SQL, Spark, forecasting, optimization, feature engineering, and stakeholder communication. Bachelor's or Master's in a relevant quantitative field required.
Python, Pandas, Scikit-learn, NumPy, SQL, Spark, ARIMA, XGBoost, LSTM, DeepAR, Superset, Tableau
1w
Save
Mark Applied
Hide
Staff AI Engineer
Sunnyvale or San Francisco or New York City
$175k-$287k/yr HybridFull Time
LinkedInNASDAQ: MSFT: Professional social network for career development and job recruitment.
4+ YOEBachelor's degree or equivalent practical experience; 4+ years in software development and machine learning; experience with Java, Python, ML systems, PyTorch, Spark, and large-scale AI.
Java, Python, PyTorch, Spark, ClaudeCode, Codex, Copilot, LLM, A/B testing
Explore Jobs
Expand Your Job Search
Top Cities Near San Francisco for Spark
- Spark jobs in San Jose, CA
- Spark jobs in Oakland, CA
- Spark jobs in Fremont, CA
- Spark jobs in Santa Rosa, CA
- Spark jobs in Hayward, CA
- Spark jobs in Sunnyvale, CA
- Spark jobs in Concord, CA
- Spark jobs in Santa Clara, CA
- Spark jobs in Vallejo, CA
- Spark jobs in Berkeley, CA
- Spark jobs in Fairfield, CA
- Spark jobs in Antioch, CA
- Spark jobs in Richmond, CA
- Spark jobs in Daly City, CA
- Spark jobs in San Mateo, CA
- Spark jobs in Vacaville, CA
- Spark jobs in San Leandro, CA
- Spark jobs in Livermore, CA
- Spark jobs in Redwood City, CA
- Spark jobs in Mountain View, CA