604 spark engineer jobs at 230 companies in Atherton, CA
2mo
Save
Mark Applied
Hide
Spark Engineer
Sunnyvale, California, United States
OnsiteFull Time
5+ YOE5+ years in software development; data engineering with pipelines; Python/Perl/Shell; Java; Oracle/MySQL; real-time pipelines with Kafka/Storm.
Python, Perl, Shell, Java, Oracle, MySQL, Kafka, Storm, HDFS, Hive, Pig, Oozie, HBase, Spark
2mo
Save
Mark Applied
Hide
Principal Machine Learning Engineer, Accelerated Apache Spark
Santa Clara, California, United States
$272k-$431k/yr OnsiteFull Time
12+ YOESenior ML/DS engineer with 12+ years of experience; 5+ years leading ML model development; strong Python and ML tooling; experience with GPU-accelerated Spark; expertise in ML methods and feature engineering.
Python, numpy, pandas, scikit-learn, scipy, pytorch, tensorflow, Apache Spark, Scala, Java, C++, XGBoost
1mo
Save
Mark Applied
Hide
Software Engineer, Spark Platform
San Francisco or Sunnyvale or Seattle or New York City
$131k-$285k/yr HybridFull Time
24+ YOEExperience operating production distributed systems and Apache Spark at scale, Kubernetes production experience, familiarity with schedulers and observability stacks, cloud (AWS) experience, programming in Python/Go/Scala/Java, and SQL fluency. BS/MS/PhD in CS or equivalent.
Apache Spark, Amazon EMR, Databricks, Kubernetes, YuniKorn, Volcano, Kueue, Spark-on-Kubernetes operator, Prometheus, OpenTelemetry, Python, Go, Scala, Java, SQL, VPC
2mo
Save
Mark Applied
Hide
Principal Machine Learning Engineer, Accelerated Apache Spark
Santa Clara, California, United States
$272k-$431k/yr OnsiteFull Time
12+ YOEBS/MS/PhD or equivalent; 12+ years ML/DL experience; 5+ years as technical lead; 2+ years with Apache Spark; strong Python and data-science libraries experience; expertise in LLM/GenAI, RL, XGBoost; leadership and deployment experience.
Apache Spark, Python, numpy, pandas, scikit-learn, scipy, PyTorch, TensorFlow, XGBoost, CUDA, Scala, Java, C++
1d
Save
Mark Applied
Hide
Software Engineer - Infrastructure (Senior+)
San Francisco or New York
$100k-$300k/yr OnsiteFull Time
5+ YOE5+ years infrastructure engineering experience, hands-on AWS, Clickhouse, Postgres, Spark; startup experience; security and on-prem deployment experience; able to drive large cross-stakeholder projects.
AWS, Clickhouse, Clickhouse Cloud, Postgres, Spark, GCP, Azure, Envoy, Istio, Hashicorp Vault, MicroVM (Runloop), SPIFFE, SPIRE
2mo
Save
Mark Applied
Hide
Staff Fullstack Engineer, Agentic Applications
Mountain View, California, United States
$192k-$260k/yr OnsiteFull Time
8+ YOE8+ years software engineering with 2+ years building production LLM/agentic applications; deep Python fluency; experience with agentic frameworks, REST/GraphQL integrations, Databricks/Spark, and technical leadership.
Python, LangChain, LangGraph, CrewAI, AutoGen, Semantic Kernel, RAG pipelines, REST, GraphQL, Databricks Unity Catalog, Databricks, Spark, Workday, Greenhouse, ADP, MLflow
1w
Save
Mark Applied
Hide
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yr RemoteFull Time
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Python, Golang, PostgreSQL (RDS), OpenSearch, Redshift, EMR, Spark, Docker, Lambda, AWS, EKS, SQS, SNS, S3, Kubernetes, Hadoop, Kafka, Microsoft Azure, GCP
1mo
Save
Mark Applied
Hide
Principal Engineer, Model Development Platform
Sunnyvale, California, United States
$296k-$335k/yr HybridFull Time
10+ YOE10+ years building large-scale distributed systems or ML infrastructure, 3+ years at staff/principal level, experience with Spark, Ray, Kubernetes, Airflow, MLflow, web frameworks, reliability engineering, and mentoring engineers.
Spark, Ray, Kubernetes, Airflow, MLflow, React, Flask, FastAPI
3w
Save
Mark Applied
Hide
Senior Software Engineer, Infrastructure, Managed Spark Platform and Foundations
Sunnyvale, California, United States
$174k-$253k/yr OnsiteFull Time
5+ YOEBachelor's degree or equivalent experience,5+ years software development,3+ years building large-scale distributed infrastructure,EMR/Excel not required,experience with distributed computing and API design.
Open Telemetry, JMX, Spark, Ray, Flink, Presto
1w
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or San Francisco
$170k-$200k/yr HybridFull Time
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
1w
Save
Mark Applied
Hide
Staff Data Engineer
Denver or San Francisco
$190k-$264k/yr HybridFull Time
10+ YOE10+ years building scalable data platforms; expert PySpark, Python, SQL; experience with Kafka, Spark, Iceberg, data lakes, AWS; strong data modeling and security awareness.
PySpark, Python, SQL, MongoDB, Kafka, Spark, Iceberg, EKS, EMR, Serverless, Glue, Athena, S3, Databricks, Snowflake
3w
Save
Mark Applied
Hide
Site Reliability Engineer, Compute Platform
San Jose, California, United States
$156k-$388k/yr OnsiteFull Time
Bachelor's in CS/Engineering, strong Linux, networking, databases, Kubernetes, SRE/DevOps toolset knowledge, experience with ClickHouse/Spark/Presto/Doris/Hadoop, coding in Python/Shell/Java/Go, strong problem-solving and communication.
ClickHouse, Spark, Presto, Doris, Hadoop, Kubernetes, Python, Shell, Java, Go
2mo
Save
Mark Applied
Hide
Staff Machine Learning Platform Engineer
Kitchener-Waterloo or Toronto or San Francisco
$216k-$297k/yr HybridFull Time
8+ YOE8+ years in production ML or data platforms; graduate degree in CS/Engineering/Statistics or related field; strong Databricks/Spark/Delta Lake/MLflow; Python/SQL; cloud and IaC; MLOps.
Databricks, Spark, Delta Lake, MLflow, Terraform, GitHub Actions, Kubernetes, AWS, S3, Python, SQL, Kotlin, Airflow, Snowflake, Unity Catalog
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or United States
$190k-$220k/yr HybridFull Time
5+ YOE5+ years building data-intensive SaaS platforms, deep Spark and distributed processing expertise, strong SQL and data modeling, experience with Airflow, Terraform, Databricks, dbt/Great Expectations, healthcare data and HIPAA, Python proficiency.
Python, Spark, SQL, R, Databricks, AWS, Airflow, Terraform, dbt, Great Expectations, Cursor, Claude, Copilot, Gemini, Databricks Genie, Next.js, React, TypeScript, Tailwind CSS, GitHub, Jira, Confluence, Kafka, Structured Streaming, CI/CD
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Mateo or New York
$140k-$160k/yr HybridFull Time
6+ YOE6+ years building production data systems; expert Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, and AWS; bachelor's in CS/Data Engineering preferred or equivalent experience.
Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, AWS RDS, AWS
1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
1w
Save
Mark Applied
Hide
Hardware Analytics Engineer
Sunnyvale, California, United States
$214k-$225k/yr HybridFull Time
3+ YOEMaster's degree in EE/CE/CS or related +3 years experience; expertise in large-scale data pipelines, Hive/Spark, Python/SQL, Tableau, Linux, ML for hardware reliability and performance; strong statistical and A/B testing skills.
Python, SQL, Tableau, Hive, Spark, Linux
3w
Save
Mark Applied
Hide
Site Reliability Engineer, Compute Platform
San Jose, California, United States
OnsiteFull Time
Experience with Linux, networking, databases, Kubernetes, ClickHouse/Hadoop/Doris/Spark/Presto, scripting or programming (Python, Shell, Java, Go), incident management, and capacity planning.
ClickHouse, Spark, Presto, Doris, Hadoop, Kubernetes, Linux, Python, Shell, Java, Go
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
San Jose, California, United States
HybridFull Time
5+ YOE5+ years applied machine learning experience; strong statistical, optimization, and experimental methodology knowledge; proficient in Spark, Python or Java; experience with real-time, low-latency systems and distributed ML frameworks.
Spark, Python, Java, Spark-MLlib, TensorFlow, Hive, Aerospike, ScyllaDB
1mo
Save
Mark Applied
Hide
Senior Staff Safety Analytics and Metrics Engineer - Robot Safety
San Carlos, California, United States
$170k-$259k/yr OnsiteFull Time
10+ YOE10+ years experience in safety analytics, robotics, autonomy, or data engineering; proficiency with large-scale data infrastructure; Python, SQL, Spark; bachelor’s degree in a technical field required.
Python, SQL, Spark
Explore Jobs