HiringCafe
Join our community

395 spark engineer jobs at 104 companies in Gilroy, CA

2mo
Save
Mark Applied
Hide
Spark Engineer
Sunnyvale, California, United States
OnsiteFull Time
IT Convergence
IT Convergence: Global provider of Oracle cloud, managed services, and digital transformation.
5+ YOE5+ years in software development; data engineering with pipelines; Python/Perl/Shell; Java; Oracle/MySQL; real-time pipelines with Kafka/Storm.
Python, Perl, Shell, Java, Oracle, MySQL, Kafka, Storm, HDFS, Hive, Pig, Oozie, HBase, Spark
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal Machine Learning Engineer, Accelerated Apache Spark
Santa Clara, California, United States
$272k-$431k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
12+ YOESenior ML/DS engineer with 12+ years of experience; 5+ years leading ML model development; strong Python and ML tooling; experience with GPU-accelerated Spark; expertise in ML methods and feature engineering.
Python, numpy, pandas, scikit-learn, scipy, pytorch, tensorflow, Apache Spark, Scala, Java, C++, XGBoost
Job PostingView all
1w
Save
Mark Applied
Hide
Software Engineer – Presto / Spark Development
San Jose or Austin
$131k-$245k/yr HybridFull Time
IBM
IBMNew York Stock Exchange: IBM: Global technology providing enterprise software, cloud, and consulting.
6+ YOE6+ years software engineering experience with ≥2 years on Presto/Trino or Apache Spark internals; strong Java or Scala; connectors, UDFs/UDAFs, optimizer work; JVM tuning, open table formats, and clear written communication.
Presto, Trino, Apache Spark, Java, Scala, Iceberg, Delta, Hudi, JVM, async-profiler, flamegraphs, Kubernetes, RAPIDS Accelerator, cuDF, Arrow, ORC, Parquet, CI/CD
Job PostingView all
3w
Save
Mark Applied
Hide
Software Engineer, Spark Platform
San Francisco or Sunnyvale or Seattle or New York City
$131k-$285k/yr HybridFull Time
DoorDash
DoorDashNASDAQ: DASH: On-demand delivery platform connecting consumers with local merchants.
24+ YOEExperience operating production distributed systems and Apache Spark at scale, Kubernetes production experience, familiarity with schedulers and observability stacks, cloud (AWS) experience, programming in Python/Go/Scala/Java, and SQL fluency. BS/MS/PhD in CS or equivalent.
Apache Spark, Amazon EMR, Databricks, Kubernetes, YuniKorn, Volcano, Kueue, Spark-on-Kubernetes operator, Prometheus, OpenTelemetry, Python, Go, Scala, Java, SQL, VPC
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal Machine Learning Engineer, Accelerated Apache Spark
Santa Clara, California, United States
$272k-$431k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
12+ YOEBS/MS/PhD or equivalent; 12+ years ML/DL experience; 5+ years as technical lead; 2+ years with Apache Spark; strong Python and data-science libraries experience; expertise in LLM/GenAI, RL, XGBoost; leadership and deployment experience.
Apache Spark, Python, numpy, pandas, scikit-learn, scipy, PyTorch, TensorFlow, XGBoost, CUDA, Scala, Java, C++
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Machine Learning Engineer
Sunnyvale, California, United States
$191k-$220k/yr OnsiteFull Time
Illumio
Illumio: Provides zero-trust segmentation software to contain cyberattacks.
5+ YOE5–8 years backend engineering with Java, Python, or Go; distributed systems; Kafka; Spark/Flink; Kubernetes; cloud deployments; agentic frameworks; Langfuse; Evals.
Java, Python, Go, Kafka, Spark, Flink, Kubernetes, Terraform, Langfuse, Evals
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Fullstack Engineer, Agentic Applications
Mountain View, California, United States
$192k-$260k/yr OnsiteFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
8+ YOE8+ years software engineering with 2+ years building production LLM/agentic applications; deep Python fluency; experience with agentic frameworks, REST/GraphQL integrations, Databricks/Spark, and technical leadership.
Python, LangChain, LangGraph, CrewAI, AutoGen, Semantic Kernel, RAG pipelines, REST, GraphQL, Databricks Unity Catalog, Databricks, Spark, Workday, Greenhouse, ADP, MLflow
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Engineer, Model Development Platform
Sunnyvale, California, United States
$296k-$335k/yr HybridFull Time
Wayve
Wayve: Develops end-to-end artificial intelligence for autonomous driving systems.
10+ YOE10+ years building large-scale distributed systems or ML infrastructure, 3+ years at staff/principal level, experience with Spark, Ray, Kubernetes, Airflow, MLflow, web frameworks, reliability engineering, and mentoring engineers.
Spark, Ray, Kubernetes, Airflow, MLflow, React, Flask, FastAPI
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Software Engineer, Infrastructure, Managed Spark Platform and Foundations
Sunnyvale, California, United States
$174k-$253k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
5+ YOEBachelor's degree or equivalent experience,5+ years software development,3+ years building large-scale distributed infrastructure,EMR/Excel not required,experience with distributed computing and API design.
Open Telemetry, JMX, Spark, Ray, Flink, Presto
Job PostingView all
2w
Save
Mark Applied
Hide
Site Reliability Engineer, Compute Platform
San Jose, California, United States
$156k-$388k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
Bachelor's in CS/Engineering, strong Linux, networking, databases, Kubernetes, SRE/DevOps toolset knowledge, experience with ClickHouse/Spark/Presto/Doris/Hadoop, coding in Python/Shell/Java/Go, strong problem-solving and communication.
ClickHouse, Spark, Presto, Doris, Hadoop, Kubernetes, Python, Shell, Java, Go
Job PostingView all
2w
Save
Mark Applied
Hide
Site Reliability Engineer, Compute Platform
San Jose, California, United States
OnsiteFull Time
ByteDance
ByteDance: Developing AI-driven content platforms and mobile applications.
Experience with Linux, networking, databases, Kubernetes, ClickHouse/Hadoop/Doris/Spark/Presto, scripting or programming (Python, Shell, Java, Go), incident management, and capacity planning.
ClickHouse, Spark, Presto, Doris, Hadoop, Kubernetes, Linux, Python, Shell, Java, Go
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
San Jose, California, United States
HybridFull Time
Roku
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
5+ YOE5+ years applied machine learning experience; strong statistical, optimization, and experimental methodology knowledge; proficient in Spark, Python or Java; experience with real-time, low-latency systems and distributed ML frameworks.
Spark, Python, Java, Spark-MLlib, TensorFlow, Hive, Aerospike, ScyllaDB
Job PostingView all
3w
Save
Mark Applied
Hide
Staff Machine Learning Engineer
Bengaluru or Noida or Santa Clara
HybridFull Time
Eightfold
Eightfold: An AI-native enterprise talent platform that builds scalable machine learning solutions and agentic AI for talent workflows.
6+ YOEDeep expertise in ML/DL/NLP and LLMs; technical leadership and team mentoring; proficiency with Python, TensorFlow, PyTorch, big data (Hadoop, Spark); experience deploying ML at scale. MS/PhD and 6+ years preferred.
Azure, AWS, Python, TensorFlow, PyTorch, Hadoop, Spark, C/C++, Hava, Scala, R, LLMs, Transformers
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Engineer, Model Development Platform
Sunnyvale, California, United States
$296k-$335k/yr HybridFull Time
Wayve
Wayve: Develops AI software for autonomous vehicle navigation.
10+ YOE10+ years building large-scale distributed systems or ML infrastructure, 3+ years at staff/principal level, experience with Spark, Ray, Kubernetes, Airflow, MLflow, reliability/observability, mentoring, and optimization or scheduling systems.
Spark, Ray, Kubernetes, Airflow, MLflow, React, Flask, FastAPI
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Site Reliability Engineer, Product - USDS
San Jose, California, United States
$187k-$438k/yr OnsiteFull Time
TikTok USDS Joint Venture
TikTok USDS Joint Venture: Operates and secures TikTok services for U.S. users.
5+ YOEBachelor's in CS or related plus 5+ years deploying/administering large-scale distributed systems; strong Unix/Linux and networking knowledge; experience with programming, debugging, and systems like Nginx, Kubernetes, Docker, Hadoop, Spark, Flink, Kafka.
Unix/Linux, TCP/IP, C, C++, Java, Python, Go, Ruby, Rust, JavaScript, Nginx, Kubernetes, Docker, OpenStack, Hadoop, Spark, Flink, Kafka
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Principal Machine Learning Engineer - Optimization
Redwood City or United States
$260k-$330k/yr HybridFull Time
PubMatic
PubMaticNASDAQ: PUBM: Sell-side platform for digital advertising and programmatic media buying.
10+ YOE10+ years building production ML, ranking, or optimization systems; strong ML fundamentals, experience with prediction/CTR/CVR/ calibration/experimentation; proficiency in Python, Java, SQL, Spark, TensorFlow, PyTorch, XGBoost.
Python, Java, SQL, Spark, TensorFlow, PyTorch, XGBoost
Job PostingView all
4d
Save
Mark Applied
Hide
Software Engineer II
Redmond or Mountain View
$102k-$202k/yr RemoteFull Time
Microsoft
MicrosoftNASDAQ: MSFT: Develops software, services, devices, and cloud computing solutions.
2+ YOEBachelor's or equivalent and 2+ years engineering experience; coding in C,C++,C#,Java,JavaScript or Python; experience with Spark and data engineering preferred; must pass Microsoft security screening.
Spark, Python, C, C++, C#, Java, JavaScript, .Net
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Site Reliability Engineer, Apple Data Platform SRE / Apple Services Engineering
Cupertino, California, United States
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Apply SRE principles to mentor teams, ensure reliability for large-scale analytics infrastructure across Hadoop, HBase, Spark, Data Lakes, and Airflow; participate in production on-call.
Hadoop, HBase, Spark, Data Lakes, Airflow
Job PostingView all
3d
Save
Mark Applied
Hide
Staff Software Engineer
Livingston or New York City or Sunnyvale or San Francisco or Bellevue
$207k-$275k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
10+ YOE10+ years in platform or infrastructure engineering with Kubernetes, CI/CD, IaC, observability, multi-region systems, and production ownership for high-availability services.
Spark, Airflow, Kafka, Flink, Kubernetes, Argo CD, GitHub Actions, Prometheus, Grafana, OpenTelemetry, Helm, Terraform, Pulumi
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer - Product
Menlo Park, California, United States
$168k-$242k/yr HybridFull Time
Snowflake
SnowflakeNYSE: SNOW: Cloud-based platform for data storage, processing, and analytics.
Bachelor's in CS/Engineering; strong Snowflake, Python, Spark; SQL; cloud platforms; Streamlit; Git; collaboration.
Snowflake, Python, Spark, Streamlit, SQL, AWS, Azure, GCP, Git
Job PostingView all

Explore Jobs

Expand Your Job Search