75 spark data engineer jobs at 16 companies in Gustine, CA
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
8+ YOE8+ years data engineering experience, strong SQL, Python preferred, expertise with big-data tech (Hadoop, Spark, Kafka, Hive, Airflow), data modeling, and cloud platforms (AWS/GCP).
TikTok: Global short-form video hosting and social media platform.
BS/MS in CS or equivalent; experience with Hadoop, Hive, Spark, Presto, Kafka, ClickHouse, Flink; ETL, data ingestion, schema design and SQL; big data system architecture experience.
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
5+ YOE5+ years in data engineering or architecture; proficiency with Databricks or Snowflake, SQL, modern transformation frameworks (dbt, Spark, Dataflow), cloud (AWS/Azure/GCP), and BI tools; strong communication and governance experience.
Hewlett Packard EnterpriseNYSE: HPE: Providing global edge-to-cloud infrastructure and IT solutions for businesses.
4+ YOEDegree in Computer Science or Information Systems; Master’s with 2 years data engineering experience; at least 4 years in relevant technologies; Python and Java programming; big data (Spark/Kafka); AI/Generative AI experience; containerization (Kubernetes, Airflow); cloud development.
BILLNYSE: BILL: Automated financial operations software for small and midsize businesses.
8+ YOELead architecture and delivery of data platform capabilities (ingest, lake, streaming, feature store, query, graph, search). Requires distributed systems, streaming and batch experience, SQL and Python, and technical leadership.
Hark: An AI focused on next-generation multimodal intelligence and hardware-enabled interfaces.
5+ YOELead data engineering for scalable multi-modal pipelines; 5+ years in data engineering; strong infra experience with Spark/Beam/Flink; collaborate with researchers and engineers.
Manager, Data Science - Consumer Identity Machine Learning
San Jose or McLean or New York
$197k-$225k/yrOnsiteFull Time
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
Strong data science and ML skills; experience with large-scale data, Python, Spark; collaboration with product/engineering; open-source and cloud experience; multiple degree options with required years of analytics experience.
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California or San Francisco or Oakland or San Jose or Washington
$139k-$204k/yrRemoteFull Time
TwilioNYSE: TWLO: Cloud communications platform for building customer engagement applications.
5+ YOEBachelor's or Master's in CS/Engineering, 5+ years software development, proficiency in Python/Java/Scala, experience with big data tools (Kafka, Spark, Hive, Hudi, Presto, Airflow) and AWS services, strong problem-solving and communication skills.
San Jose or Durham or Mexico City or Bengaluru or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$179k-$299k/yrHybridFull Time
NutanixNASDAQ: NTNX: Sells cloud software and hyperconverged infrastructure for enterprises.
12+ YOE12+ years in data architecture/engineering with 5+ years on large-scale data platforms; expertise in SQL, Apache Spark, Kubernetes, Trino, Dremio, Informatica, CI/CD, security controls, and cloud platforms; Bachelor's required, advanced degree preferred.
Bio-TechneNASDAQ: TECH: Provides reagents, instruments, and diagnostic tools for life sciences.
6+ YOEBachelor's in CS (or equivalent) and 6+ years test automation experience; Python, SQL, APIs, Databricks/Spark familiarity; experience with test automation tools, CI/CD, ELN/LIMS, cloud platforms, and AI/data validation.
The Trade DeskNASDAQ: TTD: Cloud-based programmatic advertising platform for data-driven media buying.
7+ YOE7+ years software development (5+ in data engineering), experience with Vertica/Snowflake/Databricks, Apache Spark, Kafka, Java/Scala/Python, cloud (AWS/GCP/Azure), Kubernetes, data governance, ML pipelines, content metadata and distributed systems.
Distributed Systems Engineer, Data & Inference Platform
San Francisco or Fremont or Palo Alto or Berkeley or Sunnyvale or Mountain View or San Jose or Oakland or Redwood City
HybridFull Time
Adaption: Develops efficient AI systems that adapt in real-time.
5+ YOE5+ years building and operating distributed systems; experience with Ray/Spark/Flink/Beam/Dask; Python and at least one systems language; GPU/accelerator stack; Kubernetes; incident ownership.
ByteDance: Developing AI-driven content platforms and mobile applications.
Pursuing a BS/MS in CS, CE, Security, Statistics, AI or other STEM; proficient in C++/Java/Python; experience with big data tools (Hive, SQL, Spark, Flink); knowledge of ML algorithms.
Cadence Design SystemsNASDAQ: CDNS: Develops computational software and hardware for electronic system design.
3+ YOE3+ years industry experience; expertise in LLM/ML or data analytics; experience with LangChain, Spark, PyTorch, TensorFlow; strong AI/ML fundamentals, data structures, algorithms, distributed systems; development in Python or C++.
LangChain, Spark, PyTorch, TensorFlow, Python, C++
CadenceNASDAQ: CDNS: Provides software and hardware for designing integrated circuits and systems.
3+ YOE3+ years industry experience, BS in CS/EE or related, advanced experience with EDA/LLM/ML/data analytics (LangChain, Spark, PyTorch, TensorFlow), Python or C++, strong algorithms/distributed systems and architecture skills.
LangChain, Spark, PyTorch, TensorFlow, Python, C++
Veeam: Data resilience and security for hybrid cloud environments
12+ YOE6+ Mgmt12+ years in data infrastructure/graph systems, 6+ years engineering leadership; deep graph, data lake, distributed systems, Go/Python, EM tools, and AI-assisted dev experience.
Amazon Neptune, Neo4j, Gremlin, Cypher, openCypher, SPARQL, Delta Lake, Iceberg, Parquet, Avro, Azure Data Lake, AWS S3, AWS Glue, BigQuery, Spark, Flink, Presto, Trino, Go, Python, Claude Code, Cursor, Copilot, MLflow, Databricks Mosaic AI, Terraform, Pulumi
Distinguished Technologist, Distributed Systems & Agentic Query Optimization
San Jose or Houston or Durham or Andover
$170k-$413k/yrHybridFull Time
Hewlett Packard EnterpriseNYSE: HPE: Provides global edge-to-cloud technology solutions and IT infrastructure services.
15+ YOE15+ years designing and operating large distributed systems and cloud platform services; expertise in distributed query engines, federated data, cloud-native architecture; strong communication and technical leadership skills.