HiringCafe
Join our community

220 spark data engineer jobs at 76 companies in Gilroy, CA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
2mo
Save
Mark Applied
Hide
Spark Engineer
Sunnyvale, California, United States
OnsiteFull Time
IT Convergence
IT Convergence: Global provider of Oracle cloud, managed services, and digital transformation.
5+ YOE5+ years in software development; data engineering with pipelines; Python/Perl/Shell; Java; Oracle/MySQL; real-time pipelines with Kafka/Storm.
Python, Perl, Shell, Java, Oracle, MySQL, Kafka, Storm, HDFS, Hive, Pig, Oozie, HBase, Spark
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Santa Clara, California, United States
$135k-$180k/yr HybridFull Time
PlusAI
PlusAI: AI-based virtual driver software for factory-built autonomous trucks.
1+ YOEMS in CS/Electrical or related, 1+ years software engineering, expertise in Python and SQL, experience with large-scale data processing (Spark, MapReduce, Kafka), AWS (S3, EC2, RDS), and building/maintaining data pipelines.
Python, SQL, microservices, MapReduce, Spark, Kafka, AWS, S3, EC2, RDS, TensorFlow, PyTorch
Job PostingView all
1w
Save
Mark Applied
Hide
Senior, Data Engineer
Sunnyvale or Bentonville
$90k-$234k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
2+ YOEDesign and operate large-scale data pipelines on GCP using Spark, Airflow, BigQuery; optimize cloud cost; build automation and AI-driven engineering tools; 2+ years data engineering experience.
Spark, Scala, PySpark, Airflow, BigQuery, GCP, Python, Kafka, GCS
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer
San Jose, California, United States
$149k-$361k/yr HybridFull Time
Roku
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
8+ YOE8+ years data engineering experience, strong SQL, Python preferred, expertise with big-data tech (Hadoop, Spark, Kafka, Hive, Airflow), data modeling, and cloud platforms (AWS/GCP).
SQL, Python, Hadoop, HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, Presto, Trino, AWS, GCP, Looker, Claude Code, Cursor, MCP servers
Job PostingView all
3mo
Save
Mark Applied
Hide
Lead Data Engineer
Fremont, California, United States
$141k-$307k/yr HybridFull Time
Lam Research
Lam ResearchNASDAQ: LRCX: Designs and manufactures wafer fabrication equipment for the semiconductor industry.
8+ YOEBachelor's degree in CS/CE/Information Systems, 8+ years in data engineering/architecture, strong Microsoft Azure experience, proficiency in Python, SQL, Spark, experience building production-grade data pipelines and modern data architectures for AI/ML.
Microsoft Azure, Microsoft Fabric, Python, SQL, Spark, Azure Databricks, Azure Data Factory, Synapse, Neo4j, Azure AI Search, CI/CD
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer - Data Platform
San Jose, California, United States
$156k-$388k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
BS/MS in CS or equivalent; experience with Hadoop, Hive, Spark, Presto, Kafka, ClickHouse, Flink; ETL, data ingestion, schema design and SQL; big data system architecture experience.
Hadoop, M/R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink, ETL, SQL
Job PostingView all
2d
Save
Mark Applied
Hide
Senior Data Engineer
San Jose, California, United States
$139k-$258k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
5+ YOE5+ years in data engineering or architecture; proficiency with Databricks or Snowflake, SQL, modern transformation frameworks (dbt, Spark, Dataflow), cloud (AWS/Azure/GCP), and BI tools; strong communication and governance experience.
Databricks, Snowflake, SQL, dbt, Spark, Dataflow, AWS, Azure, GCP, Power BI, Tableau, Looker, Amplitude, Segment, Adobe Analytics
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Temporary
Boston Scientific
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
13+ YOEBachelor's in CS or related, 13+ years data engineering with 6+ years building AWS cloud-native data platforms; expertise with AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer, Data Architecture and Engineering, gData
Sunnyvale or Boulder or New York City
$130k-$188k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
3+ YOEBachelor's in CS/Math/related or equivalent; 3+ years with data processing (Hadoop, Spark, Pig, Hive), DB administration or data engineering, software experience in Java/C++/Python/Go/JavaScript, and client-facing project experience.
Hadoop, Spark, Pig, Hive, MapReduce, Flume, Java, C++, Python, Go, JavaScript, Advanced SQL, ETL/ELT, NoSQL, AI technologies
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
New York City or Sunnyvale or Bellevue
$182k-$242k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
5+ YOE5+ years building analytical data models and production data systems; expertise in Python/Scala/Rust, advanced SQL, Spark/Flink, lakehouse technologies, and dimensional modeling for OLAP workloads.
Python, Scala, Rust, SQL, Spark, Flink, Iceberg, Delta, StarRocks, ClickHouse, Trino, Kafka, AutoMQ, Pulsar, Kubernetes
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Arden Hills or Valencia or Santa Clara
$107k-$203k/yr HybridFull Time, Contract
Boston Scientific
Boston ScientificNYSE: BSX: Developer and manufacturer of innovative medical devices and therapies.
13+ YOEBachelor's degree required; 13+ years data engineering experience including 6+ years designing cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise with AWS data services, Snowflake, Python, Terraform, Bash, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Apache Iceberg, Python, Terraform, Bash, Spark, Flink, Alation, Atlan, DataHub, Informatica, Databricks
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Cupertino, California, United States
$180k-$235k/yr OnsiteFull Time
Gridmatic
Gridmatic: AI-powered platform for optimizing energy trading and battery storage.
Experience building large-scale production data pipelines, designing storage and schema for timeseries and warehouse data, proficiency with DBT and data processing tools, strong software engineering skills, and startup experience.
DBT, spark, kafka, flink, beam, dataflow, Python, GCP, Kubernetes, Terraform, Flyte, Temporal, React, NextJS, Postgres, BigQuery
Job PostingView all
3mo
Save
Mark Applied
Hide
Staff Data Engineer/Surgical Robotics - OTTAVA
Santa Clara, California, United States
$118k-$179k/yr OnsiteFull Time
Johnson & Johnson
Johnson & JohnsonNYSE: JNJ: Global healthcare providing pharmaceuticals and medical technologies.
7+ YOEBachelor's/Master's in CS/Engineering/Data Science, 7+ years data engineering (5+ for exceptional), Databricks/Spark/Delta Lake, Python/PySpark/SQL, AWS S3, OT integrations (OPC UA, MQTT, MES), data governance and GxP/CSV compliance.
Databricks, Spark, Delta Lake, Databricks Workflows, Python, PySpark, SQL, AWS S3, Kinesis, MSK, OPC UA, MQTT, MES, ISA-95
Job PostingView all
2mo
Save
Mark Applied
Hide
Cloud Data Engineer
San Jose, California, United States
$137k-$277k/yr OnsiteFull Time
Hewlett Packard Enterprise
Hewlett Packard EnterpriseNYSE: HPE: Provides edge-to-cloud IT infrastructure and platform services.
4+ YOE4+ years of data engineering experience; strong Python and Java; Spark/Kafka; Kubernetes/Airflow; CI/CD; cloud environments.
Python, Java, Apache Spark, Kafka, Kubernetes, Airflow, CI/CD, Cloud computing environments
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer / Analyst - USA
New York City or Miami or Mountain View or Los Angeles or Chicago or Seattle or Dallas or United States
$122k-$162k/yr HybridFull Time
Cognify Analytics
Cognify Analytics: Independent analytics firm focused on data-driven solutions.
5+ YOE5–8+ years data engineering/analytics delivery; SQL, Snowflake/Databricks, dbt, Python, Spark; data governance; client collaboration.
Snowflake, Databricks, dbt, Python, Pandas, PySpark, Spark, Airflow, Dagster, Kafka, Kinesis, Tableau, Looker, Power BI, Sigma Computing, SQL, Data Governance, Alation, Atlan, DataHub, Unity Catalog
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer- Large Driving Model, Autonomy
Palo Alto, California, United States
$179k-$224k/yr OnsiteFull Time
Rivian
RivianNASDAQ: RIVN: Designs and manufactures electric vehicles and charging networks.
5+ YOEB.S./M.S. in CS/data/engineering, 5+ years as a data/ML/motion planning engineer in autonomous driving or robotics; advanced Python and SQL; experience with Spark or Ray, cloud infrastructure, dataset curation, large-scale sensor data, and production-grade data pipelines.
Python, SQL, Spark, Ray, C++
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer - Product
Menlo Park, California, United States
$168k-$242k/yr HybridFull Time
Snowflake
SnowflakeNYSE: SNOW: Cloud-based platform for data storage, processing, and analytics.
Bachelor's in CS/Engineering; strong Snowflake, Python, Spark; SQL; cloud platforms; Streamlit; Git; collaboration.
Snowflake, Python, Spark, Streamlit, SQL, AWS, Azure, GCP, Git
Job PostingView all
3mo
Save
Mark Applied
Hide
Staff Data Engineer: Robotics & Digital Surgery - OTTAVA
Santa Clara, California, United States
$118k-$179k/yr OnsiteFull Time
Johnson & Johnson
Johnson & JohnsonNYSE: JNJ: Develops and manufactures pharmaceutical drugs and medical devices.
7+ YOE7+ years data engineering; Databricks, Spark/Delta Lake, Python/PySpark; AWS S3; ETL/ELT design; data governance; OT data integration; strong communication.
Databricks, Spark, Delta Lake, Databricks Workflows, Python, PySpark, SQL, AWS S3, Kinesis, MSK, OPC UA, MQTT, MES
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Infra Engineer
Mountain View, California, United States
$175k-$221k/yr OnsiteFull Time
NewsBreak
NewsBreak: Local news aggregation platform powered by artificial intelligence.
BS/MS in Computer Science or equivalent; experience with big-data technologies (Hadoop, Spark, Presto, Kafka, Flink), databases, and cloud (AWS). Strong modeling, communication, and mentoring skills; senior-level data infrastructure experience preferred.
Hadoop, Spark, Presto, Kafka, Flink, AWS
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer (Valencia, CA, US, 91355)
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Contract
Boston Scientific
Boston ScientificNYSE: BSX: Developing and manufacturing innovative medical devices for less-invasive treatments.
13+ YOEBachelor's degree required; 13+ years data engineering experience with 6+ years building cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise in AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD, IAM
Job PostingView all

Explore Jobs

Expand Your Job Search