247 spark data engineer jobs at 91 companies in Live Oak, CA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
2mo
Save
Mark Applied
Hide
Spark Engineer
Sunnyvale, California, United States
OnsiteFull Time
IT Convergence
IT Convergence: Global provider of Oracle cloud, managed services, and digital transformation.
5+ YOE5+ years in software development; data engineering with pipelines; Python/Perl/Shell; Java; Oracle/MySQL; real-time pipelines with Kafka/Storm.
Python, Perl, Shell, Java, Oracle, MySQL, Kafka, Storm, HDFS, Hive, Pig, Oozie, HBase, Spark
1w
Save
Mark Applied
Hide
Lead Data Engineer
Santa Clara, California, United States
OnsiteFull Time
Qcells
Qcells: Provider of solar modules, energy storage, and EPC services.
10+ YOE10+ years in data engineering or architecture, deep SQL and Python, Azure data services experience, distributed processing (Spark), data modeling, governance, and leadership experience.
Azure Fabric, Data Lake, Data Factory, Synapse, NetSuite, SAP, Salesforce, APIs, Delta Lake, Delta Tables, Snowflake, Kafka, Event Hub, Spark, Python, SQL
1mo
Save
Mark Applied
Hide
Data Engineer
Santa Clara, California, United States
$135k-$180k/yr HybridFull Time
PlusAI
PlusAI: AI-based virtual driver software for factory-built autonomous trucks.
1+ YOEMS in CS/Electrical or related, 1+ years software engineering, expertise in Python and SQL, experience with large-scale data processing (Spark, MapReduce, Kafka), AWS (S3, EC2, RDS), and building/maintaining data pipelines.
Python, SQL, microservices, MapReduce, Spark, Kafka, AWS, S3, EC2, RDS, TensorFlow, PyTorch
2w
Save
Mark Applied
Hide
Senior, Data Engineer
Sunnyvale or Bentonville
$90k-$234k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
2+ YOEDesign and operate large-scale data pipelines on GCP using Spark, Airflow, BigQuery; optimize cloud cost; build automation and AI-driven engineering tools; 2+ years data engineering experience.
Spark, Scala, PySpark, Airflow, BigQuery, GCP, Python, Kafka, GCS
3w
Save
Mark Applied
Hide
Senior Data Engineer
San Jose, California, United States
$149k-$361k/yr HybridFull Time
Roku
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
8+ YOE8+ years data engineering experience, strong SQL, Python preferred, expertise with big-data tech (Hadoop, Spark, Kafka, Hive, Airflow), data modeling, and cloud platforms (AWS/GCP).
SQL, Python, Hadoop, HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, Presto, Trino, AWS, GCP, Looker, Claude Code, Cursor, MCP servers
2d
Save
Mark Applied
Hide
Staff Data Engineer
San Jose, California, United States
$228k-$301k/yr HybridFull Time
PayPal
PayPalNASDAQ: PYPL: Global digital payments platform for consumers and merchants.
8+ YOEMaster's in CS/Engineering plus 8 years (or Bachelor's plus 10 years). Requires data engineering, Python, Shell, SQL, ETL, BigQuery, GCP, Kafka, Airflow, Spark/Hadoop, BI tools, data modeling experience.
Python, Shell, SQL, Tableau, ThoughtSpot, Google BigQuery, Google Cloud Platform, Erwin, Apache Kafka, Apache Airflow, Automic UC4, Spark, Hadoop
3mo
Save
Mark Applied
Hide
Lead Data Engineer
Fremont, California, United States
$141k-$307k/yr HybridFull Time
Lam Research
Lam ResearchNASDAQ: LRCX: Designs and manufactures wafer fabrication equipment for the semiconductor industry.
8+ YOEBachelor's degree in CS/CE/Information Systems, 8+ years in data engineering/architecture, strong Microsoft Azure experience, proficiency in Python, SQL, Spark, experience building production-grade data pipelines and modern data architectures for AI/ML.
Microsoft Azure, Microsoft Fabric, Python, SQL, Spark, Azure Databricks, Azure Data Factory, Synapse, Neo4j, Azure AI Search, CI/CD
2w
Save
Mark Applied
Hide
Data Engineer - Data Platform
San Jose, California, United States
$156k-$388k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
BS/MS in CS or equivalent; experience with Hadoop, Hive, Spark, Presto, Kafka, ClickHouse, Flink; ETL, data ingestion, schema design and SQL; big data system architecture experience.
Hadoop, M/R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink, ETL, SQL
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Temporary
Boston Scientific
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
13+ YOEBachelor's in CS or related, 13+ years data engineering with 6+ years building AWS cloud-native data platforms; expertise with AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD
3w
Save
Mark Applied
Hide
Data Engineer, Data Architecture and Engineering, gData
Sunnyvale or Boulder or New York City
$130k-$188k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
3+ YOEBachelor's in CS/Math/related or equivalent; 3+ years with data processing (Hadoop, Spark, Pig, Hive), DB administration or data engineering, software experience in Java/C++/Python/Go/JavaScript, and client-facing project experience.
Hadoop, Spark, Pig, Hive, MapReduce, Flume, Java, C++, Python, Go, JavaScript, Advanced SQL, ETL/ELT, NoSQL, AI technologies
1mo
Save
Mark Applied
Hide
Senior Data Engineer
New York City or Sunnyvale or Bellevue
$182k-$242k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
5+ YOE5+ years building analytical data models and production data systems; expertise in Python/Scala/Rust, advanced SQL, Spark/Flink, lakehouse technologies, and dimensional modeling for OLAP workloads.
Python, Scala, Rust, SQL, Spark, Flink, Iceberg, Delta, StarRocks, ClickHouse, Trino, Kafka, AutoMQ, Pulsar, Kubernetes
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Arden Hills or Valencia or Santa Clara
$107k-$203k/yr HybridFull Time, Contract
Boston Scientific
Boston ScientificNYSE: BSX: Developer and manufacturer of innovative medical devices and therapies.
13+ YOEBachelor's degree required; 13+ years data engineering experience including 6+ years designing cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise with AWS data services, Snowflake, Python, Terraform, Bash, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Apache Iceberg, Python, Terraform, Bash, Spark, Flink, Alation, Atlan, DataHub, Informatica, Databricks
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Foster City, California, United States
$123k-$191k/yr HybridFull Time
Visa
VisaNYSE: V: Global payment technology facilitating electronic funds transfers.
2+ YOE2+ years experience with a Bachelor's (or Advanced) degree; strong programming in Java/Python/Go/Scala; experience building scalable data pipelines, Spark/Kafka/Hadoop ecosystem, cloud platforms, GenAI and data modeling.
Java, Python, Go, Scala, Gen AI, GenAI, Apache Spark, Spark, Kafka, Hadoop, Hive, Trino, Presto, Apache Airflow, Hbase, AWS, Azure, DataBricks, HDFS, S3, LLMs, NLP, RAG, Vector DBs, MCP, A2A, J2EE, Microservices, REST APIs, CI/CD, Jira, Jira Align
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Mateo or New York City
$140k-$160k/yr HybridFull Time
Chartmetric
Chartmetric: Provides a global music data analytics platform for professionals.
6+ YOE6+ years building production data systems; expert in Python, PostgreSQL, Airflow, Clickhouse, Snowflake, Elasticsearch, Spark, and AWS; Bachelor's in CS/Data Engineering or equivalent experience.
Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, AWS, AWS RDS
1mo
Save
Mark Applied
Hide
Data Engineer
Cupertino, California, United States
$180k-$235k/yr OnsiteFull Time
Gridmatic
Gridmatic: AI-powered platform for optimizing energy trading and battery storage.
Experience building large-scale production data pipelines, designing storage and schema for timeseries and warehouse data, proficiency with DBT and data processing tools, strong software engineering skills, and startup experience.
DBT, spark, kafka, flink, beam, dataflow, Python, GCP, Kubernetes, Terraform, Flyte, Temporal, React, NextJS, Postgres, BigQuery
3mo
Save
Mark Applied
Hide
Staff Data Engineer/Surgical Robotics - OTTAVA
Santa Clara, California, United States
$118k-$179k/yr OnsiteFull Time
Johnson & Johnson
Johnson & JohnsonNYSE: JNJ: Global healthcare providing pharmaceuticals and medical technologies.
7+ YOEBachelor's/Master's in CS/Engineering/Data Science, 7+ years data engineering (5+ for exceptional), Databricks/Spark/Delta Lake, Python/PySpark/SQL, AWS S3, OT integrations (OPC UA, MQTT, MES), data governance and GxP/CSV compliance.
Databricks, Spark, Delta Lake, Databricks Workflows, Python, PySpark, SQL, AWS S3, Kinesis, MSK, OPC UA, MQTT, MES, ISA-95
2mo
Save
Mark Applied
Hide
Cloud Data Engineer
San Jose, California, United States
$137k-$277k/yr OnsiteFull Time
Hewlett Packard Enterprise
Hewlett Packard EnterpriseNYSE: HPE: Provides edge-to-cloud IT infrastructure and platform services.
4+ YOE4+ years of data engineering experience; strong Python and Java; Spark/Kafka; Kubernetes/Airflow; CI/CD; cloud environments.
Python, Java, Apache Spark, Kafka, Kubernetes, Airflow, CI/CD, Cloud computing environments
3mo
Save
Mark Applied
Hide
Senior Data Engineer / Analyst - USA
New York City or Miami or Mountain View or Los Angeles or Chicago or Seattle or Dallas or United States
$122k-$162k/yr HybridFull Time
Cognify Analytics
Cognify Analytics: Independent analytics firm focused on data-driven solutions.
5+ YOE5–8+ years data engineering/analytics delivery; SQL, Snowflake/Databricks, dbt, Python, Spark; data governance; client collaboration.
Snowflake, Databricks, dbt, Python, Pandas, PySpark, Spark, Airflow, Dagster, Kafka, Kinesis, Tableau, Looker, Power BI, Sigma Computing, SQL, Data Governance, Alation, Atlan, DataHub, Unity Catalog
1mo
Save
Mark Applied
Hide
Senior Data Engineer- Large Driving Model, Autonomy
Palo Alto, California, United States
$179k-$224k/yr OnsiteFull Time
Rivian
RivianNASDAQ: RIVN: Designs and manufactures electric vehicles and charging networks.
5+ YOEB.S./M.S. in CS/data/engineering, 5+ years as a data/ML/motion planning engineer in autonomous driving or robotics; advanced Python and SQL; experience with Spark or Ray, cloud infrastructure, dataset curation, large-scale sensor data, and production-grade data pipelines.
Python, SQL, Spark, Ray, C++
2mo
Save
Mark Applied
Hide
Senior Data Engineer - Product
Menlo Park, California, United States
$168k-$242k/yr HybridFull Time
Snowflake
SnowflakeNYSE: SNOW: Cloud-based platform for data storage, processing, and analytics.
Bachelor's in CS/Engineering; strong Snowflake, Python, Spark; SQL; cloud platforms; Streamlit; Git; collaboration.
Snowflake, Python, Spark, Streamlit, SQL, AWS, Azure, GCP, Git