HiringCafe
Join our community

398 spark data engineer jobs at 183 companies in Hayward, CA

2mo
Save
Mark Applied
Hide
Spark Engineer
Sunnyvale, California, United States
OnsiteFull Time
IT Convergence
IT Convergence: Global provider of Oracle cloud, managed services, and digital transformation.
5+ YOE5+ years in software development; data engineering with pipelines; Python/Perl/Shell; Java; Oracle/MySQL; real-time pipelines with Kafka/Storm.
Python, Perl, Shell, Java, Oracle, MySQL, Kafka, Storm, HDFS, Hive, Pig, Oozie, HBase, Spark
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
New York City or San Francisco
OnsiteFull Time
Bedrock Robotics
Bedrock Robotics: Automates heavy construction machinery with AI retrofit kits.
5+ YOE5+ years data engineering experience in large-scale data lake/warehouse environments; strong SQL and distributed query engine experience; pipeline orchestration (Airflow/Prefect) and Spark/Databricks experience; data quality and observability expertise.
SQL, Spark, BigQuery, Snowflake, Airflow, Prefect, Databricks
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Warren or Austin or Mountain View
$139k-$207k/yr HybridFull Time
General Motors
General MotorsNYSE: GM: Manufactures and sells automobiles and automotive parts globally.
5+ YOEBachelor's degree or equivalent experience; 5+ years as a data engineer/ETL/integration engineer; hands-on Databricks, Python, Spark, and SQL; experience with DataStage, GitHub, enterprise integrations, and building production data pipelines and medallion-style data products.
Databricks, Databricks notebooks, Databricks Lakehouse, Python, Spark, SQL, DataStage, GitHub, ServiceNow
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
United States or San Francisco
$100k-$167k/yr OnsiteFull Time
Stitch Fix
Stitch FixNASDAQ: SFIX: Provides personalized apparel styling services through algorithms and stylists.
2+ YOEBachelor's in engineering or computer science, 2+ years data engineering experience, familiarity with Spark, dbt, Fivetran, Airflow, S3; production Python and SQL; experience with AI coding agents; strong communication.
Spark, dbt, Fivetran, Airflow, S3, Claude Code, Codex, Python, SQL
Job PostingView all
2w
Save
Mark Applied
Hide
Lead Data Engineer
Santa Clara, California, United States
OnsiteFull Time
Qcells
Qcells: Provider of solar modules, energy storage, and EPC services.
10+ YOE10+ years in data engineering or architecture, deep SQL and Python, Azure data services experience, distributed processing (Spark), data modeling, governance, and leadership experience.
Azure Fabric, Data Lake, Data Factory, Synapse, NetSuite, SAP, Salesforce, APIs, Delta Lake, Delta Tables, Snowflake, Kafka, Event Hub, Spark, Python, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Santa Clara, California, United States
$135k-$180k/yr HybridFull Time
PlusAI
PlusAI: AI-based virtual driver software for factory-built autonomous trucks.
1+ YOEMS in CS/Electrical or related, 1+ years software engineering, expertise in Python and SQL, experience with large-scale data processing (Spark, MapReduce, Kafka), AWS (S3, EC2, RDS), and building/maintaining data pipelines.
Python, SQL, microservices, MapReduce, Spark, Kafka, AWS, S3, EC2, RDS, TensorFlow, PyTorch
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Data Engineer
San Francisco, California, United States
$190k-$220k/yr HybridFull Time
LendingClub
LendingClubNYSE: LC: Digital marketplace bank providing personal loans and banking services.
8+ YOE2+ Mgmt8+ years data engineering experience with 2+ years technical lead experience; strong SQL, data modeling, ETL, orchestration, Spark, AWS, modern data platforms, and experience applying AI tools to engineering workflows.
Databricks, dbt, Elementary, Dagster, Airflow, Oozie, Spark, PySpark, EMR, S3, Redshift, Snowflake, Claude, ChatGPT, GitHub Copilot, Streamlit
Job PostingView all
3w
Save
Mark Applied
Hide
Senior, Data Engineer
Sunnyvale or Bentonville
$90k-$234k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
2+ YOEDesign and operate large-scale data pipelines on GCP using Spark, Airflow, BigQuery; optimize cloud cost; build automation and AI-driven engineering tools; 2+ years data engineering experience.
Spark, Scala, PySpark, Airflow, BigQuery, GCP, Python, Kafka, GCS
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Jose, California, United States
$149k-$361k/yr HybridFull Time
Roku
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
8+ YOE8+ years data engineering experience, strong SQL, Python preferred, expertise with big-data tech (Hadoop, Spark, Kafka, Hive, Airflow), data modeling, and cloud platforms (AWS/GCP).
SQL, Python, Hadoop, HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, Presto, Trino, AWS, GCP, Looker, Claude Code, Cursor, MCP servers
Job PostingView all
1w
Save
Mark Applied
Hide
Staff Data Engineer
San Jose, California, United States
$228k-$301k/yr HybridFull Time
PayPal
PayPalNASDAQ: PYPL: Global digital payments platform for consumers and merchants.
8+ YOEMaster's in CS/Engineering plus 8 years (or Bachelor's plus 10 years). Requires data engineering, Python, Shell, SQL, ETL, BigQuery, GCP, Kafka, Airflow, Spark/Hadoop, BI tools, data modeling experience.
Python, Shell, SQL, Tableau, ThoughtSpot, Google BigQuery, Google Cloud Platform, Erwin, Apache Kafka, Apache Airflow, Automic UC4, Spark, Hadoop
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yr RemoteFull Time
Samsara
SamsaraNYSE: IOT: Connected Operations Cloud platform for physical operations and IoT.
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
Spark, PySpark, Databricks, Python, SQL, Snowflake, Google BigQuery, Apache Iceberg, Fivetran, dbt, NetSuite, Salesforce, MySQL, AWS RDS/Aurora, PostgreSQL, Oracle, Microsoft SQL Server, AWS, Azure, GCP, Splunk, Datadog, AWS CloudWatch, API Gateway, Lambda, S3, SNS, SQS, SecretsManager, MCP (Model Context Protocol)
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer III
San Ramon, California, United States
$104k-$153k/yr RemoteFull Time
Robert Half
Robert HalfNYSE: RHI: Provides specialized staffing and global business consulting services.
5+ YOE5+ years Python/SQL data engineering; 3+ years cloud AWS; ETL/ELT pipelines; Docker/Kubernetes; Terraform/CloudFormation; Spark; CI/CD; collaboration with data science and MLOps; mentoring.
Python, SQL, Spark, Databricks, Delta Lake, Unity Catalog, MLflow, AWS, Docker, Kubernetes, Terraform, CloudFormation
Job PostingView all
2d
Save
Mark Applied
Hide
Director, Data Engineer
Mountain View, California, United States
OnsiteFull Time
Coupang
CoupangNYSE: CPNG: Provides an end-to-end e-commerce and logistics network.
8+ YOE3+ Mgmt8+ years data engineering experience, 3+ years people management; proficiency in data modeling, ETL, Python, SQL; experience with Spark, HDFS, S3 and ETL schedulers (Airflow, Dagster, DBT); experimentation and ML familiarity.
Python, SQL, Spark, HDFS, S3, Airflow, Dagster, DBT
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer - Data Platform
San Jose, California, United States
$156k-$388k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
BS/MS in CS or equivalent; experience with Hadoop, Hive, Spark, Presto, Kafka, ClickHouse, Flink; ETL, data ingestion, schema design and SQL; big data system architecture experience.
Hadoop, M/R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink, ETL, SQL
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer
San Francisco or Denver
$170k-$220k/yr HybridFull Time
Windfall
Windfall: Provides consumer financial data and AI-driven go-to-market insights.
4+ YOE4-8 years in data engineering; experience with Apache Beam/Spark/Flink or MapReduce; JVM language proficiency; distributed data processing; experience at a small company; strong communication and ownership.
GCP, Java, Python, Kotlin, BigQuery, PostgreSQL, Scylla/Cassandra, Apache Beam, Apache Spark, Dataflow, Airflow
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Temporary
Boston Scientific
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
13+ YOEBachelor's in CS or related, 13+ years data engineering with 6+ years building AWS cloud-native data platforms; expertise with AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica or Seattle or San Francisco
$142k-$190k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOEBachelor's or equivalent experience, 5+ years big data engineering, strong Python/Scala/SQL, Spark/Presto/Hive, Databricks and cloud MPP databases, Airflow, AWS S3, CI/CD, on-call and production operations experience.
Databricks, Spark, Presto, Hive, Python, Scala, SQL, Snowflake, Redshift, BigQuery, Airflow, CI/CD, AWS S3, Terraform
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer, People Innovation Labs
San Francisco, California, United States
$293k-$325k/yr HybridFull Time
OpenAI
OpenAI: Develops artificial intelligence models and generative AI software services.
3+ YOE3+ years data engineering; 8+ years software engineering; Python/Scala/Java; Databricks, Snowflake; ETL schedulers; Spark/Hadoop/Flink; S3/HDFS; strong data pipelines and collaboration.
Python, Scala, Java, Databricks, Snowflake, Fivetran, Airflow, Dagster, Prefect, Spark, Hadoop, Flink, HDFS, S3
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
San Francisco, California, United States
OnsiteFull Time
Sapiom
Sapiom: Financial infrastructure for autonomous AI agents.
5+ YOE5+ years building production data pipelines; hands-on SQL, Python, Spark, AWS Glue, EMR, DBT, Airflow; 3+ years with MPP databases (Snowflake/Redshift/Teradata); on-call experience and strong cross-team communication.
SQL, Python, Spark, AWS Glue, EMR, DBT, Airflow, Snowflake, AWS Redshift, Teradata
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
New York City or Sunnyvale or Bellevue
$182k-$242k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
5+ YOE5+ years building analytical data models and production data systems; expertise in Python/Scala/Rust, advanced SQL, Spark/Flink, lakehouse technologies, and dimensional modeling for OLAP workloads.
Python, Scala, Rust, SQL, Spark, Flink, Iceberg, Delta, StarRocks, ClickHouse, Trino, Kafka, AutoMQ, Pulsar, Kubernetes
Job PostingView all

Explore Jobs

Expand Your Job Search