310 spark data engineer jobs at 166 companies in Benicia, CA

2mo
Save
Mark Applied
Hide
Spark Engineer
Sunnyvale, California, United States
OnsiteFull Time
IT Convergence
IT Convergence: Global provider of Oracle cloud, managed services, and digital transformation.
5+ YOE5+ years in software development; data engineering with pipelines; Python/Perl/Shell; Java; Oracle/MySQL; real-time pipelines with Kafka/Storm.
Python, Perl, Shell, Java, Oracle, MySQL, Kafka, Storm, HDFS, Hive, Pig, Oozie, HBase, Spark
1mo
Save
Mark Applied
Hide
Data Engineer
New York City or San Francisco
OnsiteFull Time
Bedrock Robotics
Bedrock Robotics: Automates heavy construction machinery with AI retrofit kits.
5+ YOE5+ years data engineering experience in large-scale data lake/warehouse environments; strong SQL and distributed query engine experience; pipeline orchestration (Airflow/Prefect) and Spark/Databricks experience; data quality and observability expertise.
SQL, Spark, BigQuery, Snowflake, Airflow, Prefect, Databricks
1mo
Save
Mark Applied
Hide
Data Engineer
Warren or Austin or Mountain View
$139k-$207k/yr HybridFull Time
General Motors
General MotorsNYSE: GM: Manufactures and sells automobiles and automotive parts globally.
5+ YOEBachelor's degree or equivalent experience; 5+ years as a data engineer/ETL/integration engineer; hands-on Databricks, Python, Spark, and SQL; experience with DataStage, GitHub, enterprise integrations, and building production data pipelines and medallion-style data products.
Databricks, Databricks notebooks, Databricks Lakehouse, Python, Spark, SQL, DataStage, GitHub, ServiceNow
1mo
Save
Mark Applied
Hide
Data Engineer
United States or San Francisco
$100k-$167k/yr OnsiteFull Time
Stitch Fix
Stitch FixNASDAQ: SFIX: Provides personalized apparel styling services through algorithms and stylists.
2+ YOEBachelor's in engineering or computer science, 2+ years data engineering experience, familiarity with Spark, dbt, Fivetran, Airflow, S3; production Python and SQL; experience with AI coding agents; strong communication.
Spark, dbt, Fivetran, Airflow, S3, Claude Code, Codex, Python, SQL
2w
Save
Mark Applied
Hide
Lead Data Engineer
Santa Clara, California, United States
OnsiteFull Time
Qcells
Qcells: Provider of solar modules, energy storage, and EPC services.
10+ YOE10+ years in data engineering or architecture, deep SQL and Python, Azure data services experience, distributed processing (Spark), data modeling, governance, and leadership experience.
Azure Fabric, Data Lake, Data Factory, Synapse, NetSuite, SAP, Salesforce, APIs, Delta Lake, Delta Tables, Snowflake, Kafka, Event Hub, Spark, Python, SQL
1mo
Save
Mark Applied
Hide
Data Engineer
Santa Clara, California, United States
$135k-$180k/yr HybridFull Time
PlusAI
PlusAI: AI-based virtual driver software for factory-built autonomous trucks.
1+ YOEMS in CS/Electrical or related, 1+ years software engineering, expertise in Python and SQL, experience with large-scale data processing (Spark, MapReduce, Kafka), AWS (S3, EC2, RDS), and building/maintaining data pipelines.
Python, SQL, microservices, MapReduce, Spark, Kafka, AWS, S3, EC2, RDS, TensorFlow, PyTorch
1w
Save
Mark Applied
Hide
Lead Data Engineer
San Francisco, California, United States
$190k-$220k/yr HybridFull Time
LendingClub
LendingClubNYSE: LC: Digital marketplace bank providing personal loans and banking services.
8+ YOE2+ Mgmt8+ years data engineering experience with 2+ years technical lead experience; strong SQL, data modeling, ETL, orchestration, Spark, AWS, modern data platforms, and experience applying AI tools to engineering workflows.
Databricks, dbt, Elementary, Dagster, Airflow, Oozie, Spark, PySpark, EMR, S3, Redshift, Snowflake, Claude, ChatGPT, GitHub Copilot, Streamlit
3w
Save
Mark Applied
Hide
Senior, Data Engineer
Sunnyvale or Bentonville
$90k-$234k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Multinational retail operating discount stores and supermarkets.
2+ YOEDesign and operate large-scale data pipelines on GCP using Spark, Airflow, BigQuery; optimize cloud cost; build automation and AI-driven engineering tools; 2+ years data engineering experience.
Spark, Scala, PySpark, Airflow, BigQuery, GCP, Python, Kafka, GCS
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yr RemoteFull Time
Samsara
SamsaraNYSE: IOT: Connected Operations Cloud platform for physical operations and IoT.
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
Spark, PySpark, Databricks, Python, SQL, Snowflake, Google BigQuery, Apache Iceberg, Fivetran, dbt, NetSuite, Salesforce, MySQL, AWS RDS/Aurora, PostgreSQL, Oracle, Microsoft SQL Server, AWS, Azure, GCP, Splunk, Datadog, AWS CloudWatch, API Gateway, Lambda, S3, SNS, SQS, SecretsManager, MCP (Model Context Protocol)
2mo
Save
Mark Applied
Hide
Data Engineer III
San Ramon, California, United States
$104k-$153k/yr RemoteFull Time
Robert Half
Robert HalfNYSE: RHI: Provides specialized staffing and global business consulting services.
5+ YOE5+ years Python/SQL data engineering; 3+ years cloud AWS; ETL/ELT pipelines; Docker/Kubernetes; Terraform/CloudFormation; Spark; CI/CD; collaboration with data science and MLOps; mentoring.
Python, SQL, Spark, Databricks, Delta Lake, Unity Catalog, MLflow, AWS, Docker, Kubernetes, Terraform, CloudFormation
2d
Save
Mark Applied
Hide
Director, Data Engineer
Mountain View, California, United States
OnsiteFull Time
Coupang
CoupangNYSE: CPNG: Provides an end-to-end e-commerce and logistics network.
8+ YOE3+ Mgmt8+ years data engineering experience, 3+ years people management; proficiency in data modeling, ETL, Python, SQL; experience with Spark, HDFS, S3 and ETL schedulers (Airflow, Dagster, DBT); experimentation and ML familiarity.
Python, SQL, Spark, HDFS, S3, Airflow, Dagster, DBT
2mo
Save
Mark Applied
Hide
Data Engineer
San Francisco or Denver
$170k-$220k/yr HybridFull Time
Windfall
Windfall: Provides consumer financial data and AI-driven go-to-market insights.
4+ YOE4-8 years in data engineering; experience with Apache Beam/Spark/Flink or MapReduce; JVM language proficiency; distributed data processing; experience at a small company; strong communication and ownership.
GCP, Java, Python, Kotlin, BigQuery, PostgreSQL, Scylla/Cassandra, Apache Beam, Apache Spark, Dataflow, Airflow
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Temporary
Boston Scientific
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
13+ YOEBachelor's in CS or related, 13+ years data engineering with 6+ years building AWS cloud-native data platforms; expertise with AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica or Seattle or San Francisco
$142k-$190k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOEBachelor's or equivalent experience, 5+ years big data engineering, strong Python/Scala/SQL, Spark/Presto/Hive, Databricks and cloud MPP databases, Airflow, AWS S3, CI/CD, on-call and production operations experience.
Databricks, Spark, Presto, Hive, Python, Scala, SQL, Snowflake, Redshift, BigQuery, Airflow, CI/CD, AWS S3, Terraform
2mo
Save
Mark Applied
Hide
Data Engineer, People Innovation Labs
San Francisco, California, United States
$293k-$325k/yr HybridFull Time
OpenAI
OpenAI: Develops artificial intelligence models and generative AI software services.
3+ YOE3+ years data engineering; 8+ years software engineering; Python/Scala/Java; Databricks, Snowflake; ETL schedulers; Spark/Hadoop/Flink; S3/HDFS; strong data pipelines and collaboration.
Python, Scala, Java, Databricks, Snowflake, Fivetran, Airflow, Dagster, Prefect, Spark, Hadoop, Flink, HDFS, S3
1mo
Save
Mark Applied
Hide
Data Engineer
San Francisco, California, United States
OnsiteFull Time
Sapiom
Sapiom: Financial infrastructure for autonomous AI agents.
5+ YOE5+ years building production data pipelines; hands-on SQL, Python, Spark, AWS Glue, EMR, DBT, Airflow; 3+ years with MPP databases (Snowflake/Redshift/Teradata); on-call experience and strong cross-team communication.
SQL, Python, Spark, AWS Glue, EMR, DBT, Airflow, Snowflake, AWS Redshift, Teradata
1mo
Save
Mark Applied
Hide
Senior Data Engineer
New York City or Sunnyvale or Bellevue
$182k-$242k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
5+ YOE5+ years building analytical data models and production data systems; expertise in Python/Scala/Rust, advanced SQL, Spark/Flink, lakehouse technologies, and dimensional modeling for OLAP workloads.
Python, Scala, Rust, SQL, Spark, Flink, Iceberg, Delta, StarRocks, ClickHouse, Trino, Kafka, AutoMQ, Pulsar, Kubernetes
1w
Save
Mark Applied
Hide
Senior Data Engineer
New York City or San Francisco
$170k-$200k/yr HybridFull Time
Tatari
Tatari: A platform for buying and measuring TV advertising campaigns.
5+ YOE5+ years building and operating production ETL pipelines; strong Python and SQL skills; Spark/PySpark, Databricks/Delta Lake, Airflow experience; strong data modeling and data quality practices.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
2mo
Save
Mark Applied
Hide
Senior Data Engineer - Data Lead
San Francisco, California, United States
$150k-$250k/yr OnsiteFull Time
Foundry Robotics
Foundry Robotics: An AI-native robotics manufacturer focused on deploying advanced assembly and production capability for robotics companies and national-security-critical hardware.
5+ YOE5-7 years data engineering experience; TB–PB-scale pipelines; Spark/Flink/Kafka/Airflow/dbt; Python/SQL; Go/Java/TypeScript a plus; cloud data services; architecture and governance; independent, end-to-end ownership.
Spark, Flink, Kafka, Airflow, dbt, Python, SQL, Go, Java, TypeScript, AWS, GCP, Azure, Kubernetes
1w
Save
Mark Applied
Hide
Staff Data Engineer
Denver or San Francisco
$190k-$264k/yr HybridFull Time
Checkr
Checkr: AI-powered platform for background checks and identity verification.
10+ YOE10+ years building scalable data platforms; expert PySpark, Python, SQL; experience with Kafka, Spark, Iceberg, data lakes, AWS; strong data modeling and security awareness.
PySpark, Python, SQL, MongoDB, Kafka, Spark, Iceberg, EKS, EMR, Serverless, Glue, Athena, S3, Databricks, Snowflake