HiringCafe
Join our community

261 spark engineer jobs at 143 companies in Fairfield, CA

1mo
Save
Mark Applied
Hide
Software Engineer, Spark Platform
San Francisco or Sunnyvale or Seattle or New York City
$131k-$285k/yr HybridFull Time
DoorDash
DoorDashNASDAQ: DASH: On-demand delivery platform connecting consumers with local merchants.
24+ YOEExperience operating production distributed systems and Apache Spark at scale, Kubernetes production experience, familiarity with schedulers and observability stacks, cloud (AWS) experience, programming in Python/Go/Scala/Java, and SQL fluency. BS/MS/PhD in CS or equivalent.
Apache Spark, Amazon EMR, Databricks, Kubernetes, YuniKorn, Volcano, Kueue, Spark-on-Kubernetes operator, Prometheus, OpenTelemetry, Python, Go, Scala, Java, SQL, VPC
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Software Engineer I (Data Engineer - Spark, Scala, ETL)
San Francisco, California, United States
RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
6+ YOE6+ years data engineering (Spark/Scala); 4+ years ETL/Databricks; Azure PaaS; Agile; unit tests; SQL/PLSQL; Git; GenAI tools; OO and secure coding.
Apache Spark, Scala, Databricks, Azure, Git, Docker, Splunk, GitHub Actions, SQL, GenAI
Job PostingView all
5d
Save
Mark Applied
Hide
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yr RemoteFull Time
SentiLink
SentiLink: Provides identity verification and fraud prevention for financial institutions.
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Python, Golang, PostgreSQL (RDS), OpenSearch, Redshift, EMR, Spark, Docker, Lambda, AWS, EKS, SQS, SNS, S3, Kubernetes, Hadoop, Kafka, Microsoft Azure, GCP
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or San Francisco
$170k-$200k/yr HybridFull Time
Tatari
Tatari: A platform for buying and measuring TV advertising campaigns.
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
Job PostingView all
1w
Save
Mark Applied
Hide
Staff Data Engineer
Denver or San Francisco
$190k-$264k/yr HybridFull Time
Checkr
Checkr: AI-powered platform for background checks and identity verification.
10+ YOE10+ years building scalable data platforms; expert PySpark, Python, SQL; experience with Kafka, Spark, Iceberg, data lakes, AWS; strong data modeling and security awareness.
PySpark, Python, SQL, MongoDB, Kafka, Spark, Iceberg, EKS, EMR, Serverless, Glue, Athena, S3, Databricks, Snowflake
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Machine Learning Platform Engineer
Kitchener-Waterloo or Toronto or San Francisco
$216k-$297k/yr HybridFull Time
Faire
Faire: Online wholesale marketplace connecting independent retailers with unique brands.
8+ YOE8+ years in production ML or data platforms; graduate degree in CS/Engineering/Statistics or related field; strong Databricks/Spark/Delta Lake/MLflow; Python/SQL; cloud and IaC; MLOps.
Databricks, Spark, Delta Lake, MLflow, Terraform, GitHub Actions, Kubernetes, AWS, S3, Python, SQL, Kotlin, Airflow, Snowflake, Unity Catalog
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or United States
$190k-$220k/yr HybridFull Time
Arbital Health
Arbital Health: Provides infrastructure for adjudicating healthcare value-based care contracts.
5+ YOE5+ years building data-intensive SaaS platforms, deep Spark and distributed processing expertise, strong SQL and data modeling, experience with Airflow, Terraform, Databricks, dbt/Great Expectations, healthcare data and HIPAA, Python proficiency.
Python, Spark, SQL, R, Databricks, AWS, Airflow, Terraform, dbt, Great Expectations, Cursor, Claude, Copilot, Gemini, Databricks Genie, Next.js, React, TypeScript, Tailwind CSS, GitHub, Jira, Confluence, Kafka, Structured Streaming, CI/CD
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Mateo or New York
$140k-$160k/yr HybridFull Time
Chartmetric
Chartmetric: Provides a global music data analytics platform for professionals.
6+ YOE6+ years building production data systems; expert Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, and AWS; bachelor's in CS/Data Engineering preferred or equivalent experience.
Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, AWS RDS, AWS
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer – GeoAI Platform
San Francisco or Bellevue
$185k-$275k/yr HybridFull Time
Wherobots
Wherobots: Cloud-native platform for geospatial data analytics and AI.
5+ YOE5+ years building distributed data or ML systems; experience with Ray/Spark/Dask, GPU inference, Python and scientific stack; geospatial and object-storage expertise.
Ray, Spark, Dask, Python, PyTorch, PyArrow, NumPy, Xarray, Zarr, Cloud-Optimized GeoTIFF (COG), GeoParquet, Parquet, S3, CUDA
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Software Engineer - Events Platform
New York or Seattle or San Francisco
$189k-$331k/yr OnsiteFull Time
Rippling
Rippling: Unified platform managing workforce HR, IT, and finance operations
8+ YOE8+ years backend engineering experience, leadership driving cross-functional projects, distributed systems and data pipeline experience (Spark or Flink), strong CS fundamentals, experience with APIs and high-availability services.
Apache Spark, Flink, AWS, Slack, Microsoft 365
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
United States or San Francisco
$100k-$167k/yr OnsiteFull Time
Stitch Fix
Stitch FixNASDAQ: SFIX: Provides personalized apparel styling services through algorithms and stylists.
2+ YOEBachelor's in engineering or computer science, 2+ years data engineering experience, familiarity with Spark, dbt, Fivetran, Airflow, S3; production Python and SQL; experience with AI coding agents; strong communication.
Spark, dbt, Fivetran, Airflow, S3, Claude Code, Codex, Python, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Glendale or San Francisco or New York
$142k-$199k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOEExperience building and operating large-scale data/ML systems, strong distributed systems fundamentals, streaming/batch technologies (Kafka, Kinesis, Spark, Flink), Python, plus working knowledge of Java/Scala/Go/C++, cloud-native (AWS, containers, Kubernetes, IaC), observability, and collaboration skills; Bachelor's or Master's required.
Kafka, Kinesis, Spark, Flink, Python, Java, Scala, Go, C++, AWS, Kubernetes, containers, IaC tools
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Forward Deployed Engineer - Financial Services
San Francisco or California or United States
$181k-$248k/yr RemoteFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
6+ YOE6+ years in data engineering or software engineering, expertise with Apache Spark, cloud (AWS/Azure/GCP), coding in Python/Scala/JavaScript/TypeScript, CI/CD, MLOps, customer-facing delivery, and Databricks certification preferred.
Python, Scala, JavaScript, TypeScript, Apache Spark, AWS, Azure, GCP, CI/CD, MLOps, Databricks, MLflow, Delta Lake
Job PostingView all
1mo
Save
Mark Applied
Hide
Member of Technical Staff - Web Crawl Engineer
San Francisco, California, United States
OnsiteFull Time
Reflection AI
Reflection AI: Developing open-source frontier artificial intelligence models and coding agents.
Experience building and operating large-scale web crawling and data collection systems; strong distributed systems skills; familiarity with Ray, Spark, Beam, or Flink; HTML parsing and browser automation experience; observability and performance optimization skills.
Ray, Spark, Beam, Flink, HTML
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
New York City or San Francisco
OnsiteFull Time
Bedrock Robotics
Bedrock Robotics: Automates heavy construction machinery with AI retrofit kits.
5+ YOE5+ years data engineering experience in large-scale data lake/warehouse environments; strong SQL and distributed query engine experience; pipeline orchestration (Airflow/Prefect) and Spark/Databricks experience; data quality and observability expertise.
SQL, Spark, BigQuery, Snowflake, Airflow, Prefect, Databricks
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Engineer, Identity
Seattle or San Francisco or New York City or United States
HybridFull Time
Stripe
Stripe: Provides online payment processing and financial infrastructure for businesses.
10+ YOE10+ years software engineering, 5+ years technical leadership, API design/abstractions, platform development, strong communication, and cross-functional collaboration.
Ruby, Typescript, Python, Scala, Java, Go, SQL, Spark, Trino, React, GraphQL, Kafka, Protobuf, Airflow, Bazel, Temporal, Mongo, Splunk, Prometheus
Job PostingView all
1w
Save
Mark Applied
Hide
Staff Software Engineer
Livingston or New York City or Sunnyvale or San Francisco or Bellevue
$207k-$275k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
10+ YOE10+ years in platform or infrastructure engineering with Kubernetes, CI/CD, IaC, observability, multi-region systems, and production ownership for high-availability services.
Spark, Airflow, Kafka, Flink, Kubernetes, Argo CD, GitHub Actions, Prometheus, Grafana, OpenTelemetry, Helm, Terraform, Pulumi
Job PostingView all
3d
Save
Mark Applied
Hide
Staff Data Engineer
San Francisco, California, United States
$200k-$260k/yr HybridFull Time
Metriport
Metriport: Provides an open-source API for healthcare data interoperability.
8+ YOE8+ years building and operating large-scale data platforms; experience with ingestion, storage, processing, warehousing, streaming, and leadership; strong software engineering and mentorship skills.
Spark, Parquet, Iceberg, Delta, S3, Snowflake, BigQuery, Redshift, dbt, Airflow, Dagster, Kafka, Kinesis, TypeScript, Python, Node.js, AWS, ECS, Lambda, SQS, SNS, Batch, CDK, PostgreSQL, Aurora, DynamoDB, FHIR, Athena, SageMaker, FHIR, HIE, IHE, EHR/EMR, NPI, TEFCA, ADT, HL7, HEDIS, RAF, SNOMED, LOINC, ICD-10
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Data Engineer
San Francisco, California, United States
$190k-$220k/yr HybridFull Time
LendingClub
LendingClubNYSE: LC: Digital marketplace bank providing personal loans and banking services.
8+ YOE2+ Mgmt8+ years data engineering experience with 2+ years technical lead experience; strong SQL, data modeling, ETL, orchestration, Spark, AWS, modern data platforms, and experience applying AI tools to engineering workflows.
Databricks, dbt, Elementary, Dagster, Airflow, Oozie, Spark, PySpark, EMR, S3, Redshift, Snowflake, Claude, ChatGPT, GitHub Copilot, Streamlit
Job PostingView all

Explore Jobs

Expand Your Job Search