312 spark data engineer jobs at 164 companies in Ross, CA
2mo
Save
Mark Applied
Hide
Spark Engineer
Sunnyvale, California, United States
OnsiteFull Time
5+ YOE5+ years in software development; data engineering with pipelines; Python/Perl/Shell; Java; Oracle/MySQL; real-time pipelines with Kafka/Storm.
Python, Perl, Shell, Java, Oracle, MySQL, Kafka, Storm, HDFS, Hive, Pig, Oozie, HBase, Spark
1mo
Save
Mark Applied
Hide
Data Engineer
New York City or San Francisco
OnsiteFull Time
5+ YOE5+ years data engineering experience in large-scale data lake/warehouse environments; strong SQL and distributed query engine experience; pipeline orchestration (Airflow/Prefect) and Spark/Databricks experience; data quality and observability expertise.
SQL, Spark, BigQuery, Snowflake, Airflow, Prefect, Databricks
1mo
Save
Mark Applied
Hide
Data Engineer
United States or San Francisco
$100k-$167k/yr OnsiteFull Time
2+ YOEBachelor's in engineering or computer science, 2+ years data engineering experience, familiarity with Spark, dbt, Fivetran, Airflow, S3; production Python and SQL; experience with AI coding agents; strong communication.
Spark, dbt, Fivetran, Airflow, S3, Claude Code, Codex, Python, SQL
2w
Save
Mark Applied
Hide
Lead Data Engineer
San Francisco, California, United States
$190k-$220k/yr HybridFull Time
8+ YOE2+ Mgmt8+ years data engineering experience with 2+ years technical lead experience; strong SQL, data modeling, ETL, orchestration, Spark, AWS, modern data platforms, and experience applying AI tools to engineering workflows.
Databricks, dbt, Elementary, Dagster, Airflow, Oozie, Spark, PySpark, EMR, S3, Redshift, Snowflake, Claude, ChatGPT, GitHub Copilot, Streamlit
1mo
Save
Mark Applied
Hide
Senior, Data Engineer
Sunnyvale or Bentonville
$90k-$234k/yr OnsiteFull Time
2+ YOEDesign and operate large-scale data pipelines on GCP using Spark, Airflow, BigQuery; optimize cloud cost; build automation and AI-driven engineering tools; 2+ years data engineering experience.
Spark, Scala, PySpark, Airflow, BigQuery, GCP, Python, Kafka, GCS
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yr RemoteFull Time
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
Spark, PySpark, Databricks, Python, SQL, Snowflake, Google BigQuery, Apache Iceberg, Fivetran, dbt, NetSuite, Salesforce, MySQL, AWS RDS/Aurora, PostgreSQL, Oracle, Microsoft SQL Server, AWS, Azure, GCP, Splunk, Datadog, AWS CloudWatch, API Gateway, Lambda, S3, SNS, SQS, SecretsManager, MCP (Model Context Protocol)
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or Foster City or Orange County or Morristown
RemoteFull Time
5+ YOERequires 5+ years in data engineering, advanced SQL, Python, Spark/PySpark, Microsoft Fabric, Azure data services, APIs, data modeling, CI/CD, Git, and Azure DevOps; bachelor's degree or equivalent experience.
Microsoft Fabric, Lakehouse, Warehouse, Data Pipelines, Notebooks, OneLake, Git, Azure DevOps, Spark, PySpark, SQL, Python, Azure, Delta Lake, Parquet, REST APIs, JSON, Power BI, DP-600, DP-700
2mo
Save
Mark Applied
Hide
Data Engineer III
San Ramon, California, United States
$104k-$153k/yr RemoteFull Time
5+ YOE5+ years Python/SQL data engineering; 3+ years cloud AWS; ETL/ELT pipelines; Docker/Kubernetes; Terraform/CloudFormation; Spark; CI/CD; collaboration with data science and MLOps; mentoring.
Python, SQL, Spark, Databricks, Delta Lake, Unity Catalog, MLflow, AWS, Docker, Kubernetes, Terraform, CloudFormation
1w
Save
Mark Applied
Hide
Director, Data Engineer
Mountain View, California, United States
OnsiteFull Time
8+ YOE3+ Mgmt8+ years data engineering experience, 3+ years people management; proficiency in data modeling, ETL, Python, SQL; experience with Spark, HDFS, S3 and ETL schedulers (Airflow, Dagster, DBT); experimentation and ML familiarity.
Python, SQL, Spark, HDFS, S3, Airflow, Dagster, DBT
2mo
Save
Mark Applied
Hide
Data Engineer
San Francisco or Denver
$170k-$220k/yr HybridFull Time
4+ YOE4-8 years in data engineering; experience with Apache Beam/Spark/Flink or MapReduce; JVM language proficiency; distributed data processing; experience at a small company; strong communication and ownership.
GCP, Java, Python, Kotlin, BigQuery, PostgreSQL, Scylla/Cassandra, Apache Beam, Apache Spark, Dataflow, Airflow
3d
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Chicago
$170k-$230k/yr HybridFull Time
Experience building production data pipelines at scale with advanced Python, SQL, Airflow, Spark, and AWS; healthcare data expertise and strong data quality, reliability, troubleshooting, and collaboration skills required.
Python, SQL, Airflow, AWS, Spark, ChatGPT, Gemini, Claude, ICD-10, CPT, NDC, NPI
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica or Seattle or San Francisco
$142k-$190k/yr HybridFull Time
5+ YOEBachelor's or equivalent experience, 5+ years big data engineering, strong Python/Scala/SQL, Spark/Presto/Hive, Databricks and cloud MPP databases, Airflow, AWS S3, CI/CD, on-call and production operations experience.
Databricks, Spark, Presto, Hive, Python, Scala, SQL, Snowflake, Redshift, BigQuery, Airflow, CI/CD, AWS S3, Terraform
2mo
Save
Mark Applied
Hide
Data Engineer, People Innovation Labs
San Francisco, California, United States
$293k-$325k/yr HybridFull Time
3+ YOE3+ years data engineering; 8+ years software engineering; Python/Scala/Java; Databricks, Snowflake; ETL schedulers; Spark/Hadoop/Flink; S3/HDFS; strong data pipelines and collaboration.
Python, Scala, Java, Databricks, Snowflake, Fivetran, Airflow, Dagster, Prefect, Spark, Hadoop, Flink, HDFS, S3
2mo
Save
Mark Applied
Hide
Data Engineer
San Francisco, California, United States
OnsiteFull Time
5+ YOE5+ years building production data pipelines; hands-on SQL, Python, Spark, AWS Glue, EMR, DBT, Airflow; 3+ years with MPP databases (Snowflake/Redshift/Teradata); on-call experience and strong cross-team communication.
SQL, Python, Spark, AWS Glue, EMR, DBT, Airflow, Snowflake, AWS Redshift, Teradata
1mo
Save
Mark Applied
Hide
Senior Data Engineer
New York City or Sunnyvale or Bellevue
$182k-$242k/yr OnsiteFull Time
5+ YOE5+ years building analytical data models and production data systems; expertise in Python/Scala/Rust, advanced SQL, Spark/Flink, lakehouse technologies, and dimensional modeling for OLAP workloads.
Python, Scala, Rust, SQL, Spark, Flink, Iceberg, Delta, StarRocks, ClickHouse, Trino, Kafka, AutoMQ, Pulsar, Kubernetes
2w
Save
Mark Applied
Hide
Staff Data Engineer
Denver or San Francisco
$190k-$264k/yr HybridFull Time
10+ YOE10+ years building scalable data platforms; expert PySpark, Python, SQL; experience with Kafka, Spark, Iceberg, data lakes, AWS; strong data modeling and security awareness.
PySpark, Python, SQL, MongoDB, Kafka, Spark, Iceberg, EKS, EMR, Serverless, Glue, Athena, S3, Databricks, Snowflake
2w
Save
Mark Applied
Hide
Senior Data Engineer
New York City or San Francisco
$170k-$200k/yr HybridFull Time
5+ YOE5+ years building and operating production ETL pipelines; strong Python and SQL skills; Spark/PySpark, Databricks/Delta Lake, Airflow experience; strong data modeling and data quality practices.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
2mo
Save
Mark Applied
Hide
Senior Data Engineer - Data Lead
San Francisco, California, United States
$150k-$250k/yr OnsiteFull Time
5+ YOE5-7 years data engineering experience; TB–PB-scale pipelines; Spark/Flink/Kafka/Airflow/dbt; Python/SQL; Go/Java/TypeScript a plus; cloud data services; architecture and governance; independent, end-to-end ownership.
Spark, Flink, Kafka, Airflow, dbt, Python, SQL, Go, Java, TypeScript, AWS, GCP, Azure, Kubernetes
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Foster City, California, United States
$123k-$191k/yr HybridFull Time
2+ YOE2+ years experience with a Bachelor's (or Advanced) degree; strong programming in Java/Python/Go/Scala; experience building scalable data pipelines, Spark/Kafka/Hadoop ecosystem, cloud platforms, GenAI and data modeling.
Java, Python, Go, Scala, Gen AI, GenAI, Apache Spark, Spark, Kafka, Hadoop, Hive, Trino, Presto, Apache Airflow, Hbase, AWS, Azure, DataBricks, HDFS, S3, LLMs, NLP, RAG, Vector DBs, MCP, A2A, J2EE, Microservices, REST APIs, CI/CD, Jira, Jira Align
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Mateo or New York City
$140k-$160k/yr HybridFull Time
6+ YOE6+ years building production data systems; expert in Python, PostgreSQL, Airflow, Clickhouse, Snowflake, Elasticsearch, Spark, and AWS; Bachelor's in CS/Data Engineering or equivalent experience.
Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, AWS, AWS RDS
Explore Jobs