97 pyspark data engineer jobs at 50 companies in Cotati, CA
2mo
Save
Mark Applied
Hide
Data Engineer
San Francisco, California, United States
$140k-$230k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; strong SQL; Python; TypeScript; Airflow; AWS Glue; PySpark; Snowflake/PostgreSQL; backend frameworks; observability and data quality mechanisms.
Python, TypeScript, Apache Airflow, PySpark, AWS Glue, Snowflake, PostgreSQL, NestJS, GraphQL, AWS
1w
Save
Mark Applied
Hide
Data Engineer
Durham or Boston or Princeton or Emeryville or Evanston or Evanston or New York City or Rockville
$85k-$105k/yr HybridFull Time
3+ YOEBachelor's degree,3+ years data engineering experience,proficient with Python/PySpark,Databricks,AWS/Azure,relational databases,Git,CI/CD,and cloud security/IAM.
Databricks, Python, PySpark, AWS, Azure, PostgreSQL, Oracle, MySQL, Amazon Redshift, Snowflake, Git, Azure AD, Okta, OAuth, SAML, Azure Data Factory, Informatica, SnapLogic, Boomi, Docker, Kubernetes, AWS ECS, Flask, Django, JavaScript, HTML, CSS, Ajax
1mo
Save
Mark Applied
Hide
Data Engineer
New York or Los Angeles or San Francisco
$140k-$175k/yr HybridFull Time
3+ YOEBS or equivalent, 3+ years data engineering experience, Python and SQL proficiency, experience with PySpark and distributed data processing, AWS experience preferred, LLM-assisted development familiarity, and willingness to participate in on-call support.
S3, Apache Iceberg, EMR, PySpark, Dagster, Kubernetes, ClickHouse, PostgreSQL, FastAPI, Metabase, Python, SQL, AWS, AWS Athena, EHR, OMOP CDM, HIPAA, LLM
2w
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco, California, United States
$133k-$236k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; proficiency in SQL, Python, PySpark, Airflow, Databricks; experience with high-volume telemetry, AI/ML data pipelines, and data governance.
SQL, Python, PySpark, Airflow, Databricks, Unity Catalog, Azure
1mo
Save
Mark Applied
Hide
Sr. Data Engineer
San Francisco, California, United States
$120k-$160k/yr HybridFull Time
Experienced in data modeling, large-scale data pipelines, ETL/ELT, Python and PySpark, machine learning/NLP, data warehousing, and collaboration across engineering and product teams.
Python, numpy, pandas, scikit-learn, nltk, TensorFlow, matplotlib, PySpark
3w
Save
Mark Applied
Hide
Staff Data Engineer
San Francisco or New York City
$185k-$195k/yr HybridFull Time
5+ YOE5+ years data engineering experience, strong dbt and Databricks skills, Python/PySpark, streaming and CDC ingestion, data quality and observability, experience with operational integrations.
dbt, Databricks, Python, PySpark, Delta Lake, Delta Live Tables, Airflow, Cloud Run, Cloud Functions, BigQuery, GCP, AWS, Salesforce, NetSuite, Stripe, Mulesoft, Great Expectations, Unity Catalog, Terraform, Spacelift, Boomi
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yr RemoteFull Time
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
Spark, PySpark, Databricks, Python, SQL, Snowflake, Google BigQuery, Apache Iceberg, Fivetran, dbt, NetSuite, Salesforce, MySQL, AWS RDS/Aurora, PostgreSQL, Oracle, Microsoft SQL Server, AWS, Azure, GCP, Splunk, Datadog, AWS CloudWatch, API Gateway, Lambda, S3, SNS, SQS, SecretsManager, MCP (Model Context Protocol)
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City
$120k-$235k/yr OnsiteFull Time
3+ YOEMaster's (3+ yrs) or Bachelor's (4+ yrs) in CS/Math/Engineering or equivalent experience; experience building production data systems, instrumentation/telemetry, experimentation, PySpark/SQL, and mentoring engineers; must pass Microsoft background checks.
ADLS, Azure Synapse, Microsoft Fabric, Databricks, PySpark, SQL, Cosmos, Scope, Conform, Aria
2mo
Save
Mark Applied
Hide
Staff Data Engineer - Data & ML Platform
San Francisco, California, United States
$198k-$296k/yr HybridFull Time
8+ YOE8+ years data engineering; strong Python and SQL; distributed processing (PySpark/Flink); cloud pipelines; mentoring.
Python, SQL, Flink, PySpark, Kafka, Delta Lake, dbt, Airflow, Aurora PostgreSQL, AWS
4d
Save
Mark Applied
Hide
Data Analytics Engineer
San Francisco, California, United States
$140k-$155k/yr HybridFull Time
5+ YOERequires a bachelor's degree or equivalent experience, 5+ years in data engineering or analytics engineering, advanced Python, PySpark, SQL, AWS, ETL/ELT, orchestration, CI/CD, and financial services experience.
Python, PySpark, SQL, AWS, Amazon S3, AWS Glue, Amazon EMR, Amazon Redshift, AWS Lambda, AWS Identity and Access Management (IAM), Amazon CloudWatch, Airflow, Databricks Workflows, AWS Step Functions, GitHub, GitHub Actions, Databricks, Delta Lake, Unity Catalog, Terraform, AWS CloudFormation, Kafka, Amazon Kinesis, Spark Structured Streaming, Great Expectations, dbt, Microsoft?
2w
Save
Mark Applied
Hide
Staff Data Engineer
Denver or San Francisco
$190k-$264k/yr HybridFull Time
10+ YOE10+ years building scalable data platforms; expert PySpark, Python, SQL; experience with Kafka, Spark, Iceberg, data lakes, AWS; strong data modeling and security awareness.
PySpark, Python, SQL, MongoDB, Kafka, Spark, Iceberg, EKS, EMR, Serverless, Glue, Athena, S3, Databricks, Snowflake
2w
Save
Mark Applied
Hide
Senior Data Engineer
New York City or San Francisco
$170k-$200k/yr HybridFull Time
5+ YOE5+ years building and operating production ETL pipelines; strong Python and SQL skills; Spark/PySpark, Databricks/Delta Lake, Airflow experience; strong data modeling and data quality practices.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
2mo
Save
Mark Applied
Hide
Data Engineer
San Francisco or Denver
$170k-$220k/yr HybridFull Time
4+ YOE4-8 years in data engineering; experience with Apache Beam/Spark/Flink or MapReduce; JVM language proficiency; distributed data processing; experience at a small company; strong communication and ownership.
GCP, Java, Python, Kotlin, BigQuery, PostgreSQL, Scylla/Cassandra, Apache Beam, Apache Spark, Dataflow, Airflow
2w
Save
Mark Applied
Hide
Lead Data Engineer
San Francisco, California, United States
$190k-$220k/yr HybridFull Time
8+ YOE2+ Mgmt8+ years data engineering experience with 2+ years technical lead experience; strong SQL, data modeling, ETL, orchestration, Spark, AWS, modern data platforms, and experience applying AI tools to engineering workflows.
Databricks, dbt, Elementary, Dagster, Airflow, Oozie, Spark, PySpark, EMR, S3, Redshift, Snowflake, Claude, ChatGPT, GitHub Copilot, Streamlit
1mo
Save
Mark Applied
Hide
Data Engineer
Houston or Golden or Reno or Oakland or Salt Lake City
HybridFull Time
2+ YOE2+ years building and operating production data pipelines with Apache Spark, Python/SQL, Databricks, Azure, and Snowflake; experience with streaming, data modeling, data quality, governance, and CI/CD.
Databricks, Delta Lake, Delta Live Tables, Unity Catalog, Databricks Workflows, Databricks SQL, Apache Spark, PySpark, Spark SQL, Structured Streaming, Kafka, Microsoft Event Hubs, Microsoft Azure Data Factory, Microsoft Azure Data Lake Storage (ADLS), Snowflake, Microsoft Power BI, Spotfire, Python, SQL, Git, Azure DevOps, GitHub Actions, dbt, Terraform, Docker, Airflow, Microsoft Entra ID, Microsoft Key Vault, MQTT, OPC UA, SparkplugB, Canary, Ignition, Snowflake Semantic Views, Databricks Metric Views
4d
Save
Mark Applied
Hide
Data Engineer - Senior/Lead
Seattle or Bellevue or San Francisco
$173k-$260k/yr OnsiteFull Time
8+ YOERequires 8+ years in data engineering, technical degree, SQL, Python, ETL/ELT, Airflow, Hadoop, data modeling, GitHub or Subversion, CI/CD, and technical leadership across enterprise data products.
SQL, Python, Apache Airflow, Amazon Web Services (AWS), Apache Spark, Tableau, Hadoop, dbt, Snowflake, Databricks, GitHub, Subversion, CI/CD, LookML, Cube
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco, California, United States
$138k-$221k/yr OnsiteFull Time
Senior-level Big Data engineering experience with Java or Scala, Apache Spark, Hive/Impala, streaming tools (Kafka, NiFi), relational and NoSQL databases, Linux/Shell, strong CS fundamentals, and experience designing high-scale distributed systems.
Java, Scala, Apache Spark, MySQL, PostgreSQL, Hive, Impala, Oozie, Airflow, NiFi, Kafka, Linux/Unix, Shell, Azure, AWS, GCP
1w
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$175k-$270k/yr HybridFull Time
8+ YOE8+ years building large-scale data platforms, distributed systems, cloud-native data pipelines, EM/ML operationalization, and data warehouse/Big Data solutions; Bachelor's in CS or related.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, Aerospike, Elastic Search, IBM Infosphere, Oracle, SQL Server, AppDynamics, Kubernetes
1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
1mo
Save
Mark Applied
Hide
Staff Engineer - Data Platform
San Francisco or Seattle or New York City
$240k-$260k/yr HybridFull Time
Haus: Provides an incrementality platform for marketing measurement and optimization.
8+ YOE8+ years software engineering with 4+ years building production data platforms; deep expertise in Python, SQL/dbt, orchestrators (Dagster/Airflow/Temporal), BigQuery/Snowflake; technical leadership, design docs, and mentorship experience.
Python, SQL, dbt, Dagster, Airflow, Temporal, GCP, BigQuery, Snowflake, Fivetran, Apache Spark, Apache Beam, Apache Iceberg, Google, Meta, TikTok, Amazon
Explore Jobs