18 batch data engineer jobs at 15 companies in American Canyon, CA

2w
Save
Mark Applied
Hide
Principal Data Engineer, People Data
Bellevue or Chicago or San Francisco or Washington
$197k-$271k/yr HybridFull Time
Okta
OktaNASDAQ: OKTA: Provide secure identity management and authentication for enterprises.
10+ YOE10+ years data engineering experience; expert SQL, ETL/ELT, MPP databases, AWS services; HR/People data experience; experience with batch and realtime pipelines, lakehouse architectures, and data quality frameworks.
SQL, Airflow, dbt, Snowflake, Redshift, Amazon S3, AWS Lambda, EMR, ECR, EKS, Workday, Spark, Kafka, Databricks, Iceberg, Delta
1w
Save
Mark Applied
Hide
Staff Data Engineer
San Francisco or New York
$185k-$195k/yr HybridFull Time
Butterfly Network
Butterfly NetworkNYSE: BFLY: Handheld whole-body ultrasound scanners powered by semiconductor technology.
5+ YOE5+ years data engineering experience, strong dbt and Databricks skills, Python/PySpark, streaming and batch ingestion, CDC pipelines, data quality and observability, and experience integrating with operational systems.
dbt, Databricks, Delta Lake, Delta Live Tables, Python, PySpark, Salesforce, NetSuite, Stripe, Mulesoft, Great Expectations, Unity Catalog, Airflow, Cloud Run, Cloud Functions, BigQuery, AWS, GCP, Terraform, Spacelift, Boomi
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or New York City
HybridFull Time
Beast Industries
Beast Industries: Produces digital media and consumer goods for MrBeast brands.
8+ YOE8+ years building production data platforms, expertise in batch and streaming pipelines, data modeling, ETL/ELT, reliability, observability, and privacy-safe foundations for AI/ML.
1d
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco, California, United States
$180k-$220k/yr HybridFull Time
Metriport
Metriport: Provides an open-source API for healthcare data interoperability.
6+ YOE6+ years data engineering experience building and scaling pipelines; experience across ingestion, storage, processing, warehousing; production coding in TypeScript/Python; mentoring experience; located in or willing to relocate to San Francisco Bay Area.
Spark, Parquet, Iceberg, Delta, S3, Snowflake, BigQuery, Redshift, TypeScript, Python, Kafka, Kinesis, dbt, Airflow, Dagster, FHIR, HIE, IHE, EHR/EMR, NPI, TEFCA, ADT, HL7, HEDIS, RAF, SNOMED, LOINC, ICD-10, Node.js, AWS, ECS, Lambda, SQS, SNS, Batch, CDK, PostgreSQL, Aurora, DynamoDB, Athena, SageMaker
1d
Save
Mark Applied
Hide
Staff Data Engineer
San Francisco, California, United States
$200k-$260k/yr HybridFull Time
Metriport
Metriport: Provides an open-source API for healthcare data interoperability.
8+ YOE8+ years building and operating large-scale data platforms; experience with ingestion, storage, processing, warehousing, streaming, and leadership; strong software engineering and mentorship skills.
Spark, Parquet, Iceberg, Delta, S3, Snowflake, BigQuery, Redshift, dbt, Airflow, Dagster, Kafka, Kinesis, TypeScript, Python, Node.js, AWS, ECS, Lambda, SQS, SNS, Batch, CDK, PostgreSQL, Aurora, DynamoDB, FHIR, Athena, SageMaker, FHIR, HIE, IHE, EHR/EMR, NPI, TEFCA, ADT, HL7, HEDIS, RAF, SNOMED, LOINC, ICD-10
1w
Save
Mark Applied
Hide
ML Infra Engineer (Data Systems)
San Francisco, California, United States
OnsiteFull Time
Physical Intelligence
Physical Intelligence: Creating foundation models for general-purpose robot intelligence.
Strong software engineering fundamentals with experience building distributed systems, large-scale data pipelines, object storage and batch/streaming systems; ownership mindset and performance focus.
ClickHouse, Ray, Flink, Spark
1w
Save
Mark Applied
Hide
Member of Technical Staff - Data Platform
New York City or San Francisco or London
OnsiteFull Time
Reflection AI
Reflection AI: Developing open-source frontier artificial intelligence models and coding agents.
Experienced data engineer with production-grade pipeline experience for large-scale batch and streaming workloads; strong debugging, cost/performance optimization, and data quality/governance skills.
Spark, Flink, Beam, Airflow, Dagster, Kafka, PubSub, Parquet, Iceberg, Delta Lake, BigQuery, Snowflake, Great Expectations
1w
Save
Mark Applied
Hide
Member of Technical Staff — Data Ingestion & Quality
San Francisco, California, United States
OnsiteFull Time
Causal Labs
Causal Labs: Building physics-based causal AI models for predictive weather intelligence.
Experience building large-scale data pipelines and QA systems, familiarity with streaming and batch ingestion, vendor collaboration, and strong problem-solving and domain learning skills.
Apache Spark, Ray, Beam
1mo
Save
Mark Applied
Hide
Data Engineering Manager, Data & ML Platform
San Francisco or Montreal or Bengaluru
$220k-$330k/yr HybridFull Time
Hinge Health
Hinge HealthNYSE: HNGE: Digital provider of musculoskeletal care and physical therapy
5+ YOE2+ Mgmt5+ years data engineering; 2+ years managing engineering teams; 2+ years building ML platform capabilities; experience with batch & streaming systems and tools such as Kafka, Flink, Spark; proficiency with Python, SQL, dbt, Databricks, and AWS.
Kafka, Flink, Spark, Python, SQL, dbt, Databricks, AWS, Delta Lake, MLflow, Unity Catalog
2mo
Save
Mark Applied
Hide
Lead AI Engineer, Data Solutions
San Francisco, California, United States
$173k-$260k/yr HybridFull Time
Salesforce
SalesforceNYSE: CRM: Sells cloud-based customer relationship management and business software solutions.
6+ YOE6+ years in AI/ML engineering or applied data science; strong Python in production; ML model development and deployment; data pipelines (ETL/ELT, batch or streaming); APIs and backend systems; experience with LLM-powered systems and agent workflows; familiarity with Spark, Airflow/Dagster, Snowflake/BigQuery.
Python, Spark, Airflow, Dagster, Snowflake, BigQuery
1mo
Save
Mark Applied
Hide
Software Engineer, Platform
San Francisco, California, United States
$200k-$250k/yr OnsiteFull Time
Duckbill
Duckbill: SaaS platform for enterprise cloud financial planning and analysis.
Proven experience building data systems and ETL for batch and streaming; strong Python and SQL; experience with data warehouses/lakehouses/OLAP, columnar databases, cloud storage, and data quality practices.
Python, ClickHouse, Airflow, Parquet, S3, Flask, React, OpenTelemetry (OTel), HTTP APIs, SQL
1mo
Save
Mark Applied
Hide
Member of Technical Staff (Software Engineer, Data Platform)
San Francisco or New York City or Palo Alto
$220k-$405k/yr OnsiteFull Time
Perplexity
Perplexity: AI-powered search engine providing conversational answers with citations.
5+ YOE5+ years software engineering experience (8+ for staff), production data infrastructure and batch/streaming experience, Airflow/Dagster, Python plus another backend language (Go/TypeScript), ML/AI workflow support, data quality and observability knowledge.
Databricks, Snowflake, Spark, Kafka, Flink, Airflow, Dagster, dbt, Iceberg, Delta Lake, ClickHouse, Kinesis, PubSub, Python, Go, TypeScript
1mo
Save
Mark Applied
Hide
Senior Technical Solutions Engineer
San Bruno or Boston or Dallas
$162k-$182k/yr HybridFull Time
Verily
Verily: Developing data-driven technologies for clinical research and precision health.
6+ YOEBA/BS in CS or equivalent, 6+ years experience with Python and/or Java, SQL proficiency, experience with life science/biomedical data and batch workflows, strong communication and project management skills.
Python, Java, SQL, Google Cloud Platform, Amazon Web Services, Microsoft Azure, Docker, Linux
9h
Save
Mark Applied
Hide
Software Engineer, Cloud Infrastructure (Multiple Seniority Levels)
San Carlos, California, United States
$135k-$260k/yr HybridFull Time
Beacon AI
Beacon AI: Developing an AI-powered-pilot for safer flight operations.
Experience designing and operating AWS cloud and LLM/ML infrastructure, building data pipelines, and implementing security and observability for production systems.
AWS CDK, Terraform, GitHub Actions, CodeBuild, CodePipeline, VPC, PrivateLink, KMS, Secrets Manager, CloudWatch, OpenTelemetry, AWS Bedrock, SageMaker, ECS, EKS, Lambda, Batch, LangChain, Step Functions, Apache Airflow, OpenSearch Serverless, Aurora PostgreSQL, pgvector, Pinecone, S3, Glacier, Athena, Glue, Lake Formation, Redis, EventBridge, SQS, Python, Triton Inference Server, TensorRT-LLM, Bedrock Guardrails
4d
Save
Mark Applied
Hide
Software Engineer, Cloud Infrastructure (Multiple Seniority Levels)
San Carlos, California, United States
$135k-$260k/yr HybridFull Time
Beacon AI
Beacon AI: Developing an AI-powered-pilot for safer flight operations.
Experience building and operating AWS cloud and LLM infrastructure, CI/CD for infra and ML pipelines, data pipelines, security and observability for production systems.
AWS CDK, Terraform, GitHub Actions, CodeBuild, CodePipeline, VPC, PrivateLink, VPC endpoints, IAM, KMS, Secrets Manager, CloudWatch, OpenTelemetry, AWS Bedrock, SageMaker, ECS, EKS, Lambda, Batch, LangChain, Step Functions, Airflow, OpenSearch Serverless, Aurora PostgreSQL, pgvector, Pinecone, S3, Glacier, Athena, Glue, Lake Formation, Redis, EventBridge, SQS, Triton Inference Server, TensorRT-LLM, Python
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Glendale or San Francisco or New York
$142k-$199k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOEExperience building and operating large-scale data/ML systems, strong distributed systems fundamentals, streaming/batch technologies (Kafka, Kinesis, Spark, Flink), Python, plus working knowledge of Java/Scala/Go/C++, cloud-native (AWS, containers, Kubernetes, IaC), observability, and collaboration skills; Bachelor's or Master's required.
Kafka, Kinesis, Spark, Flink, Python, Java, Scala, Go, C++, AWS, Kubernetes, containers, IaC tools
2d
Save
Mark Applied
Hide
Member of Technical Staff, Data Engineering
Palo Alto or San Francisco
$150k-$300k/yr OnsiteFull Time
Parallel
Parallel: Build web infrastructure and search APIs for AI agents.
Deep experience in distributed data processing, data modeling, system reliability, batch and streaming pipelines, and building data quality, lineage, and observability systems.
3w
Save
Mark Applied
Hide
Software Engineer SMTS/ MTS
Bellevue or San Francisco
$117k-$224k/yr HybridFull Time
Salesforce
SalesforceNYSE: CRM: Sells cloud-based customer relationship management and business software solutions.
10+ YOE10+ years software development experience building large-scale data platforms using Apache Spark, AWS S3, streaming/batch pipelines; strong distributed systems, API, and architecture expertise; MSc/BS or equivalent; Scrum/Kanban experience.
Apache Spark, AWS S3, OpenAPI