7 streaming data engineer jobs at 5 companies in San Diego, CA
1d
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Seattle or Toronto or Santa Barbara or San Diego
$127k-$190k/yr RemoteFull Time
5+ YOE5+ years in data or software engineering; advanced Python, SQL, Databricks, Spark, and data modeling; experience with orchestration, streaming, cloud infrastructure, data quality, ML datasets, and privacy; bachelor's degree or equivalent.
Python, PySpark, Pandas, Polars, PyArrow, SQL, MySQL, PostgreSQL, Databricks, Delta Lake, Unity Catalog, Workflows, Jobs/Compute, Snowflake, BigQuery, Apache Spark, Airflow, Dagster, Kafka, Kinesis, Spark Structured Streaming, AWS, S3, IAM, FastAPI, Databricks Model Serving, SageMaker endpoints
2mo
Save
Mark Applied
Hide
Senior Data Engineer (OpAI)
Fort Carson or Colorado Springs or Charleston or Denver or San Diego
$110k-$180k/yr OnsiteFull Time
10+ YOEU.S. citizen with active TS clearance, 10+ years relevant experience, strong Python/Go/Rust/SQL skills, experience with data pipelines, event streaming, cloud-native data services, GIS, and secure DoD environments.
CSV, JSON, XML, Parquet, ORC, Apache Kafka, AWS Kinesis, RabbitMQ, ZeroMQ, AWS Lambda, Dask, Spark, AWS S3, RDS, EFS, SNS, SQS, AirByte, Apache Airflow, dbt, Apache Iceberg, Snowflake, ArcGIS, PostGIS, Docker, Kubernetes, Elasticsearch, Redis, PostgreSQL, Python, Go, Rust, Pandas, R, SQL
2mo
Save
Mark Applied
Hide
Advisor - Data Architect, Data Foundry
San Diego or San Francisco or Boston or Louisville or Indianapolis
$152k-$244k/yr OnsiteFull Time
2+ YOEM.S. or PhD in a STEM field with relevant data architecture/engineering or scientific informatics experience (MS+6 yrs or PhD+2 yrs). Expertise in data modeling, lakehouse and platform architecture, knowledge graphs, semantic web standards, cloud and streaming data patterns.
Databricks, Snowflake, Spark, dbt, Kafka, Kinesis, Flink, Neo4j, Amazon Neptune, TigerGraph, TileDB, MongoDB, Pinecone, Weaviate, pgvector, Delta Lake, Unity Catalog, RDF, OWL, SPARQL, Protégé, Benchling, C, C++, Rust, SQL, LIMS, ELN, HPC
1w
Save
Mark Applied
Hide
Software Engineer II, Data Platform
Aliso Viejo or San Diego
$150k-$225k/yr HybridFull Time
3+ YOEBachelor's in Computer Science,3+ years building scalable distributed systems,proficiency in Scala/Java/Python,AWS or GCP experience,knowledge of event streaming and distributed processing,CI/CD and on-call experience.
Scala, Java, Python, AWS, GCP, Kafka, Kinesis, SQS, Apache Spark, Apache Flink, Databricks
1w
Save
Mark Applied
Hide
Software Engineer II, Data Platform
San Diego or Los Angeles
$150k-$225k/yr HybridFull Time
3+ YOEBachelor's in Computer Science,3+ years building scalable distributed systems,proficiency in Scala/Java/Python,cloud experience (AWS preferred),event streaming and distributed processing familiarity,CI/CD and on-call experience.
Scala, Java, Python, AWS, GCP, Kafka, Kinesis, SQS, Apache Spark, Apache Flink, Databricks
1mo
Save
Mark Applied
Hide
Senior Software Engineer (Platform Data Reliability & Automation)
San Diego, California, United States
$177k-$266k/yr OnsiteFull Time
6+ YOE6+ years software/DBRE experience (3+ years with Go), experience with IaC and automation (Terraform/Ansible), Kubernetes, AWS/GCP, NoSQL/streaming/caching platforms (Cassandra, Kafka, Redis), strong Linux, observability, and incident response skills; Bachelor's or Master's in CS or related field.
Infrastructure as Code (IaC), Terraform, Ansible, Go (Golang), Kubernetes, AWS, GCP, Kafka, MSK, Cassandra, Aerospike, Redis, DynamoDB, ElastiCache, Linux, AI/ML
22h
Save
Mark Applied
Hide
Senior Software Engineer Expeditionary Systems (OpAI)
San Diego or Arlington or Colorado Springs or Charleston or Denver
$160k-$200k/yr OnsiteFull Time
9+ YOEBachelor's degree or equivalent experience, 9+ years in software or data-related roles, Python, Rust or Go, tactical data systems, data pipelines, event streaming, and active Secret clearance.
Zenoh, Rust, React, JavaScript, Python, Go, Docker, Kubernetes, CSV, JSON, XML, Parquet, ORC, Apache Kafka, AWS Kinesis, RabbitMQ, ZeroMQ, Tactical Assault Kit (TAK), AirByte, Apache Airflow, dbt, Apache Iceberg, Snowflake, ArcGIS, PostGIS, Elasticsearch, Redis, S3, PostgreSQL