49 spark data engineer jobs at 29 companies in Fallbrook, CA

4w
Save
Mark Applied
Hide
Senior Data Engineer
Costa Mesa, California, United States
$166k-$220k/yr OnsiteFull Time
Anduril Industries
Anduril Industries: Defense technology building autonomous military hardware and software.
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
Palantir Foundry, SQLMesh, Athena, Apache Iceberg, Flyte, Python, Spark, PySpark, SQL, dbt, AWS, Azure, GCP, Tableau
1mo
Save
Mark Applied
Hide
Senior Data Engineer III
San Diego, California, United States
$183k-$205k/yr OnsiteFull Time
SHEIN
SHEIN: Global online retailer of affordable fashion and lifestyle products.
4+ YOEBachelor's in Data Science/Computer Science + 4 years data engineering experience building large-scale ETL pipelines with Hive/Presto/Spark/Flink, data warehousing (Redshift), SQL, Amazon S3, AWS EMR, Airflow; on-call participation.
Hive, Presto, Spark, Flink, Amazon Redshift, SQL, Amazon S3, AWS EMR, Airflow
2w
Save
Mark Applied
Hide
Data Developer
San Diego, California, United States
HybridFull Time
Innovatus Technology Consulting
Innovatus Technology Consulting: Delivers IT infrastructure and cybersecurity services to federal defense agencies.
4+ YOEActive Secret clearance and U.S. citizenship required; Bachelor's degree or 4+ years' related experience; experience with data engineering, ETL/ELT, Apache Spark, SQL, AWS, Python, ML, and data visualization.
ETL/ELT, SQL, Apache Spark, PySpark, AWS, Delta Lake, Python, Scikit-Learn, TensorFlow, MLflow, Pandas, Flask, Django, Git, Tableau, Qlik, Jupyter Notebooks, Databricks, Azure Data Studio, Palantir Foundry
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Diego, California, United States
$124k-$190k/yr HybridFull Time
CoStar Group
CoStar GroupNASDAQ: CSGP: Global provider of commercial and residential real estate data.
5+ YOEBachelor's degree required, 5+ years data engineering experience, strong ETL/pipeline and AWS experience, Databricks/Spark, C#/.NET, SQL, CI/CD/DevOps, and experience designing scalable data platforms.
Databricks, Apache Spark, C#, .NET, Claude Code, AWS, Kafka, Kinesis, SQL, CI/CD, DevOps
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Carlsbad, California, United States
HybridFull Time
NTENT
NTENT: Develops semantic search and natural language processing technology platforms.
3+ YOEThree+ years in data engineering or data warehousing; SQL Server with T-SQL; Hadoop ecosystem; Python; data modeling and visualization.
T-SQL, Microsoft SQL Server, Hadoop, Hive, Pig, Oozie, Python, Tableau, Kafka, Spark
1w
Save
Mark Applied
Hide
Lead Data Engineer - MSS
Irvine, California, United States
$110k-$140k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOEHands-on experience with Databricks, dbt, Python, PySpark, Spark, and SQL; 6+ years experience; proven track record in data platform migration to Databricks Lakehouse; leadership and mentoring experience.
Databricks, dbt, Python, PySpark, Spark, SQL, Delta Lake, Unity Catalog, Databricks Workflows, Structured Streaming, Medallion Architecture, Airflow, EBT
4w
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
Cotality
Cotality: Provides property data, analytics, and workflow intelligence solutions.
7+ YOE7+ years IT experience, bachelor's in CS/Engineering or equivalent, expertise in cloud data platforms, Python/PySpark, data modeling, big data technologies, graph DBs, orchestration tools, and enterprise data architecture.
AWS, Google Cloud Platform (GCP), Python, PySpark, Neo4j, Google Spanner, Hadoop, Spark, Elasticsearch, Google Cloud Dataflow, Apache Beam, Apache Airflow, BMAD, Spec Kit, SQL, NoSQL
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Diego or Vienna
RemoteFull Time
9amHealth
9amHealth: Virtual clinic providing personalized cardiometabolic and diabetes care.
10+ YOE10+ years in data engineering or hybrid data/backend software role; strong Python and SQL; AWS data services; ETL/ELT pipelines; Looker/Tableau experience; BI and analytics knowledge.
Python, SQL, AWS Glue, S3, Redshift, Athena, CloudFormation, CloudWatch, IAM, Looker, Tableau, Java, Spring Boot, Spark, dbt, Airflow, GitHub Copilot, Claude, Cursor, Cody
1mo
Save
Mark Applied
Hide
Data Engineer III, Development
Carlsbad, California, United States
$181k-$186k/yr OnsiteFull Time
Thermo Fisher Scientific
Thermo Fisher ScientificNYSE: TMO: Sells equipment and chemicals for scientific research and healthcare.
4+ YOEMaster's in CS/IS (or Bachelor's +6 yrs); minimum 4 years as a Database Administrator or Data Engineer; experience with Databricks, Data lake/Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elasticsearch, Lambda, S3, RDS, MongoDB, DynamoDB, PySpark, Python, SQL, Git, Jenkins, Informatica, TCL/Unix shell, and Sybase.
Databricks, Data lake, Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elastic Search, Lambda, S3, Redshift, RDS, MongoDB, DynamoDB, PySpark, Python, Git, Jenkins, Informatica, TCL, Unix shell script, SQL, Sybase
6d
Save
Mark Applied
Hide
Principal Engineer Data
San Diego, California, United States
$114k-$171k/yr OnsiteFull Time
Northrop Grumman
Northrop GrummanNYSE: NOC: Develops and manufactures advanced aerospace, defense, and space systems.
5+ YOEBachelor's in STEM with 5+ years (or Master's with 3+ years), experience in data architecture, SQL Server, ETL, data visualization, data governance, and ability to obtain/maintain US Secret clearance.
SQL Server, Tableau, Power BI, Python, SQL, MongoDB, Neo4J, Hadoop, Spark, PowerShell, Palantir, Databricks, Denodo, Collibra, Airflow, DataHub
3w
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
Cotality
Cotality: Provider of property intelligence, data, and analytics solutions.
7+ YOE7+ years IT experience in data architecture; hands-on GCP, Dataflow, BigQuery, Python/PySpark, Airflow; experience with graph and SQL/NoSQL databases; strong communication and leadership skills.
Google Cloud Platform (GCP), Dataflow, BigQuery, Python, PySpark, Neo4j, Google Spanner, Apache Airflow, AWS, Hadoop, Spark, Elasticsearch, Apache Beam, BMAD, Spec Kit, SQL, NoSQL
5d
Save
Mark Applied
Hide
Staff Data Engineer - Dev360
Mountain View or San Diego
$189k-$274k/yr OnsiteFull Time
Intuit
IntuitNASDAQ: INTU: Provides financial software for accounting, tax, and personal finance.
8+ YOE8+ years in product or web analytics domains; advanced SQL and big-data tech, BI tools, Python/Java/Scala, experience architecting data platforms and pipelines, strong communication and business acumen.
SQL, Redshift, Spark, Hive, BigQuery, Tableau, Qlik, Dash, Python, Java, Scala
1mo
Save
Mark Applied
Hide
Senior Data Engineer (OpAI)
Fort Carson or Colorado Springs or Charleston or Denver or San Diego
$110k-$180k/yr OnsiteFull Time
The Marlin Alliance
The Marlin Alliance: Provides digital transformation and automation services to defense agencies.
10+ YOEU.S. citizen with active TS clearance, 10+ years relevant experience, strong Python/Go/Rust/SQL skills, experience with data pipelines, event streaming, cloud-native data services, GIS, and secure DoD environments.
CSV, JSON, XML, Parquet, ORC, Apache Kafka, AWS Kinesis, RabbitMQ, ZeroMQ, AWS Lambda, Dask, Spark, AWS S3, RDS, EFS, SNS, SQS, AirByte, Apache Airflow, dbt, Apache Iceberg, Snowflake, ArcGIS, PostGIS, Docker, Kubernetes, Elasticsearch, Redis, PostgreSQL, Python, Go, Rust, Pandas, R, SQL
2mo
Save
Mark Applied
Hide
Data Ops Engineer
San Diego, California, United States
OnsiteFull Time
Xenith Solutions
Xenith Solutions: Provides IT solutions and consulting for federal government agencies.
3+ YOEExperience in data engineering/DevOps, TS/SCI clearance, BS in a related field, 3+ years in data pipelines; tools include NiFi, Kafka, Grafana, Prometheus, Flink/Spark, Snowflake, Elasticsearch, MQTT, JMS; Windows and Linux.
NiFi, Kafka, Grafana, Prometheus, Flink/Spark Streaming, Snowflake, Elasticsearch, MQTT, JMS, Windows, Linux
3w
Save
Mark Applied
Hide
Data Platform Engineer, Infrastructure
Irvine, California, United States
OnsiteFull Time
Field AI
Field AI: Develops autonomous software brains for robots in unstructured environments.
3+ YOE3+ years infrastructure/platform experience, bachelor's or master's in CS/Engineering, cloud (AWS/GCP), Kubernetes, Terraform, Python/Go, production operations, security and cost management experience.
Kubernetes, Terraform, Python, Go, AWS, GCP, Spark, Databricks, GitOps, CI/CD
1mo
Save
Mark Applied
Hide
Data Analyst
San Diego, California, United States
$62k-$141k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
4+ YOE4+ years related experience with DoW, 2+ years data engineering in Databricks or Spark, 2+ years with Python/R/SQL, experience in research and BI, Secret clearance, and a bachelor's degree.
Databricks, Spark, Python, R, SQL, Tableau, Power BI, Matplotlib, Seaborn, Pandas, Polars, Scikit-learn, MLFlow, PyTorch, TensorFlow, Power Platform, Canvas Apps, Power Automate
1w
Save
Mark Applied
Hide
Senior Data Engineer
Indianapolis or Woodland Hills or Ashburn or Costa Mesa or Miami or Richmond or Chicago or New York City or Seattle or Grand Prairie or Chicago or Atlanta or Iselin or Overland Park or Tampa or Woburn
$127k-$229k/yr HybridFull Time
Elevance Health
Elevance HealthNYSE: ELV: Provides health insurance plans and integrated healthcare services.
8+ YOEBS/BA and 8+ years technical experience in systems administration/security, data platform architecture, Microsoft Fabric/Azure, data pipelines, SQL/Python, and regulatory compliance (HIPAA,NIST,SOC2).
Microsoft Fabric, Apache Spark, SQL, Python, PySpark, Spark, Delta Lake, Parquet, REST APIs, JSON, Git, Azure DevOps, CI/CD
1mo
Save
Mark Applied
Hide
Senior Manager, Data Engineering
San Francisco or Ottawa or Phoenix or Toronto or Los Angeles or Denver or Salt Lake City or Atlanta or Chicago or Houston or Portland or New York City or Vancouver or San Diego or Washington, D.C. or Sacramento or Jacksonville or Seattle or Mexico City or Austin or Miami or Boston or Dallas
$155k-$265k/yr HybridFull Time
Scribd
Scribd: Subscription-based digital library for e-books, audiobooks, and documents.
10+ YOE3+ Mgmt10+ years in data engineering, 3+ years managing engineering teams; advanced SQL and experience with Python/Scala, Spark, Databricks/Delta Lake/Snowflake/BigQuery; strong data architecture, dimensional modeling, and cross-functional leadership.
SQL, Python, Scala, Spark, Databricks, Delta Lake, Snowflake, BigQuery
2mo
Save
Mark Applied
Hide
Enterprise Data Engineering Manager, FVP
San Diego or Irvine or Los Angeles or Centennial or Las Vegas or Kansas City or Edison or Omaha
$145k-$180k/yr OnsiteFull Time
Axos Financial
Axos FinancialNYSE: AX: Provides digital-first banking and diverse financial services to customers.
10+ YOE7+ Mgmt10+ years in data engineering leadership; SQL Server; cloud data ecosystems (GCP/AWS/Azure); Databricks and Spark; PySpark; Python; SQL; ETL/ELT tools (Fivetran, dbt); leadership and collaboration skills.
Databricks, Spark, PySpark, Python, SQL, Fivetran, dbt, GCP, Azure, AWS, BigQuery, Snowflake, SQL Server
2mo
Save
Mark Applied
Hide
Advisor - Data Architect, Data Foundry
San Diego or San Francisco or Boston or Louisville or Indianapolis
$152k-$244k/yr OnsiteFull Time
Eli Lilly and Company
Eli Lilly and CompanyNYSE: LLY: Researches and manufactures medicines for human health.
2+ YOEM.S. or PhD in a STEM field with relevant data architecture/engineering or scientific informatics experience (MS+6 yrs or PhD+2 yrs). Expertise in data modeling, lakehouse and platform architecture, knowledge graphs, semantic web standards, cloud and streaming data patterns.
Databricks, Snowflake, Spark, dbt, Kafka, Kinesis, Flink, Neo4j, Amazon Neptune, TigerGraph, TileDB, MongoDB, Pinecone, Weaviate, pgvector, Delta Lake, Unity Catalog, RDF, OWL, SPARQL, Protégé, Benchling, C, C++, Rust, SQL, LIMS, ELN, HPC