HiringCafe
Join our community

57 spark data engineer jobs at 37 companies in Vista, CA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
2w
Save
Mark Applied
Hide
Senior Data Engineer
Costa Mesa, California, United States
$166k-$220k/yr OnsiteFull Time
Anduril Industries
Anduril Industries: Defense technology building autonomous military hardware and software.
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
Palantir Foundry, SQLMesh, Athena, Apache Iceberg, Flyte, Python, Spark, PySpark, SQL, dbt, AWS, Azure, GCP, Tableau
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer III
San Diego, California, United States
$183k-$205k/yr OnsiteFull Time
SHEIN
SHEIN: Global online retailer of affordable fashion and lifestyle products.
4+ YOEBachelor's in Data Science/Computer Science + 4 years data engineering experience building large-scale ETL pipelines with Hive/Presto/Spark/Flink, data warehousing (Redshift), SQL, Amazon S3, AWS EMR, Airflow; on-call participation.
Hive, Presto, Spark, Flink, Amazon Redshift, SQL, Amazon S3, AWS EMR, Airflow
Job PostingView all
1w
Save
Mark Applied
Hide
Data Developer
San Diego, California, United States
HybridFull Time
Innovatus Technology Consulting
Innovatus Technology Consulting: Delivers IT infrastructure and cybersecurity services to federal defense agencies.
4+ YOEActive Secret clearance and U.S. citizenship required; Bachelor's degree or 4+ years' related experience; experience with data engineering, ETL/ELT, Apache Spark, SQL, AWS, Python, ML, and data visualization.
ETL/ELT, SQL, Apache Spark, PySpark, AWS, Delta Lake, Python, Scikit-Learn, TensorFlow, MLflow, Pandas, Flask, Django, Git, Tableau, Qlik, Jupyter Notebooks, Databricks, Azure Data Studio, Palantir Foundry
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Diego, California, United States
$124k-$190k/yr HybridFull Time
CoStar Group
CoStar GroupNASDAQ: CSGP: Global provider of commercial and residential real estate data.
5+ YOEBachelor's degree required, 5+ years data engineering experience, strong ETL/pipeline and AWS experience, Databricks/Spark, C#/.NET, SQL, CI/CD/DevOps, and experience designing scalable data platforms.
Databricks, Apache Spark, C#, .NET, Claude Code, AWS, Kafka, Kinesis, SQL, CI/CD, DevOps
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Carlsbad, California, United States
HybridFull Time
NTENT
NTENT: Develops semantic search and natural language processing technology platforms.
3+ YOEThree+ years in data engineering or data warehousing; SQL Server with T-SQL; Hadoop ecosystem; Python; data modeling and visualization.
T-SQL, Microsoft SQL Server, Hadoop, Hive, Pig, Oozie, Python, Tableau, Kafka, Spark
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer
San Diego, California, United States
$70k-$80k/yr OnsiteFull Time
Axos Financial
Axos FinancialNYSE: AX: Provides digital-first banking and diverse financial services to customers.
3+ YOE3+ years relational DB and Microsoft SQL Server experience, 2+ years SSIS, 1+ year C#, Databricks/Spark/PySpark experience, ETL/ELT, Git/GitHub, CI/CD and Azure DevOps knowledge, strong analysis and communication skills.
Microsoft SQL Server, SSIS, C#, Databricks, Spark, PySpark, Databricks SQL, Databricks notebooks, Git, GitHub, CI/CD, Azure DevOps, GitHub Actions
Job PostingView all
2w
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
Cotality
Cotality: Provides property data, analytics, and workflow intelligence solutions.
7+ YOE7+ years IT experience, bachelor's in CS/Engineering or equivalent, expertise in cloud data platforms, Python/PySpark, data modeling, big data technologies, graph DBs, orchestration tools, and enterprise data architecture.
AWS, Google Cloud Platform (GCP), Python, PySpark, Neo4j, Google Spanner, Hadoop, Spark, Elasticsearch, Google Cloud Dataflow, Apache Beam, Apache Airflow, BMAD, Spec Kit, SQL, NoSQL
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Diego or Vienna
RemoteFull Time
9amHealth
9amHealth: Virtual clinic providing personalized cardiometabolic and diabetes care.
10+ YOE10+ years in data engineering or hybrid data/backend software role; strong Python and SQL; AWS data services; ETL/ELT pipelines; Looker/Tableau experience; BI and analytics knowledge.
Python, SQL, AWS Glue, S3, Redshift, Athena, CloudFormation, CloudWatch, IAM, Looker, Tableau, Java, Spring Boot, Spark, dbt, Airflow, GitHub Copilot, Claude, Cursor, Cody
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Data Engineer / Full‑Stack Data Developer (Databricks / Python)
San Diego, California, United States
$128k-$192k/yr OnsiteFull Time
Qualcomm
QualcommNASDAQ: QCOM: Designs and manufactures semiconductors and wireless telecommunications products.
5+ YOE5+ years data engineering experience; strong Databricks, Python, PySpark, Apache Spark, and SQL skills; production data pipeline and application ownership; Bachelor's in related field preferred (or 7+ years experience).
Databricks, Python, Apache Spark, PySpark, SQL, NoSQL, Databricks notebooks, Databricks dashboards, Structured Streaming, Kafka, AWS S3, AWS IAM, AWS EC2, AWS Glue, Unity Catalog, Git
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
Irvine, California, United States
$120k-$150k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOESenior data engineer with strong Databricks/Spark, Airflow/Astronomer, data pipeline design, DevOps/CI/CD, and platform management experience.
Databricks, Apache Spark, Airflow, Astronomer, CI/CD
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer III, Development
Carlsbad, California, United States
$181k-$186k/yr OnsiteFull Time
Thermo Fisher Scientific
Thermo Fisher ScientificNYSE: TMO: Sells equipment and chemicals for scientific research and healthcare.
4+ YOEMaster's in CS/IS (or Bachelor's +6 yrs); minimum 4 years as a Database Administrator or Data Engineer; experience with Databricks, Data lake/Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elasticsearch, Lambda, S3, RDS, MongoDB, DynamoDB, PySpark, Python, SQL, Git, Jenkins, Informatica, TCL/Unix shell, and Sybase.
Databricks, Data lake, Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elastic Search, Lambda, S3, Redshift, RDS, MongoDB, DynamoDB, PySpark, Python, Git, Jenkins, Informatica, TCL, Unix shell script, SQL, Sybase
Job PostingView all
1w
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
Cotality
Cotality: Provider of property intelligence, data, and analytics solutions.
7+ YOE7+ years IT experience in data architecture; hands-on GCP, Dataflow, BigQuery, Python/PySpark, Airflow; experience with graph and SQL/NoSQL databases; strong communication and leadership skills.
Google Cloud Platform (GCP), Dataflow, BigQuery, Python, PySpark, Neo4j, Google Spanner, Apache Airflow, AWS, Hadoop, Spark, Elasticsearch, Apache Beam, BMAD, Spec Kit, SQL, NoSQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer (OpAI)
Fort Carson or Colorado Springs or Charleston or Denver or San Diego
$110k-$180k/yr OnsiteFull Time
The Marlin Alliance
The Marlin Alliance: Provides digital transformation and automation services to defense agencies.
10+ YOEU.S. citizen with active TS clearance, 10+ years relevant experience, strong Python/Go/Rust/SQL skills, experience with data pipelines, event streaming, cloud-native data services, GIS, and secure DoD environments.
CSV, JSON, XML, Parquet, ORC, Apache Kafka, AWS Kinesis, RabbitMQ, ZeroMQ, AWS Lambda, Dask, Spark, AWS S3, RDS, EFS, SNS, SQS, AirByte, Apache Airflow, dbt, Apache Iceberg, Snowflake, ArcGIS, PostGIS, Docker, Kubernetes, Elasticsearch, Redis, PostgreSQL, Python, Go, Rust, Pandas, R, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer III
San Diego, California, United States
HybridFull Time
ICW Group
ICW Group: Provides workers' compensation and specialty property and casualty insurance.
6+ YOEBachelor's in CS/Math/Engineering; min 6 years in data integration/engineering; AWS and data governance experience; SQL/NoSQL, data warehousing; insurance exp a plus.
AWS, Redshift, S3, EC2, Glue, EMR, Kinesis, Lambda, DynamoDB, Snowflake, Databricks, Hadoop, Spark, Kafka, Python, Scala, Talend, SSIS, Profisee, Alteryx, Informatica
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Ops Engineer
San Diego, California, United States
OnsiteFull Time
Xenith Solutions
Xenith Solutions: Provides IT solutions and consulting for federal government agencies.
3+ YOEExperience in data engineering/DevOps, TS/SCI clearance, BS in a related field, 3+ years in data pipelines; tools include NiFi, Kafka, Grafana, Prometheus, Flink/Spark, Snowflake, Elasticsearch, MQTT, JMS; Windows and Linux.
NiFi, Kafka, Grafana, Prometheus, Flink/Spark Streaming, Snowflake, Elasticsearch, MQTT, JMS, Windows, Linux
Job PostingView all
1w
Save
Mark Applied
Hide
Data Platform Engineer, Infrastructure
Irvine, California, United States
OnsiteFull Time
Field AI
Field AI: Develops autonomous software brains for robots in unstructured environments.
3+ YOE3+ years infrastructure/platform experience, bachelor's or master's in CS/Engineering, cloud (AWS/GCP), Kubernetes, Terraform, Python/Go, production operations, security and cost management experience.
Kubernetes, Terraform, Python, Go, AWS, GCP, Spark, Databricks, GitOps, CI/CD
Job PostingView all
3w
Save
Mark Applied
Hide
Data Analyst
San Diego, California, United States
$62k-$141k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
4+ YOE4+ years related experience with DoW, 2+ years data engineering in Databricks or Spark, 2+ years with Python/R/SQL, experience in research and BI, Secret clearance, and a bachelor's degree.
Databricks, Spark, Python, R, SQL, Tableau, Power BI, Matplotlib, Seaborn, Pandas, Polars, Scikit-learn, MLFlow, PyTorch, TensorFlow, Power Platform, Canvas Apps, Power Automate
Job PostingView all
2d
Save
Mark Applied
Hide
Senior Data Engineer
Indianapolis or Woodland Hills or Ashburn or Costa Mesa or Miami or Richmond or Chicago or New York City or Seattle or Grand Prairie or Chicago or Atlanta or Iselin or Overland Park or Tampa or Woburn
$127k-$229k/yr HybridFull Time
Elevance Health
Elevance HealthNYSE: ELV: Provides health insurance plans and integrated healthcare services.
8+ YOEBS/BA and 8+ years technical experience in systems administration/security, data platform architecture, Microsoft Fabric/Azure, data pipelines, SQL/Python, and regulatory compliance (HIPAA,NIST,SOC2).
Microsoft Fabric, Apache Spark, SQL, Python, PySpark, Spark, Delta Lake, Parquet, REST APIs, JSON, Git, Azure DevOps, CI/CD
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Manager, Data Engineering
San Francisco or Ottawa or Phoenix or Toronto or Los Angeles or Denver or Salt Lake City or Atlanta or Chicago or Houston or Portland or New York City or Vancouver or San Diego or Washington, D.C. or Sacramento or Jacksonville or Seattle or Mexico City or Austin or Miami or Boston or Dallas
$155k-$265k/yr HybridFull Time
Scribd
Scribd: Subscription-based digital library for e-books, audiobooks, and documents.
10+ YOE3+ Mgmt10+ years in data engineering, 3+ years managing engineering teams; advanced SQL and experience with Python/Scala, Spark, Databricks/Delta Lake/Snowflake/BigQuery; strong data architecture, dimensional modeling, and cross-functional leadership.
SQL, Python, Scala, Spark, Databricks, Delta Lake, Snowflake, BigQuery
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Engineer
Carlsbad or Germantown or Englewood or Tempe
$141k-$222k/yr OnsiteFull Time
Viasat
ViasatNASDAQ: VSAT: Provider of global satellite-based connectivity and secure communication solutions.
5+ YOE5+ years software development with Java/Scala/Python/C/C++, SQL DBMS, Linux, Docker, Git/CI/CD; cloud familiarity (AWS/GCP/Azure); strong analytical skills; BS in a related field; US citizenship required; travel up to 10%
Java, Scala, Python, C, C++, PostgreSQL, MySQL, Oracle, Linux, Docker, Git, CI/CD, AWS, GCP, Azure, Kafka, Spark
Job PostingView all

Explore Jobs

Expand Your Job Search