33 spark data engineer jobs at 23 companies in Poway, CA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
1mo
Save
Mark Applied
Hide
Senior Data Engineer III
San Diego, California, United States
$183k-$205k/yr OnsiteFull Time
SHEIN
SHEIN: Global online retailer of affordable fashion and lifestyle products.
4+ YOEBachelor's in Data Science/Computer Science + 4 years data engineering experience building large-scale ETL pipelines with Hive/Presto/Spark/Flink, data warehousing (Redshift), SQL, Amazon S3, AWS EMR, Airflow; on-call participation.
Hive, Presto, Spark, Flink, Amazon Redshift, SQL, Amazon S3, AWS EMR, Airflow
3d
Save
Mark Applied
Hide
Data Developer
San Diego, California, United States
HybridFull Time
Innovatus Technology Consulting
Innovatus Technology Consulting: Delivers IT infrastructure and cybersecurity services to federal defense agencies.
4+ YOEActive Secret clearance and U.S. citizenship required; Bachelor's degree or 4+ years' related experience; experience with data engineering, ETL/ELT, Apache Spark, SQL, AWS, Python, ML, and data visualization.
ETL/ELT, SQL, Apache Spark, PySpark, AWS, Delta Lake, Python, Scikit-Learn, TensorFlow, MLflow, Pandas, Flask, Django, Git, Tableau, Qlik, Jupyter Notebooks, Databricks, Azure Data Studio, Palantir Foundry
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Diego, California, United States
$124k-$190k/yr HybridFull Time
CoStar Group
CoStar GroupNASDAQ: CSGP: Global provider of commercial and residential real estate data.
5+ YOEBachelor's degree required, 5+ years data engineering experience, strong ETL/pipeline and AWS experience, Databricks/Spark, C#/.NET, SQL, CI/CD/DevOps, and experience designing scalable data platforms.
Databricks, Apache Spark, C#, .NET, Claude Code, AWS, Kafka, Kinesis, SQL, CI/CD, DevOps
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Carlsbad, California, United States
HybridFull Time
NTENT
NTENT: Develops semantic search and natural language processing technology platforms.
3+ YOEThree+ years in data engineering or data warehousing; SQL Server with T-SQL; Hadoop ecosystem; Python; data modeling and visualization.
T-SQL, Microsoft SQL Server, Hadoop, Hive, Pig, Oozie, Python, Tableau, Kafka, Spark
1w
Save
Mark Applied
Hide
Data Engineer
San Diego, California, United States
$70k-$80k/yr OnsiteFull Time
Axos Financial
Axos FinancialNYSE: AX: Provides digital-first banking and diverse financial services to customers.
3+ YOE3+ years relational DB and Microsoft SQL Server experience, 2+ years SSIS, 1+ year C#, Databricks/Spark/PySpark experience, ETL/ELT, Git/GitHub, CI/CD and Azure DevOps knowledge, strong analysis and communication skills.
Microsoft SQL Server, SSIS, C#, Databricks, Spark, PySpark, Databricks SQL, Databricks notebooks, Git, GitHub, CI/CD, Azure DevOps, GitHub Actions
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Diego or Vienna
RemoteFull Time
9amHealth
9amHealth: Virtual clinic providing personalized cardiometabolic and diabetes care.
10+ YOE10+ years in data engineering or hybrid data/backend software role; strong Python and SQL; AWS data services; ETL/ELT pipelines; Looker/Tableau experience; BI and analytics knowledge.
Python, SQL, AWS Glue, S3, Redshift, Athena, CloudFormation, CloudWatch, IAM, Looker, Tableau, Java, Spring Boot, Spark, dbt, Airflow, GitHub Copilot, Claude, Cursor, Cody
2mo
Save
Mark Applied
Hide
Staff Data Engineer / Full‑Stack Data Developer (Databricks / Python)
San Diego, California, United States
$128k-$192k/yr OnsiteFull Time
Qualcomm
QualcommNASDAQ: QCOM: Designs and manufactures semiconductors and wireless telecommunications products.
5+ YOE5+ years data engineering experience; strong Databricks, Python, PySpark, Apache Spark, and SQL skills; production data pipeline and application ownership; Bachelor's in related field preferred (or 7+ years experience).
Databricks, Python, Apache Spark, PySpark, SQL, NoSQL, Databricks notebooks, Databricks dashboards, Structured Streaming, Kafka, AWS S3, AWS IAM, AWS EC2, AWS Glue, Unity Catalog, Git
2w
Save
Mark Applied
Hide
Data Engineer III, Development
Carlsbad, California, United States
$181k-$186k/yr OnsiteFull Time
Thermo Fisher Scientific
Thermo Fisher ScientificNYSE: TMO: Sells equipment and chemicals for scientific research and healthcare.
4+ YOEMaster's in CS/IS (or Bachelor's +6 yrs); minimum 4 years as a Database Administrator or Data Engineer; experience with Databricks, Data lake/Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elasticsearch, Lambda, S3, RDS, MongoDB, DynamoDB, PySpark, Python, SQL, Git, Jenkins, Informatica, TCL/Unix shell, and Sybase.
Databricks, Data lake, Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elastic Search, Lambda, S3, Redshift, RDS, MongoDB, DynamoDB, PySpark, Python, Git, Jenkins, Informatica, TCL, Unix shell script, SQL, Sybase
1mo
Save
Mark Applied
Hide
Senior Data Engineer (OpAI)
Fort Carson or Colorado Springs or Charleston or Denver or San Diego
$110k-$180k/yr OnsiteFull Time
The Marlin Alliance
The Marlin Alliance: Provides digital transformation and automation services to defense agencies.
10+ YOEU.S. citizen with active TS clearance, 10+ years relevant experience, strong Python/Go/Rust/SQL skills, experience with data pipelines, event streaming, cloud-native data services, GIS, and secure DoD environments.
CSV, JSON, XML, Parquet, ORC, Apache Kafka, AWS Kinesis, RabbitMQ, ZeroMQ, AWS Lambda, Dask, Spark, AWS S3, RDS, EFS, SNS, SQS, AirByte, Apache Airflow, dbt, Apache Iceberg, Snowflake, ArcGIS, PostGIS, Docker, Kubernetes, Elasticsearch, Redis, PostgreSQL, Python, Go, Rust, Pandas, R, SQL
2mo
Save
Mark Applied
Hide
Senior AI Data Engineer
San Francisco or Atlanta or Austin or Boston or Chicago or Dallas or Denver or Houston or Jacksonville or Los Angeles or Miami or New York City or Phoenix or Portland or Sacramento or Salt Lake City or San Diego or Seattle or Washington, D.C. or Ottawa or Toronto or Vancouver or Mexico City
$128k-$235k/yr HybridFull Time
Scribd
Scribd: Subscription-based digital library for e-books, audiobooks, and documents.
5+ YOE5+ years data engineering; AI/ML infra or LLM apps; Python and SQL; Databricks; NLP/LLM systems; governance and security focus; autonomous in ambiguous problems; strong communication.
Python, SQL, Databricks, Apache Airflow, Spark, Terraform, AWS
1mo
Save
Mark Applied
Hide
Data Engineer III
San Diego, California, United States
HybridFull Time
ICW Group
ICW Group: Provides workers' compensation and specialty property and casualty insurance.
6+ YOEBachelor's in CS/Math/Engineering; min 6 years in data integration/engineering; AWS and data governance experience; SQL/NoSQL, data warehousing; insurance exp a plus.
AWS, Redshift, S3, EC2, Glue, EMR, Kinesis, Lambda, DynamoDB, Snowflake, Databricks, Hadoop, Spark, Kafka, Python, Scala, Talend, SSIS, Profisee, Alteryx, Informatica
2mo
Save
Mark Applied
Hide
Data Ops Engineer
San Diego, California, United States
OnsiteFull Time
Xenith Solutions
Xenith Solutions: Provides IT solutions and consulting for federal government agencies.
3+ YOEExperience in data engineering/DevOps, TS/SCI clearance, BS in a related field, 3+ years in data pipelines; tools include NiFi, Kafka, Grafana, Prometheus, Flink/Spark, Snowflake, Elasticsearch, MQTT, JMS; Windows and Linux.
NiFi, Kafka, Grafana, Prometheus, Flink/Spark Streaming, Snowflake, Elasticsearch, MQTT, JMS, Windows, Linux
2w
Save
Mark Applied
Hide
Data Analyst
San Diego, California, United States
$62k-$141k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
4+ YOE4+ years related experience with DoW, 2+ years data engineering in Databricks or Spark, 2+ years with Python/R/SQL, experience in research and BI, Secret clearance, and a bachelor's degree.
Databricks, Spark, Python, R, SQL, Tableau, Power BI, Matplotlib, Seaborn, Pandas, Polars, Scikit-learn, MLFlow, PyTorch, TensorFlow, Power Platform, Canvas Apps, Power Automate
2mo
Save
Mark Applied
Hide
Data Architect, Data Foundry
San Diego or San Francisco or South San Francisco or Boston or Louisville or Indianapolis
$132k-$194k/yr OnsiteFull Time
Eli Lilly and Company
Eli Lilly and CompanyNYSE: LLY: Researches and manufactures medicines for human health.
5+ YOEB.S. or M.S. in a relevant STEM field with 5–7+ years of data architecture/engineering or scientific informatics experience; strong SQL and multi-paradigm database experience; authorized to work in the U.S.; familiarity with cloud and scientific data preferred.
SQL, RDF, OWL, SPARQL, Databricks, Delta Lake, Unity Catalog, Snowflake, Spark, dbt, Kafka, Kinesis, Flink, Neo4j, Amazon Neptune, TigerGraph, TileDB, Zarr, MongoDB, Pinecone, Weaviate, pgvector, Protégé, Benchling, LIMS, ELN, AWS, Azure, GCP, FASTA, BAM/CRAM, VCF, InChI, SMILES, Gene Ontology, UniProt, Reactome, KEGG
3d
Save
Mark Applied
Hide
Data Scientist, Principal
Oakland or Washington or Ohio or District of Columbia or California or Long Beach or Arizona or Colorado or Connecticut or Florida or Georgia or Maryland or Minnesota or Nevada or Oregon or El Dorado Hills or San Diego or Woodland Hills or Alabama or Illinois or Virginia or Wisconsin or Texas or New York
$182k-$273k/yr HybridFull Time
Ascendiun
Ascendiun: Nonprofit parent overseeing health insurance and clinical service organizations.
8+ YOEAdvanced experience in applied AI/ML and software development, strong Python engineering, hands-on with deep learning and LLM frameworks, experience building production AI applications and leading ML design.
Python, PyTorch, TensorFlow, LangChain, LangGraph, SQL, Spark, Azure, Google Cloud, AWS
2w
Save
Mark Applied
Hide
Senior Software Analytics Developer
San Diego, California, United States
OnsiteFull Time
Acenda
Acenda: Cloud-based e-commerce platform for marketplace integration and management.
5+ YOE5+ years building and integrating Big Data analytics and BI solutions; strong Java and JavaScript experience; familiarity with Hadoop/Spark, NoSQL stores, REST services, cloud SaaS, and frontend Web 2.0 development.
Hadoop/MapReduce, Spark, Tableau, ETL, Pig, Hive, MongoDB, Cassandra, Elasticsearch, Java, shell scripting, REST, Apache, JavaScript, AJAX, JSON, JQuery, JSP/Servlets, Struts, HTML
3w
Save
Mark Applied
Hide
Software Engineer- Data Engineering
Reston or San Diego or Washington or California or Maryland or Virginia or District of Columbia
$103k-$170k/yr RemoteFull Time
Noctua Technology
Noctua Technology: Provides software engineering, cloud, and data consulting services.
Proficiency with SQL, cloud platforms, Python/Java/C++, ETL and data pipeline tools (Airflow, Beam, Kafka), data visualization and analysis tools, and eligibility for US Secret security clearance.
SQL, MySQL, PostgreSQL, Beam, Airflow, Kafka, Jupyter, Colab, Pandas, Tableau, Looker, Microsoft Power BI, Qlik, SuperSet, AWS, Azure, GCP, Python, Java, C++, Git, Spark, Hadoop, Docker, Kubernetes
3mo
Save
Mark Applied
Hide
Software Engineer II, Data Platform
San Diego, California, United States
$150k-$225k/yr HybridFull Time
Sony Interactive Entertainment
Sony Interactive EntertainmentNYSE: SONY: Provides PlayStation gaming hardware, software, and digital network services.
3+ YOE3+ years building scalable distributed data platforms; proficient in Scala/Java/Python; cloud apps (AWS preferred); Kafka/Kinesis/SQS; Spark/Flink; CI/CD; global distributed team; on-call rotations.
Scala, Java, Python, AWS, Kafka, Kinesis, SQS, Apache Spark, Apache Flink, CI/CD, Databricks, GCP
3w
Save
Mark Applied
Hide
Senior Software Engineer, Data Engineering
San Diego, California, United States
$143k-$215k/yr OnsiteFull Time
ResMed
ResMedNew York Stock Exchange: RMD: Developing cloud-connected medical devices for sleep and respiratory care.
8+ YOEBachelor's/Master's or equivalent and 8+ years software/platform engineering experience. Strong React, TypeScript/JavaScript, Python, AWS, Kubernetes, Terraform, database and CI/CD/observability experience.
React, TypeScript, JavaScript, Python, AWS, Snowflake, DynamoDB, PostgreSQL, MySQL, SQL Server, MongoDB, Kubernetes, Docker, Terraform, GitHub Actions, Datadog, Grafana, Prometheus, OpenTelemetry, CloudWatch, Kafka, Flink, Kinesis, Airflow, Dagster, Spark, Databricks, Delta Lake
2w
Save
Mark Applied
Hide
Staff, Cloud Infrastructure Engineer
San Diego or California
$133k-$199k/yr OnsiteFull Time
Teradata
TeradataNew York Stock Exchange: TDC: Provides cloud data analytics and enterprise AI software platforms.
Experience at the systems or infrastructure layer with OS/runtime behavior, Kubernetes and containerization, infrastructure provisioning, performance analysis (eBPF/kernel tuning), and exposure to analytical query engines and data platforms.
Terraform, Pulumi, Kubernetes, Presto, Trino, Spark, DataFusion, eBPF