HiringCafe
Join our community

57 spark data engineer jobs at 36 companies in Carlsbad, CA

1mo
Save
Mark Applied
Hide
Senior Data Engineer
Costa Mesa, California, United States
$166k-$220k/yr OnsiteFull Time
Anduril Industries
Anduril Industries: Defense technology building autonomous military hardware and software.
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
Palantir Foundry, SQLMesh, Athena, Apache Iceberg, Flyte, Python, Spark, PySpark, SQL, dbt, AWS, Azure, GCP, Tableau
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or Foster City or Orange County or Morristown
RemoteFull Time
Bridgepointe Technologies
Bridgepointe Technologies: Vendor-agnostic IT strategy and technology procurement services.
5+ YOERequires 5+ years in data engineering, advanced SQL, Python, Spark/PySpark, Microsoft Fabric, Azure data services, APIs, data modeling, CI/CD, Git, and Azure DevOps; bachelor's degree or equivalent experience.
Microsoft Fabric, Lakehouse, Warehouse, Data Pipelines, Notebooks, OneLake, Git, Azure DevOps, Spark, PySpark, SQL, Python, Azure, Delta Lake, Parquet, REST APIs, JSON, Power BI, DP-600, DP-700
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer III
San Diego, California, United States
$183k-$205k/yr OnsiteFull Time
SHEIN
SHEIN: Global online retailer of affordable fashion and lifestyle products.
4+ YOEBachelor's in Data Science/Computer Science + 4 years data engineering experience building large-scale ETL pipelines with Hive/Presto/Spark/Flink, data warehousing (Redshift), SQL, Amazon S3, AWS EMR, Airflow; on-call participation.
Hive, Presto, Spark, Flink, Amazon Redshift, SQL, Amazon S3, AWS EMR, Airflow
Job PostingView all
3w
Save
Mark Applied
Hide
Data Developer
San Diego, California, United States
HybridFull Time
Innovatus Technology Consulting
Innovatus Technology Consulting: Delivers IT infrastructure and cybersecurity services to federal defense agencies.
4+ YOEActive Secret clearance and U.S. citizenship required; Bachelor's degree or 4+ years' related experience; experience with data engineering, ETL/ELT, Apache Spark, SQL, AWS, Python, ML, and data visualization.
ETL/ELT, SQL, Apache Spark, PySpark, AWS, Delta Lake, Python, Scikit-Learn, TensorFlow, MLflow, Pandas, Flask, Django, Git, Tableau, Qlik, Jupyter Notebooks, Databricks, Azure Data Studio, Palantir Foundry
Job PostingView all
2d
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
K&L Gates
K&L Gates: Global law firm providing comprehensive legal and regulatory counsel.
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Diego, California, United States
$124k-$190k/yr HybridFull Time
CoStar Group
CoStar GroupNASDAQ: CSGP: Global provider of commercial and residential real estate data.
5+ YOEBachelor's degree required, 5+ years data engineering experience, strong ETL/pipeline and AWS experience, Databricks/Spark, C#/.NET, SQL, CI/CD/DevOps, and experience designing scalable data platforms.
Databricks, Apache Spark, C#, .NET, Claude Code, AWS, Kafka, Kinesis, SQL, CI/CD, DevOps
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Carlsbad, California, United States
HybridFull Time
NTENT
NTENT: Develops semantic search and natural language processing technology platforms.
3+ YOEThree+ years in data engineering or data warehousing; SQL Server with T-SQL; Hadoop ecosystem; Python; data modeling and visualization.
T-SQL, Microsoft SQL Server, Hadoop, Hive, Pig, Oozie, Python, Tableau, Kafka, Spark
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Data Engineer - MSS
Irvine, California, United States
$110k-$140k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOEHands-on experience with Databricks, dbt, Python, PySpark, Spark, and SQL; 6+ years experience; proven track record in data platform migration to Databricks Lakehouse; leadership and mentoring experience.
Databricks, dbt, Python, PySpark, Spark, SQL, Delta Lake, Unity Catalog, Databricks Workflows, Structured Streaming, Medallion Architecture, Airflow, EBT
Job PostingView all
3d
Save
Mark Applied
Hide
Security Data Solutions Engineer
Quincy or Princeton or Irvine or Boston or Austin or Sacramento
$120k-$203k/yr HybridFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
8+ YOEDesign and implement enterprise security telemetry and data products; 8+ years in cybersecurity/data engineering; strong Python, SQL, Spark, Databricks, Snowflake, SIEM experience; product management skills.
Splunk, Microsoft Sentinel, QRadar, Elastic, Chronicle, Databricks, Snowflake, Kafka, Spark, Cribl, OpenTelemetry, FluentBit, Python, SQL, AWS, Azure, Google Cloud
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
Cotality
Cotality: Provides property data, analytics, and workflow intelligence solutions.
7+ YOE7+ years IT experience, bachelor's in CS/Engineering or equivalent, expertise in cloud data platforms, Python/PySpark, data modeling, big data technologies, graph DBs, orchestration tools, and enterprise data architecture.
AWS, Google Cloud Platform (GCP), Python, PySpark, Neo4j, Google Spanner, Hadoop, Spark, Elasticsearch, Google Cloud Dataflow, Apache Beam, Apache Airflow, BMAD, Spec Kit, SQL, NoSQL
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Diego or Vienna
RemoteFull Time
9amHealth
9amHealth: Virtual clinic providing personalized cardiometabolic and diabetes care.
10+ YOE10+ years in data engineering or hybrid data/backend software role; strong Python and SQL; AWS data services; ETL/ELT pipelines; Looker/Tableau experience; BI and analytics knowledge.
Python, SQL, AWS Glue, S3, Redshift, Athena, CloudFormation, CloudWatch, IAM, Looker, Tableau, Java, Spring Boot, Spark, dbt, Airflow, GitHub Copilot, Claude, Cursor, Cody
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Data Engineer / Full‑Stack Data Developer (Databricks / Python)
San Diego, California, United States
$128k-$192k/yr OnsiteFull Time
Qualcomm
QualcommNASDAQ: QCOM: Designs and manufactures semiconductors and wireless telecommunications products.
5+ YOE5+ years data engineering experience; strong Databricks, Python, PySpark, Apache Spark, and SQL skills; production data pipeline and application ownership; Bachelor's in related field preferred (or 7+ years experience).
Databricks, Python, Apache Spark, PySpark, SQL, NoSQL, Databricks notebooks, Databricks dashboards, Structured Streaming, Kafka, AWS S3, AWS IAM, AWS EC2, AWS Glue, Unity Catalog, Git
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer III, Development
Carlsbad, California, United States
$181k-$186k/yr OnsiteFull Time
Thermo Fisher Scientific
Thermo Fisher ScientificNYSE: TMO: Sells equipment and chemicals for scientific research and healthcare.
4+ YOEMaster's in CS/IS (or Bachelor's +6 yrs); minimum 4 years as a Database Administrator or Data Engineer; experience with Databricks, Data lake/Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elasticsearch, Lambda, S3, RDS, MongoDB, DynamoDB, PySpark, Python, SQL, Git, Jenkins, Informatica, TCL/Unix shell, and Sybase.
Databricks, Data lake, Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elastic Search, Lambda, S3, Redshift, RDS, MongoDB, DynamoDB, PySpark, Python, Git, Jenkins, Informatica, TCL, Unix shell script, SQL, Sybase
Job PostingView all
1w
Save
Mark Applied
Hide
Principal Engineer Data
San Diego, California, United States
$114k-$171k/yr OnsiteFull Time
Northrop Grumman
Northrop GrummanNYSE: NOC: Develops and manufactures advanced aerospace, defense, and space systems.
5+ YOEBachelor's in STEM with 5+ years (or Master's with 3+ years), experience in data architecture, SQL Server, ETL, data visualization, data governance, and ability to obtain/maintain US Secret clearance.
SQL Server, Tableau, Power BI, Python, SQL, MongoDB, Neo4J, Hadoop, Spark, PowerShell, Palantir, Databricks, Denodo, Collibra, Airflow, DataHub
Job PostingView all
1w
Save
Mark Applied
Hide
Principal Engineer Data
San Diego, California, United States
$114k-$171k/yr OnsiteFull Time
Northrop Grumman
Northrop GrummanNYSE: NOC: Designs and manufactures advanced aerospace and defense systems.
3+ YOESTEM degree with 3–5+ years experience, data architecture and integration expertise, SQL Server and data visualization experience, ability to obtain/maintain U.S. Secret clearance.
SQL Server, Tableau, Power BI, Python, SQL, MongoDB, Neo4J, Hadoop, Spark, PowerShell, Palantir, Databricks, Denodo, Collibra, Airflow, DataHub
Job PostingView all
3w
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
Cotality
Cotality: Provider of property intelligence, data, and analytics solutions.
7+ YOE7+ years IT experience in data architecture; hands-on GCP, Dataflow, BigQuery, Python/PySpark, Airflow; experience with graph and SQL/NoSQL databases; strong communication and leadership skills.
Google Cloud Platform (GCP), Dataflow, BigQuery, Python, PySpark, Neo4j, Google Spanner, Apache Airflow, AWS, Hadoop, Spark, Elasticsearch, Apache Beam, BMAD, Spec Kit, SQL, NoSQL
Job PostingView all
1d
Save
Mark Applied
Hide
Senior Data Engineer (Python)
Irvine, California, United States
$97k-$138k/yr OnsiteFull Time
Hyundai AutoEver America
Hyundai AutoEver AmericaKorea Exchange: 307950: Provides automotive software and IT services for mobility systems.
7+ YOEBachelor's degree required; 7+ years in data warehouse or MDM applications, strong SQL, Python and PL/SQL, relational databases, ETL/ELT pipelines, and production data workload experience.
Python, Apache Airflow, SQL, PL/SQL, Azure Data Lake, AWS, GCP, Spark, PySpark, Git, CI/CD, DevOps
Job PostingView all
1w
Save
Mark Applied
Hide
Staff Data Engineer - Dev360
Mountain View or San Diego
$189k-$274k/yr OnsiteFull Time
Intuit
IntuitNASDAQ: INTU: Provides financial software for accounting, tax, and personal finance.
8+ YOE8+ years in product or web analytics domains; advanced SQL and big-data tech, BI tools, Python/Java/Scala, experience architecting data platforms and pipelines, strong communication and business acumen.
SQL, Redshift, Spark, Hive, BigQuery, Tableau, Qlik, Dash, Python, Java, Scala
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer (OpAI)
Fort Carson or Colorado Springs or Charleston or Denver or San Diego
$110k-$180k/yr OnsiteFull Time
The Marlin Alliance
The Marlin Alliance: Provides digital transformation and automation services to defense agencies.
10+ YOEU.S. citizen with active TS clearance, 10+ years relevant experience, strong Python/Go/Rust/SQL skills, experience with data pipelines, event streaming, cloud-native data services, GIS, and secure DoD environments.
CSV, JSON, XML, Parquet, ORC, Apache Kafka, AWS Kinesis, RabbitMQ, ZeroMQ, AWS Lambda, Dask, Spark, AWS S3, RDS, EFS, SNS, SQS, AirByte, Apache Airflow, dbt, Apache Iceberg, Snowflake, ArcGIS, PostGIS, Docker, Kubernetes, Elasticsearch, Redis, PostgreSQL, Python, Go, Rust, Pandas, R, SQL
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Ops Engineer
San Diego, California, United States
OnsiteFull Time
Xenith Solutions
Xenith Solutions: Provides IT solutions and consulting for federal government agencies.
3+ YOEExperience in data engineering/DevOps, TS/SCI clearance, BS in a related field, 3+ years in data pipelines; tools include NiFi, Kafka, Grafana, Prometheus, Flink/Spark, Snowflake, Elasticsearch, MQTT, JMS; Windows and Linux.
NiFi, Kafka, Grafana, Prometheus, Flink/Spark Streaming, Snowflake, Elasticsearch, MQTT, JMS, Windows, Linux
Job PostingView all

Explore Jobs

Expand Your Job Search