HiringCafe
Join our community

33 spark engineer jobs at 25 companies in San Diego, CA

1w
Save
Mark Applied
Hide
Staff Data Engineer
San Diego, California, United States
$142k-$212k/yr OnsiteFull Time
Illumina
IlluminaNASDAQ: ILMN: Provides genomic sequencing and array-based solutions for genetic analysis.
10+ YOE10+ years of data engineering experience with Python, advanced SQL, data modeling, distributed systems, Databricks or Snowflake, Spark, dbt, cloud platforms, governance, and technical leadership.
Python, SQL, Databricks, Snowflake, Spark, Delta Lake, Apache Iceberg, dbt, Parquet, Unity Catalog, Git, REST APIs, JSON, CI/CD, AWS, SAP, Microsoft Power BI, Tableau
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff, Cloud Infrastructure Engineer
San Diego or California
$133k-$199k/yr OnsiteFull Time
Teradata
TeradataNew York Stock Exchange: TDC: Provides cloud data analytics and enterprise AI software platforms.
Experience at the systems or infrastructure layer with OS/runtime behavior, Kubernetes and containerization, infrastructure provisioning, performance analysis (eBPF/kernel tuning), and exposure to analytical query engines and data platforms.
Terraform, Pulumi, Kubernetes, Presto, Trino, Spark, DataFusion, eBPF
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer III
San Diego, California, United States
$183k-$205k/yr OnsiteFull Time
SHEIN
SHEIN: Global online retailer of affordable fashion and lifestyle products.
4+ YOEBachelor's in Data Science/Computer Science + 4 years data engineering experience building large-scale ETL pipelines with Hive/Presto/Spark/Flink, data warehousing (Redshift), SQL, Amazon S3, AWS EMR, Airflow; on-call participation.
Hive, Presto, Spark, Flink, Amazon Redshift, SQL, Amazon S3, AWS EMR, Airflow
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Colorado Springs or Fort Carson or Charleston or Denver or San Diego
$110k-$180k/yr OnsiteFull Time
The Marlin Alliance
The Marlin Alliance: Provides digital transformation and automation services to defense agencies.
U.S. citizen with active Top Secret clearance; strong Python and ML experience; experience with distributed systems, cloud-native development, containerization, GIS, and DevOps; able to work aboard Navy vessels.
Apache Kafka, AWS Kinesis, RabbitMQ, ZeroMQ, AWS Lambda, Dask, Spark, AWS S3, RDS, EFS, SNS, SQS, AirByte, Apache Airflow, dbt, Apache Iceberg, Snowflake, ArcGIS, PostGIS, Docker, Kubernetes, Python, Git, Java, C++, Go, Rust, GitHub Actions, GitLab CI, Jenkins, TensorFlow, PyTorch, scikit-learn, AWS, Azure
Job PostingView all
1mo
Save
Mark Applied
Hide
Machine Learning Engineer, Senior Manager
Southfield or San Francisco or Seattle or Boston or New York City or Los Angeles or San Diego or United States
$184k-$270k/yr RemoteFull Time
Credit Acceptance
Credit AcceptanceNASDAQ: CACC: Provides vehicle financing programs for subprime credit consumers.
8+ YOEPhD (8+ yrs) or MS (10+ yrs) in a relevant technical field; 8+ years designing, building, and deploying ML/DL/Gen-AI models; hands-on experience with production ML/LLM ops, scalable systems, and leading technical teams.
Kubeflow, DVC, Ray, gRPC, GraphQL, Databricks MLflow, Databricks Model Serving, MLflow, Apache Airflow, Spark, Flink, Kafka, Kinesis, Snowflake, Databricks, XGBoost, Transformers
Job PostingView all
5d
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Seattle or Toronto or Santa Barbara or San Diego
$127k-$190k/yr RemoteFull Time
Invoca
Invoca: AI platform for conversation intelligence and revenue execution.
5+ YOE5+ years in data or software engineering; advanced Python, SQL, Databricks, Spark, and data modeling; experience with orchestration, streaming, cloud infrastructure, data quality, ML datasets, and privacy; bachelor's degree or equivalent.
Python, PySpark, Pandas, Polars, PyArrow, SQL, MySQL, PostgreSQL, Databricks, Delta Lake, Unity Catalog, Workflows, Jobs/Compute, Snowflake, BigQuery, Apache Spark, Airflow, Dagster, Kafka, Kinesis, Spark Structured Streaming, AWS, S3, IAM, FastAPI, Databricks Model Serving, SageMaker endpoints
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Diego, California, United States
$124k-$190k/yr HybridFull Time
CoStar Group
CoStar GroupNASDAQ: CSGP: Global provider of commercial and residential real estate data.
5+ YOEBachelor's degree required, 5+ years data engineering experience, strong ETL/pipeline and AWS experience, Databricks/Spark, C#/.NET, SQL, CI/CD/DevOps, and experience designing scalable data platforms.
Databricks, Apache Spark, C#, .NET, Claude Code, AWS, Kafka, Kinesis, SQL, CI/CD, DevOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Software Analytics Developer
San Diego, California, United States
OnsiteFull Time
Acenda
Acenda: Cloud-based e-commerce platform for marketplace integration and management.
5+ YOE5+ years building and integrating Big Data analytics and BI solutions; strong Java and JavaScript experience; familiarity with Hadoop/Spark, NoSQL stores, REST services, cloud SaaS, and frontend Web 2.0 development.
Hadoop/MapReduce, Spark, Tableau, ETL, Pig, Hive, MongoDB, Cassandra, Elasticsearch, Java, shell scripting, REST, Apache, JavaScript, AJAX, JSON, JQuery, JSP/Servlets, Struts, HTML
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Ops Engineer
San Diego, California, United States
OnsiteFull Time
Xenith Solutions
Xenith Solutions: Provides IT solutions and consulting for federal government agencies.
3+ YOEExperience in data engineering/DevOps, TS/SCI clearance, BS in a related field, 3+ years in data pipelines; tools include NiFi, Kafka, Grafana, Prometheus, Flink/Spark, Snowflake, Elasticsearch, MQTT, JMS; Windows and Linux.
NiFi, Kafka, Grafana, Prometheus, Flink/Spark Streaming, Snowflake, Elasticsearch, MQTT, JMS, Windows, Linux
Job PostingView all
2mo
Save
Mark Applied
Hide
AI Engineer
San Diego, California, United States
$150k-$225k/yr HybridFull Time
Sony Interactive Entertainment
Sony Interactive EntertainmentNYSE: SONY: Provides PlayStation gaming hardware, software, and digital network services.
Bachelor's in CS/engineering, hands-on applied AI experience, strong Python/Java skills, cloud (AWS) experience, foundation model API and RAG/vector search familiarity, and experience building reliable production services.
Python, Java, AWS, EKS, ECS, Lambda, S3, DynamoDB, Kinesis, EventBridge, SNS, SQS, IAM, OpenAI, Azure OpenAI, Anthropic Claude, Google Gemini, Vertex AI, AWS Bedrock, Mistral, Meta Llama, OpenSearch, Pinecone, Weaviate, Redis, pgvector, Azure AI Search, LangChain, LangGraph, LlamaIndex, Semantic Kernel, OpenAI Agents SDK, AWS Bedrock Agents and Knowledge Bases, LangSmith, Arize Phoenix, OpenTelemetry, Datadog, Splunk, New Relic, CloudWatch, Kafka, Flink, Spark, dbt, Airflow, Model Context Protocol (MCP)
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Carlsbad, California, United States
HybridFull Time
NTENT
NTENT: Develops semantic search and natural language processing technology platforms.
3+ YOEThree+ years in data engineering or data warehousing; SQL Server with T-SQL; Hadoop ecosystem; Python; data modeling and visualization.
T-SQL, Microsoft SQL Server, Hadoop, Hive, Pig, Oozie, Python, Tableau, Kafka, Spark
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer III, Development
Carlsbad, California, United States
$181k-$186k/yr OnsiteFull Time
Thermo Fisher Scientific
Thermo Fisher ScientificNYSE: TMO: Sells equipment and chemicals for scientific research and healthcare.
4+ YOEMaster's in CS/IS (or Bachelor's +6 yrs); minimum 4 years as a Database Administrator or Data Engineer; experience with Databricks, Data lake/Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elasticsearch, Lambda, S3, RDS, MongoDB, DynamoDB, PySpark, Python, SQL, Git, Jenkins, Informatica, TCL/Unix shell, and Sybase.
Databricks, Data lake, Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elastic Search, Lambda, S3, Redshift, RDS, MongoDB, DynamoDB, PySpark, Python, Git, Jenkins, Informatica, TCL, Unix shell script, SQL, Sybase
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
San Diego or Vienna
RemoteFull Time
9amHealth
9amHealth: Virtual clinic providing personalized cardiometabolic and diabetes care.
10+ YOE10+ years in data engineering or hybrid data/backend software role; strong Python and SQL; AWS data services; ETL/ELT pipelines; Looker/Tableau experience; BI and analytics knowledge.
Python, SQL, AWS Glue, S3, Redshift, Athena, CloudFormation, CloudWatch, IAM, Looker, Tableau, Java, Spring Boot, Spark, dbt, Airflow, GitHub Copilot, Claude, Cursor, Cody
Job PostingView all
3w
Save
Mark Applied
Hide
Founding Product Engineer
San Diego, California, United States
$140k-$190k/yr HybridFull Time
Netradyne
Netradyne: Develops AI-powered vision technology for commercial fleet safety.
7+ YOE7+ years software engineering, full-stack (Go, Python, Java, TypeScript/JavaScript), systems thinking, customer-facing experience, multi-tenant and RBAC design, familiarity with AI-assisted development tools.
Go, Python, Java, TypeScript, JavaScript, AWS, CI/CD, Temporal, WorkOS, Auth0, Clerk, Spark, PySpark, Claude Code, Codex, Cursor
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Manager, Data Engineering
San Francisco or Ottawa or Phoenix or Toronto or Los Angeles or Denver or Salt Lake City or Atlanta or Chicago or Houston or Portland or New York City or Vancouver or San Diego or Washington, D.C. or Sacramento or Jacksonville or Seattle or Mexico City or Austin or Miami or Boston or Dallas
$155k-$265k/yr HybridFull Time
Scribd
Scribd: Subscription-based digital library for e-books, audiobooks, and documents.
10+ YOE3+ Mgmt10+ years in data engineering, 3+ years managing engineering teams; advanced SQL and experience with Python/Scala, Spark, Databricks/Delta Lake/Snowflake/BigQuery; strong data architecture, dimensional modeling, and cross-functional leadership.
SQL, Python, Scala, Spark, Databricks, Delta Lake, Snowflake, BigQuery
Job PostingView all
2mo
Save
Mark Applied
Hide
Software Engineer
Arlington or Mount Laurel or Fall River or San Diego
$74k-$184k/yr HybridFull Time
Innovative Defense Technologies
Innovative Defense Technologies: A defense technology delivering mission-critical software and systems solutions to the U.S. government.
0+ YOEAbility to obtain/maintain Secret clearance, BS in CS or equivalent experience, 0-5 years professional experience, proficiency in C/C++/Python/Java/JavaScript, Linux, Git, Agile, and ability to travel up to 10%.
C, C++, Python, JavaScript, Java, Linux, shell scripting, Git, Make, Maven, Ant, X-Windows, Jenkins, Jira, Atlassian, VMware vSphere, Azure, AWS, GCP, Hadoop, Spark, Kafka, Cassandra, React, Angular, Vue, Storybook, Postgres, SQL, REST, gRPC, CORBA, DDS, TCP/IP, UDP, GitHub Copilot, ChatGPT, Claude, Cursor, Codeium
Job PostingView all
2w
Save
Mark Applied
Hide
Principal Engineer Data
San Diego, California, United States
$114k-$171k/yr OnsiteFull Time
Northrop Grumman
Northrop GrummanNYSE: NOC: Develops and manufactures advanced aerospace, defense, and space systems.
5+ YOEBachelor's in STEM with 5+ years (or Master's with 3+ years), experience in data architecture, SQL Server, ETL, data visualization, data governance, and ability to obtain/maintain US Secret clearance.
SQL Server, Tableau, Power BI, Python, SQL, MongoDB, Neo4J, Hadoop, Spark, PowerShell, Palantir, Databricks, Denodo, Collibra, Airflow, DataHub
Job PostingView all
2w
Save
Mark Applied
Hide
Staff Data Engineer - Dev360
Mountain View or San Diego
$189k-$274k/yr OnsiteFull Time
Intuit
IntuitNASDAQ: INTU: Provides financial software for accounting, tax, and personal finance.
8+ YOE8+ years in product or web analytics domains; advanced SQL and big-data tech, BI tools, Python/Java/Scala, experience architecting data platforms and pipelines, strong communication and business acumen.
SQL, Redshift, Spark, Hive, BigQuery, Tableau, Qlik, Dash, Python, Java, Scala
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Software Engineer- Data Engineering
Reston or San Diego or Washington or Maryland or Virginia or California
$143k-$193k/yr RemoteFull Time
Noctua Technology
Noctua Technology: Provides software engineering, cloud, and data consulting services.
US citizen eligible for Secret clearance; expert SQL and relational DB skills; experience designing scalable data pipelines, cloud platforms (AWS/Azure/GCP), Python/Java/C++, ETL tools, data migration, and data visualization.
SQL, MySQL, PostgreSQL, Beam, Airflow, Kafka, Jupyter, Colab, Pandas, Tableau, Looker, PowerBI, Qlik, SuperSet, AWS, Azure, GCP, Python, Java, C++, Git, Spark, Hadoop, Docker, Kubernetes
Job PostingView all
1w
Save
Mark Applied
Hide
Lead AI / ML Engineer
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$294k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
6+ YOEBachelor's degree or equivalent experience, 6+ years developing and deploying AI/ML solutions, programming proficiency, experience with ML frameworks, big data, databases, and cloud platforms.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Microsoft Azure, Google Cloud, D3.js, ggplot
Job PostingView all

Explore Jobs

Expand Your Job Search