HiringCafe
Join our community

25 pyspark data engineer jobs at 14 companies in National City, CA

3mo
Save
Mark Applied
Hide
Staff Data Engineer / Full‑Stack Data Developer (Databricks / Python)
San Diego, California, United States
$128k-$192k/yr OnsiteFull Time
Qualcomm
QualcommNASDAQ: QCOM: Global leader in wireless technology, semiconductor design, and intelligent computing.
5+ YOE5+ years data engineering experience; strong Databricks, Python, PySpark, Apache Spark, and SQL skills; production data pipeline and application ownership; Bachelor's in related field preferred (or 7+ years experience).
Databricks, Python, Apache Spark, PySpark, SQL, NoSQL, Databricks notebooks, Databricks dashboards, Structured Streaming, Kafka, AWS S3, AWS IAM, AWS EC2, AWS Glue, Unity Catalog, Git
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
San Diego, California, United States
$62k-$141k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Global firm providing management, technology, and engineering consulting services.
3+ YOEBachelor's degree and 3+ years in data engineering, ETL, pipeline development, or data integration. Requires Databricks, programming, source control, databases, automation, and ability to obtain Secret clearance.
Databricks, Python, SQL, R, JavaScript, C++, GitHub, Atlassian, GraphQL, Linux, Windows, AWS EMR, Redshift, SageMaker, SQL Data Warehouse, Apache Spark, NVIDIA CUDA, Terraform, CloudFormation, AWS Solutions Architect, Azure, Security+, CISSP
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
San Diego, California, United States
$62k-$141k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Global firm providing management, technology, and engineering consulting services.
3+ YOERequires 3+ years in data engineering, ETL, pipeline development, or data integration; Databricks; programming; source control; databases; Linux or Windows automation; bachelor's degree; and ability to obtain Secret clearance.
Databricks, Python, SQL, R, JavaScript, C++, GitHub, Atlassian, GraphQL, Linux, Windows, AWS EMR, Redshift, SageMaker, SQL Data Warehouse, Apache Spark, NVIDIA CUDA, Terraform, CloudFormation, AWS Solutions Architect, Azure, Security+, CISSP
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer II
San Diego, California, United States
$95k-$161k/yr HybridFull Time
ICW Group
ICW Group: Privately held national property-and-casualty carrier serving businesses with workers’ compensation and specialty insurance.
3+ YOEBachelor's degree or equivalent experience, 3+ years in data integration engineering, and expertise with databases, data warehouses, cloud data platforms, pipelines, ETL/ELT, and data modeling.
Microsoft SQL Server, PostgreSQL, AWS, Amazon Redshift, Amazon S3, Amazon EC2, AWS Glue, Amazon EMR, Amazon Kinesis, AWS Lambda, Amazon DynamoDB, Snowflake, Databricks, Hadoop, Apache Spark, Apache Kafka, Python, Scala, Talend, SQL Server Integration Services (SSIS), Profisee, Alteryx, Informatica, Microsoft Office
Job PostingView all
3d
Save
Mark Applied
Hide
Principal Engineer 1, Data Platforms
San Diego, California, United States
$175k-$185k/yr OnsiteFull Time
Halozyme
HalozymeNasdaq: HALO: Public biopharmaceutical developing drug-delivery technologies, auto-injectors, and medicines for patients and pharmaceutical partners.
10+ YOE2+ MgmtBachelor’s degree and 10+ years in data engineering or platform architecture; 2+ years technical leadership; expertise in Microsoft Fabric, PySpark, T-SQL, Python, ELT/ETL, CI/CD, governance, and enterprise data platforms.
Microsoft Fabric, OneLake, Spark, SQL, Data Factory, Power BI, PySpark, T-SQL, Python, Databricks, Azure Synapse, Azure DevOps, GitHub Actions, Microsoft Purview, Unity Catalog, Master Control, Veeva, LIMS, ELN, Benchling, CTMS, EDC, HRIS
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Seattle or Toronto or Santa Barbara or San Diego
$127k-$190k/yr RemoteFull Time
Invoca
Invoca: Privately held SaaS platform helping marketing, commerce, and contact-center teams convert customer conversations into revenue.
5+ YOE5+ years in data or software engineering; advanced Python, SQL, Databricks, Spark, and data modeling; experience with orchestration, streaming, cloud infrastructure, data quality, ML datasets, and privacy; bachelor's degree or equivalent.
Python, PySpark, Pandas, Polars, PyArrow, SQL, MySQL, PostgreSQL, Databricks, Delta Lake, Unity Catalog, Workflows, Jobs/Compute, Snowflake, BigQuery, Apache Spark, Airflow, Dagster, Kafka, Kinesis, Spark Structured Streaming, AWS, S3, IAM, FastAPI, Databricks Model Serving, SageMaker endpoints
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Diego, California, United States
$124k-$190k/yr HybridFull Time
CoStar Group
CoStar GroupNASDAQ: CSGP: Provider of commercial and residential real estate information and marketplaces.
5+ YOEBachelor's degree required, 5+ years data engineering experience, strong ETL/pipeline and AWS experience, Databricks/Spark, C#/.NET, SQL, CI/CD/DevOps, and experience designing scalable data platforms.
Databricks, Apache Spark, C#, .NET, Claude Code, AWS, Kafka, Kinesis, SQL, CI/CD, DevOps
Job PostingView all
3mo
Save
Mark Applied
Hide
Enterprise Data Engineering Manager, FVP
San Diego or Irvine or Los Angeles or Centennial or Las Vegas or Kansas City or Edison or Omaha
$145k-$180k/yr OnsiteFull Time
Axos Bank
Axos BankNew York Stock Exchange (NYSE): AX: Digital-first financial services for individuals and companies.
10+ YOE7+ Mgmt10+ years in data engineering leadership; SQL Server; cloud data ecosystems (GCP/AWS/Azure); Databricks and Spark; PySpark; Python; SQL; ETL/ELT tools (Fivetran, dbt); leadership and collaboration skills.
Databricks, Spark, PySpark, Python, SQL, Fivetran, dbt, GCP, Azure, AWS, BigQuery, Snowflake, SQL Server
Job PostingView all
20h
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services delivering 360° value.
3+ YOERequires 3+ years in data engineering, cloud platforms, and Python, PySpark, or Java; 1+ year with Palantir Foundry, prompt engineering, and applied AI; bachelor's degree or equivalent experience.
Palantir Foundry, Palantir Artificial Intelligence Platform (AIP), Palantir Gotham, Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Microsoft GitHub, GitLab, Jenkins, JavaScript
Job PostingView all
1w
Save
Mark Applied
Hide
Software Engineer II, Data
United States or Southfield or San Francisco or Seattle or Boston or New York City or Los Angeles or San Diego
$106k-$153k/yr RemoteFull Time
Credit Acceptance
Credit AcceptanceNasdaq: CACC: Public indirect auto finance helping independent and franchised dealers finance vehicles for credit-challenged consumers.
2+ YOEBachelor’s degree or equivalent experience, 2+ years of data engineering, programming in Python and SQL, data modeling, database management, scalable pipelines, AI tools, ADLC, and Databricks experience.
Python, SQL, PySpark, NoSQL, Databricks, Apache Spark, AWS, S3, AWS Glue, AWS Lambda, Amazon MSK, CI/CD, Airflow, dbt, Dagster, AI tools, ADLC
Job PostingView all
2mo
Save
Mark Applied
Hide
Microsoft BI (Fabric) Engineer
San Diego or United States
$110k-$140k/yr RemoteFull Time
Avantiico
Avantiico: Privately held Microsoft consulting and software serving businesses with Dynamics 365 ERP and automation solutions.
4+ YOE4+ years with Microsoft Fabric or Azure Synapse, strong Power BI/DAX, advanced SQL and Python/PySpark, Azure Data Factory/Synapse pipelines, Git/Azure DevOps, Dynamics 365/Dataverse integration, and client-facing consulting experience.
Microsoft Fabric, Azure Synapse, Power BI, DAX, SQL, Python, PySpark, Azure Data Factory, Synapse Pipelines, Git, Azure DevOps, Microsoft Dynamics 365 Finance & Supply Chain Management, Dataverse
Job PostingView all
2mo
Save
Mark Applied
Hide
Technology Consultant 2
Richardson or San Diego or California or Texas or United States
$79k-$110k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Global leader in next-generation digital services and consulting.
Experience with Databricks, PySpark, Python, Git, DevSecOps and Medallion Architecture; build and operate data platforms; Bachelor's degree or equivalent experience; US work authorization required; relocation/travel may be needed.
Databricks, PySpark, Python, Git, DevSecOps, Medallion Architecture, AI accelerators, AWS, IAM
Job PostingView all
3d
Save
Mark Applied
Hide
Senior Staff Data Platform Engineer - Kafka - Apache Iceberg - Apache Spark
San Francisco or Pleasanton or Santa Clara or San Diego
$181k-$317k/yr HybridFull Time
ServiceNow
ServiceNowNYSE: NOW: Enterprise software providing cloud-based workflow automation platforms.
10+ YOERequires 10+ years of software development with a bachelor's degree, 8+ with a master's, 6+ with a PhD, or equivalent; expertise in Java, distributed systems, Kafka, data lakes, and ingestion pipelines.
Java, Kafka, Apache Iceberg, Kafka Connect, Apache Kafka, Apache Flink, Apache Spark, Parquet, ORC, Avro, Oracle, MySQL, PostgreSQL
Job PostingView all
3d
Save
Mark Applied
Hide
Senior Staff Data Platform Engineer - Kafka - Apache Iceberg - Apache Spark
San Diego or San Francisco or Pleasanton or Santa Clara
$181k-$317k/yr HybridFull Time
ServiceNow
ServiceNowNYSE: NOW: Enterprise software providing cloud-based workflow automation platforms.
10+ YOERequires 6–10+ years of software development experience depending on degree, deep Java and distributed systems expertise, and experience with Kafka, data lakes, ingestion pipelines, and production operations.
Java, JVM, Oracle, MySQL, PostgreSQL, Kafka, Apache Iceberg, Kafka Connect, Apache Kafka, Apache Flink, Apache Spark, Parquet, ORC, Avro
Job PostingView all
20h
Save
Mark Applied
Hide
SAP BI/BW Developer
Tijuana, Baja California, Mexico
RemoteFull Time
Thermo Fisher Scientific
Thermo Fisher ScientificNYSE: TMO: The world leader in serving science.
3+ YOERequires 3–5 years in data engineering, software development, or analytics; Python, complex SQL, Databricks/PySpark, REST and LLM API experience; a relevant degree is preferred.
Databricks, SAP Business AI, Amazon Web Services (AWS), Microsoft Azure, LLM APIs, Model Context Protocol (MCP), Python, SQL, Pandas, REST APIs, PySpark, SAP, SAP BW/4HANA, SAP Datasphere, CDS views, LangChain, LlamaIndex, SAP BOBJ, Power BI, SAP Analytics Cloud
Job PostingView all
3w
Save
Mark Applied
Hide
Biostatistician
Fort Bragg or San Diego or Fort Campbell or Hurlburt Field or Joint Base Lewis-McChord or North America or Australia or Europe or Asia or Africa or South America
$63k-$86k/yr OnsiteFull Time
General Dynamics Information Technology
General Dynamics Information TechnologyNew York Stock Exchange: GD: Provider of enterprise IT services and defense solutions.
5+ YOEMaster's or doctoral degree and 5+ years in quantitative or related science, including 3+ years of research. Requires Python or R, advanced SQL, data engineering, analytics, visualization, and Secret or Top Secret clearance.
SQL Server, Databricks, Apache Spark, PySpark, Power BI, Microsoft Power Apps, Microsoft Power Automate, Python, R, HTML, CSS, JavaScript, React, Django, ASP.NET Core, Microsoft Word, Microsoft Excel, Microsoft Access, DAX, NLP, Large Language Models (LLMs)
Job PostingView all
2mo
Save
Mark Applied
Hide
Machine Learning Scientist - Physics-Informed
San Diego, California, United States
$135k-$203k/yr OnsiteFull Time
ASML
ASMLEuronext Amsterdam / NASDAQ: ASML: Multinational developer and manufacturer of advanced semiconductor lithography systems.
3+ YOEPhD (3+ yrs) or Master's (6+ yrs) in math/physics/engineering; extensive experience in physics-informed ML, model integration, data pipelines, optimization and deep learning; strong Python and software skills.
Python, PyTorch, JAX, C/C++, MATLAB, MLflow, Apache Spark, Microsoft Azure Kubernetes Service (AKS), Google Distributed Cloud Edge (GDCE), Microsoft Azure Databricks
Job PostingView all

Explore Jobs

Expand Your Job Search