HiringCafe
Join our community

19 pyspark data engineer jobs at 13 companies in Encinitas, CA

3mo
Save
Mark Applied
Hide
Staff Data Engineer
New York City or Tarrytown or San Diego or United Kingdom or Argentina
RemoteFull Time
Exactera
Exactera: AI-powered corporate tax compliance and transfer pricing software.
5+ YOE5+ years in data engineering; SQL, Python, PySpark; Databricks (Delta Lake, Workflows, Unity Catalog); AWS; Terraform; data governance; onshore technical leadership.
SQL, Python, PySpark, Databricks, Delta Lake, Workflows, Unity Catalog, AWS, S3, IAM, VPC, Terraform, data governance
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer III, Development
Carlsbad, California, United States
$181k-$186k/yr OnsiteFull Time
Thermo Fisher Scientific
Thermo Fisher ScientificNYSE: TMO: Sells equipment and chemicals for scientific research and healthcare.
4+ YOEMaster's in CS/IS (or Bachelor's +6 yrs); minimum 4 years as a Database Administrator or Data Engineer; experience with Databricks, Data lake/Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elasticsearch, Lambda, S3, RDS, MongoDB, DynamoDB, PySpark, Python, SQL, Git, Jenkins, Informatica, TCL/Unix shell, and Sybase.
Databricks, Data lake, Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elastic Search, Lambda, S3, Redshift, RDS, MongoDB, DynamoDB, PySpark, Python, Git, Jenkins, Informatica, TCL, Unix shell script, SQL, Sybase
Job PostingView all
2d
Save
Mark Applied
Hide
Data Engineer
Arlington or San Diego
$62k-$141k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
2+ YOE2+ years data engineering or pipeline development; ETL and cloud/on-prem experience; Git/Atlassian, Python, SQL/GraphQL, Linux/Windows; ability to obtain Secret clearance; Bachelor's degree.
Git, Atlassian, Python, SQL, GraphQL, Linux, Windows, AWS EMR, Redshift, SageMaker, Databricks, SQL Data Warehouse, Apache Spark, NVIDIA CUDA, Terraform, CloudFormation
Job PostingView all
2w
Save
Mark Applied
Hide
Data Developer
San Diego, California, United States
HybridFull Time
Innovatus Technology Consulting
Innovatus Technology Consulting: Delivers IT infrastructure and cybersecurity services to federal defense agencies.
4+ YOEActive Secret clearance and U.S. citizenship required; Bachelor's degree or 4+ years' related experience; experience with data engineering, ETL/ELT, Apache Spark, SQL, AWS, Python, ML, and data visualization.
ETL/ELT, SQL, Apache Spark, PySpark, AWS, Delta Lake, Python, Scikit-Learn, TensorFlow, MLflow, Pandas, Flask, Django, Git, Tableau, Qlik, Jupyter Notebooks, Databricks, Azure Data Studio, Palantir Foundry
Job PostingView all
3w
Save
Mark Applied
Hide
Staff Data Engineer
Mountain View or San Diego
$189k-$259k/yr OnsiteFull Time
Intuit
IntuitNASDAQ: INTU: Provides financial software for accounting, tax, and personal finance.
7+ YOE7+ years experience in data analytics/engineering, bachelor's in a quantitative field, proficiency in Java or Python, ETL/data modeling, big data frameworks, and visualization tools; strong communication skills.
Java, Python, Tableau, Qlik, PowerBI, Apache Spark, Hadoop, Databricks
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
San Diego, California, United States
$62k-$141k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
3+ YOE3+ years in data engineering or ETL; experience with Databricks, Python/SQL/R/JavaScript/C++, GitHub or Atlassian, relational and non-relational databases, Linux/Windows scripting; ability to obtain Secret clearance; bachelor’s degree required.
Databricks, Python, SQL, R, Javascript, C++, GitHub, Atlassian, GraphQL, Linux, Windows, AWS EMR, Redshift, SageMaker, SQL Data Warehouse, Machine Learning service, Apache Spark, NVIDIA CUDA, Terraform, CloudFormation
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
San Diego, California, United States
$62k-$141k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
3+ YOE3+ years data engineering/ETL experience; Databricks; programming in Python, SQL, R, JavaScript, or C++; GitHub/Atlassian; relational and non-relational databases; Linux/Windows scripting; bachelor\u0002s degree; ability to obtain Secret clearance.
Databricks, Python, SQL, R, Javascript, C++, GitHub, Atlassian, GraphQL, Linux, Windows, AWS EMR, Redshift, SageMaker, SQL Data Warehouse, Machine Learning service, Apache Spark, NVIDIA CUDA, Terraform, CloudFormation
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Diego, California, United States
$124k-$190k/yr HybridFull Time
CoStar Group
CoStar GroupNASDAQ: CSGP: Global provider of commercial and residential real estate data.
5+ YOEBachelor's degree required, 5+ years data engineering experience, strong ETL/pipeline and AWS experience, Databricks/Spark, C#/.NET, SQL, CI/CD/DevOps, and experience designing scalable data platforms.
Databricks, Apache Spark, C#, .NET, Claude Code, AWS, Kafka, Kinesis, SQL, CI/CD, DevOps
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer II
Miramar, California, United States
$125k-$135k/yr OnsiteFull Time
SteerBridge: Provides technology and digital transformation services for government agencies.
3+ YOE3–5 years data engineering; US citizenship; active security clearance or ability to obtain one; Bachelor’s in Computer Science; cloud or AWS data engineering experience; Python and SQL proficiency.
Python, PySpark, pandas, SQL, AWS, Snowflake, BigQuery, Redshift, Azure Data Factory, Azure Databricks, Apache Airflow, dbt, Prefect, Tableau, Power BI, Kibana, Terraform, Pulumi
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr Manager, Data Engineering
San Diego or Massachusetts
$169k-$253k/yr HybridFull Time
Insulet
InsuletNasdaq: PODD: Manufactures wearable tubeless insulin pumps for diabetes care.
10+ YOE5+ Mgmt10+ years in data operations/platform engineering/data architecture with 5+ years as a lead administrator/architect for enterprise Databricks; expertise in Databricks, Unity Catalog, governance, security (RBAC/ABAC), Terraform, CI/CD, Python, PySpark, and SQL; Databricks admin certification preferred.
Databricks, Unity Catalog, Databricks Asset Bundles (DABs), Databricks CLI, Terraform, GitHub Actions, Azure DevOps, GitLab CI, Python, PySpark, SQL, Model Context Protocol (MCP)
Job PostingView all
2mo
Save
Mark Applied
Hide
Enterprise Data Engineering Manager, FVP
San Diego or Irvine or Los Angeles or Centennial or Las Vegas or Kansas City or Edison or Omaha
$145k-$180k/yr OnsiteFull Time
Axos Financial
Axos FinancialNYSE: AX: Provides digital-first banking and diverse financial services to customers.
10+ YOE7+ Mgmt10+ years in data engineering leadership; SQL Server; cloud data ecosystems (GCP/AWS/Azure); Databricks and Spark; PySpark; Python; SQL; ETL/ELT tools (Fivetran, dbt); leadership and collaboration skills.
Databricks, Spark, PySpark, Python, SQL, Fivetran, dbt, GCP, Azure, AWS, BigQuery, Snowflake, SQL Server
Job PostingView all
1mo
Save
Mark Applied
Hide
Microsoft BI (Fabric) Engineer
San Diego or United States
$110k-$140k/yr RemoteFull Time
Avantiico
Avantiico: Provider of Microsoft Dynamics implementation and business automation software.
4+ YOE4+ years with Microsoft Fabric or Azure Synapse, strong Power BI/DAX, advanced SQL and Python/PySpark, Azure Data Factory/Synapse pipelines, Git/Azure DevOps, Dynamics 365/Dataverse integration, and client-facing consulting experience.
Microsoft Fabric, Azure Synapse, Power BI, DAX, SQL, Python, PySpark, Azure Data Factory, Synapse Pipelines, Git, Azure DevOps, Microsoft Dynamics 365 Finance & Supply Chain Management, Dataverse
Job PostingView all
1mo
Save
Mark Applied
Hide
Technology Consultant 2
Richardson or San Diego or California or Texas or United States
$79k-$110k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Databricks, PySpark, Python, Git, DevSecOps and Medallion Architecture; build and operate data platforms; Bachelor's degree or equivalent experience; US work authorization required; relocation/travel may be needed.
Databricks, PySpark, Python, Git, DevSecOps, Medallion Architecture, AI accelerators, AWS, IAM
Job PostingView all
2mo
Save
Mark Applied
Hide
VP, Data Engineering Technical Lead
San Diego, California, United States
$125k-$150k/yr OnsiteFull Time
Axos Financial
Axos FinancialNYSE: AX: Provides digital-first banking and diverse financial services to customers.
8+ YOE3+ Mgmt8+ years data engineering, 3+ in lead role; Databricks, Spark, dbt, Fivetran, Airflow; cloud (Azure/GCP); SQL; Python/Scala/Java; strong problem solving and communication.
Databricks, Apache Spark, dbt, Fivetran, Airflow, Kafka, Census, Iceberg, Delta Live Tables, Azure, GCP, Synapse, Data Factory, BigQuery, Pub/Sub, SQL, Python, Scala, Java
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineering Technical Lead - VP
San Diego, California, United States
$125k-$150k/yr HybridFull Time
Axos Financial
Axos FinancialNYSE: AX: Provides digital-first banking and diverse financial services to customers.
8+ YOE3+ Mgmt8+ years data engineering with 3+ years in lead role; Bachelor's degree; strong SQL and programming (Python/Scala/Java); Databricks/Spark, dbt, Fivetran, Airflow, Kafka; Azure and/or GCP experience.
Databricks, Apache Spark, dbt, Fivetran, Airflow, Kafka, Census, Azure, BigQuery, Data Factory, Synapse, Iceberg, Databricks Assistant, Cursor AI, GitHub Copilot
Job PostingView all
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
3mo
Save
Mark Applied
Hide
Software Engineer II, Data Platform
San Diego, California, United States
$150k-$225k/yr HybridFull Time
Sony Interactive Entertainment
Sony Interactive EntertainmentNYSE: SONY: Provides PlayStation gaming hardware, software, and digital network services.
3+ YOE3+ years building scalable distributed data platforms; proficient in Scala/Java/Python; cloud apps (AWS preferred); Kafka/Kinesis/SQS; Spark/Flink; CI/CD; global distributed team; on-call rotations.
Scala, Java, Python, AWS, Kafka, Kinesis, SQS, Apache Spark, Apache Flink, CI/CD, Databricks, GCP
Job PostingView all
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Senior Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$305k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
5+ YOE5+ years data engineering; 3+ years Palantir Foundry/Gotham/AIP experience; 5+ years cloud (AWS/Azure/GCP); 5+ years Python/PySpark/Java; Bachelor’s in CS/Engineering or equivalent; strong client-facing and communication skills.
Palantir Foundry, Palantir Gotham, Palantir AIP, Python, PySpark, Java, TypeScript, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
1mo
Save
Mark Applied
Hide
Machine Learning Scientist - Physics-Informed
San Diego, California, United States
$135k-$203k/yr OnsiteFull Time
ASML
ASMLNASDAQ: ASML: Manufactures lithography systems used to print patterns on wafers.
3+ YOEPhD (3+ yrs) or Master's (6+ yrs) in math/physics/engineering; extensive experience in physics-informed ML, model integration, data pipelines, optimization and deep learning; strong Python and software skills.
Python, PyTorch, JAX, C/C++, MATLAB, MLflow, Apache Spark, Microsoft Azure Kubernetes Service (AKS), Google Distributed Cloud Edge (GDCE), Microsoft Azure Databricks
Job PostingView all

Explore Jobs

Expand Your Job Search