HiringCafe
Join our community

29 pyspark developer jobs at 16 companies in San Diego, CA

3d
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
3+ YOERequires 3+ years in data engineering, cloud platforms, and Python, PySpark, or Java; 1+ year with Palantir Foundry and AIP; bachelor's degree or equivalent experience.
Palantir Foundry, Palantir Gotham, Palantir Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Git, GitHub, GitLab, Jenkins, JavaScript
Job PostingView all
2mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
3w
Save
Mark Applied
Hide
Founding Product Engineer
San Diego, California, United States
$140k-$190k/yr HybridFull Time
Netradyne
Netradyne: Develops AI-powered vision technology for commercial fleet safety.
7+ YOE7+ years software engineering, full-stack (Go, Python, Java, TypeScript/JavaScript), systems thinking, customer-facing experience, multi-tenant and RBAC design, familiarity with AI-assisted development tools.
Go, Python, Java, TypeScript, JavaScript, AWS, CI/CD, Temporal, WorkOS, Auth0, Clerk, Spark, PySpark, Claude Code, Codex, Cursor
Job PostingView all
4w
Save
Mark Applied
Hide
Software Engineer II, Data Platform
San Diego, California, United States
$150k-$225k/yr HybridFull Time
Sony Interactive Entertainment
Sony Interactive EntertainmentTokyo Stock Exchange: 6758: Develops and publishes PlayStation gaming hardware, software, and services.
3+ YOEBachelor's degree in Computer Science and 3+ years developing scalable distributed systems. Requires Scala, Java, or Python proficiency, cloud services experience, and production on-call participation.
Scala, Java, Python, AWS, GCP, Kafka, Kinesis, SQS, Apache Spark, Apache Flink, Databricks
Job PostingView all
3mo
Save
Mark Applied
Hide
Staff Data Engineer / Full‑Stack Data Developer (Databricks / Python)
San Diego, California, United States
$128k-$192k/yr OnsiteFull Time
Qualcomm
QualcommNASDAQ: QCOM: Designs and manufactures semiconductors and wireless telecommunications products.
5+ YOE5+ years data engineering experience; strong Databricks, Python, PySpark, Apache Spark, and SQL skills; production data pipeline and application ownership; Bachelor's in related field preferred (or 7+ years experience).
Databricks, Python, Apache Spark, PySpark, SQL, NoSQL, Databricks notebooks, Databricks dashboards, Structured Streaming, Kafka, AWS S3, AWS IAM, AWS EC2, AWS Glue, Unity Catalog, Git
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer III, Development
Carlsbad, California, United States
$181k-$186k/yr OnsiteFull Time
Thermo Fisher Scientific
Thermo Fisher ScientificNYSE: TMO: Sells equipment and chemicals for scientific research and healthcare.
4+ YOEMaster's in CS/IS (or Bachelor's +6 yrs); minimum 4 years as a Database Administrator or Data Engineer; experience with Databricks, Data lake/Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elasticsearch, Lambda, S3, RDS, MongoDB, DynamoDB, PySpark, Python, SQL, Git, Jenkins, Informatica, TCL/Unix shell, and Sybase.
Databricks, Data lake, Delta lake, Oracle, AWS Redshift, Apache Spark, Glue, Kafka, Elastic Search, Lambda, S3, Redshift, RDS, MongoDB, DynamoDB, PySpark, Python, Git, Jenkins, Informatica, TCL, Unix shell script, SQL, Sybase
Job PostingView all
3w
Save
Mark Applied
Hide
Machine Learning Engineer
San Diego, California, United States
$110k-$209k/yr RemoteFull Time
AbbVie
AbbVieNYSE: ABBV: Develops and sells innovative pharmaceutical and biopharmaceutical medicines.
3+ YOEBS/MS/PhD in quantitative field, 3+ years building and deploying ML pipelines, strong Python skills, experience with Pandas/PySpark, scikit-learn/HuggingFace/TensorFlow/Keras/PyTorch, SQL, MLOps and cloud (AWS preferred).
Python, Pandas, PySpark, scikit-learn, HuggingFace, TensorFlow, Keras, PyTorch, MLlib, SQL, AWS, APIs, Docker, Kubernetes, Snowflake, RDS, DynamoDB, Kafka, Fivetran, dbt, Airflow, EMR, SageMaker, DataDog, PagerDuty
Job PostingView all
1mo
Save
Mark Applied
Hide
Microsoft BI (Fabric) Engineer
San Diego or United States
$110k-$140k/yr RemoteFull Time
Avantiico
Avantiico: Provider of Microsoft Dynamics implementation and business automation software.
4+ YOE4+ years with Microsoft Fabric or Azure Synapse, strong Power BI/DAX, advanced SQL and Python/PySpark, Azure Data Factory/Synapse pipelines, Git/Azure DevOps, Dynamics 365/Dataverse integration, and client-facing consulting experience.
Microsoft Fabric, Azure Synapse, Power BI, DAX, SQL, Python, PySpark, Azure Data Factory, Synapse Pipelines, Git, Azure DevOps, Microsoft Dynamics 365 Finance & Supply Chain Management, Dataverse
Job PostingView all
1w
Save
Mark Applied
Hide
Software Engineer II, Data Platform
Aliso Viejo or San Diego
$150k-$225k/yr HybridFull Time
Sony Interactive Entertainment
Sony Interactive EntertainmentNYSE: SONY: Provides PlayStation gaming hardware, software, and digital network services.
3+ YOEBachelor's in Computer Science,3+ years building scalable distributed systems,proficiency in Scala/Java/Python,AWS or GCP experience,knowledge of event streaming and distributed processing,CI/CD and on-call experience.
Scala, Java, Python, AWS, GCP, Kafka, Kinesis, SQS, Apache Spark, Apache Flink, Databricks
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
San Diego, California, United States
$62k-$141k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
3+ YOEBachelor's degree and 3+ years in data engineering, ETL, pipeline development, or data integration. Requires Databricks, programming, source control, databases, automation, and ability to obtain Secret clearance.
Databricks, Python, SQL, R, JavaScript, C++, GitHub, Atlassian, GraphQL, Linux, Windows, AWS EMR, Redshift, SageMaker, SQL Data Warehouse, Apache Spark, NVIDIA CUDA, Terraform, CloudFormation, AWS Solutions Architect, Azure, Security+, CISSP
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer
Arlington or San Diego
$62k-$141k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
2+ YOE2+ years data engineering or pipeline development; ETL and cloud/on-prem experience; Git/Atlassian, Python, SQL/GraphQL, Linux/Windows; ability to obtain Secret clearance; Bachelor's degree.
Git, Atlassian, Python, SQL, GraphQL, Linux, Windows, AWS EMR, Redshift, SageMaker, Databricks, SQL Data Warehouse, Apache Spark, NVIDIA CUDA, Terraform, CloudFormation
Job PostingView all
1mo
Save
Mark Applied
Hide
Business Intelligence Developer (Onsite)
Oceanside, California, United States
$35-$52/hr OnsiteFull Time
Frontwave Credit Union
Frontwave Credit Union: Member-owned financial institution providing banking and lending services.
2+ YOEBachelor's in STEM preferred; SQL database and query knowledge required; 2+ years SQL/database experience preferred; experience with cloud data warehouses, Python (PySpark), and performance tuning; strong communication and problem-solving skills.
Databricks, Microsoft SQL Server, Azure, DB2, SQL, Python (PySpark)
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer II
San Diego, California, United States
$95k-$161k/yr HybridFull Time
ICW Group
ICW Group: Provides workers' compensation and specialty property and casualty insurance.
3+ YOEBachelor's degree or equivalent experience, 3+ years in data integration engineering, and expertise with databases, data warehouses, cloud data platforms, pipelines, ETL/ELT, and data modeling.
Microsoft SQL Server, PostgreSQL, AWS, Amazon Redshift, Amazon S3, Amazon EC2, AWS Glue, Amazon EMR, Amazon Kinesis, AWS Lambda, Amazon DynamoDB, Snowflake, Databricks, Hadoop, Apache Spark, Apache Kafka, Python, Scala, Talend, SQL Server Integration Services (SSIS), Profisee, Alteryx, Informatica, Microsoft Office
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Diego, California, United States
$124k-$190k/yr HybridFull Time
CoStar Group
CoStar GroupNASDAQ: CSGP: Global provider of commercial and residential real estate data.
5+ YOEBachelor's degree required, 5+ years data engineering experience, strong ETL/pipeline and AWS experience, Databricks/Spark, C#/.NET, SQL, CI/CD/DevOps, and experience designing scalable data platforms.
Databricks, Apache Spark, C#, .NET, Claude Code, AWS, Kafka, Kinesis, SQL, CI/CD, DevOps
Job PostingView all
4d
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Seattle or Toronto or Santa Barbara or San Diego
$127k-$190k/yr RemoteFull Time
Invoca
Invoca: AI platform for conversation intelligence and revenue execution.
5+ YOE5+ years in data or software engineering; advanced Python, SQL, Databricks, Spark, and data modeling; experience with orchestration, streaming, cloud infrastructure, data quality, ML datasets, and privacy; bachelor's degree or equivalent.
Python, PySpark, Pandas, Polars, PyArrow, SQL, MySQL, PostgreSQL, Databricks, Delta Lake, Unity Catalog, Workflows, Jobs/Compute, Snowflake, BigQuery, Apache Spark, Airflow, Dagster, Kafka, Kinesis, Spark Structured Streaming, AWS, S3, IAM, FastAPI, Databricks Model Serving, SageMaker endpoints
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Engineer II
Miramar, California, United States
$125k-$135k/yr OnsiteFull Time
SteerBridge: Provides technology and digital transformation services for government agencies.
3+ YOE3–5 years data engineering; US citizenship; active security clearance or ability to obtain one; Bachelor’s in Computer Science; cloud or AWS data engineering experience; Python and SQL proficiency.
Python, PySpark, pandas, SQL, AWS, Snowflake, BigQuery, Redshift, Azure Data Factory, Azure Databricks, Apache Airflow, dbt, Prefect, Tableau, Power BI, Kibana, Terraform, Pulumi
Job PostingView all
3w
Save
Mark Applied
Hide
Machine Learning Engineer
San Diego, California, United States
$110k-$209k/yr RemoteFull Time
AbbVie
AbbVieNew York Stock Exchange: ABBV: Researches, develops, and manufactures biopharmaceutical and medical products.
3+ YOE3+ years building, evaluating, scaling, and deploying ML pipelines; BS/MS/PhD in quantitative field; strong Python, ML libraries, SQL, AWS, and MLOps experience.
Python, Pandas, PySpark, scikit-learn, HuggingFace, TensorFlow/Keras, PyTorch, MLlib, SQL, AWS, APIs, Docker, Kubernetes, Snowflake, RDS, DynamoDB, Kafka, Fivetran, dbt, Airflow, EMR, Sagemaker, DataDog, PagerDuty
Job PostingView all
1mo
Save
Mark Applied
Hide
Technology Consultant 2
Richardson or San Diego or California or Texas or United States
$79k-$110k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Databricks, PySpark, Python, Git, DevSecOps and Medallion Architecture; build and operate data platforms; Bachelor's degree or equivalent experience; US work authorization required; relocation/travel may be needed.
Databricks, PySpark, Python, Git, DevSecOps, Medallion Architecture, AI accelerators, AWS, IAM
Job PostingView all
2mo
Save
Mark Applied
Hide
Research Scientist
Carlsbad, California, United States
OnsiteFull Time
NTENT
NTENT: Develops semantic search and natural language processing technology platforms.
3+ YOEPhD preferred; 3+ years in NLP/ML; Python or R; Spark/PySpark; strong communication.
Python, R, Spark, PySpark
Job PostingView all
2w
Save
Mark Applied
Hide
Applied Scientist (GenAI/LLM), Sandstone
Seattle or San Diego
$143k-$193k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
2+ YOEPhD or Master's+4yrs in CS/CE/ML or related; 2+ years building models for business; programming in Java/C++/Python; experience with algorithms, optimization, distributed computing; publications or patents preferred.
Java, C++, Python, PyTorch, scikit-learn, Spark MLLib, PySpark, MxNet, TensorFlow, NumPy, SciPy, Hadoop, Spark
Job PostingView all

Explore Jobs

Expand Your Job Search