HiringCafe
Join our community

57 pyspark developer jobs at 30 companies in Santa Clarita, CA

2d
Save
Mark Applied
Hide
Lead Software Engineer
New York City or Glendale
$163k-$219k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
7+ YOE7+ years in backend development and AI/data applications; Python, Spark/PySpark, scalable APIs, distributed systems, AI/ML, foundation models, cloud deployments, GitHub, Docker, and AWS/EKS experience.
FastAPI, Flask, Spark, PySpark, Python, Claude, GPT-4, OpenAI, Qwen, LangChain, LangGraph, PyTorch, TensorFlow, Cursor, Claude Code, GitHub, Docker, AWS, EKS, Datadog, Grafana, Conviva, Pandas, Databricks, Snowflake
Job PostingView all
3w
Save
Mark Applied
Hide
AI/ML Engineer
Woodland Hills, California, United States
$70k-$75k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
0+ YOEExperience with Python, LLMs, RAG, LangChain/LangGraph, PySpark, Airflow, cloud platforms; BSc in Computer Science preferred; 0–2 years experience acceptable.
Python, SQL, LLMs, LangChain, LangGraph, PySpark, Airflow, Databricks, Snowflake, Azure, AWS
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer AI/ML Ops
Pleasanton or New York City or Los Angeles
$145k-$182k/yr HybridFull Time
BlackLine
BlackLineNASDAQ: BL: Provides cloud-based financial close and accounting automation software.
2+ YOE2+ years in Python/Java/Scala, experience building PySpark ETL, ML/LLM production pipelines, cloud (GCP/AWS/Azure), ML frameworks, orchestration, containerization, and observability.
PySpark, FiveTran, Plaid, TensorFlow, PyTorch, scikit-learn, Airflow, Kubeflow, Vertex AI, MLflow, GCP, AWS, Azure, LangChain, LangGraph, ADK, Prometheus, Grafana, Newrelic, Docker, Kubernetes, Bash, Python, Java, Scala
Job PostingView all
2mo
Save
Mark Applied
Hide
Software Engineer, Engineering Systems
Los Angeles, California, United States
$120k-$150k/yr OnsiteFull Time
Apex
Apex: Mass-manufactures standardized satellite buses for commercial and government use.
2+ YOEU.S. Person required. Bachelor's in related field or equivalent. 2+ years Palantir Foundry and 2+ years Python/PySpark or SQL. ERP implementation experience, data integration and profiling, strong verbal and written communication.
Palantir Foundry, Python, PySpark, SQL
Job PostingView all
2mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer
New York or Los Angeles or San Francisco
$140k-$175k/yr HybridFull Time
Regard
Regard: A that builds AI-powered software to improve clinical documentation and advance patient care.
3+ YOEBS or equivalent, 3+ years data engineering experience, Python and SQL proficiency, experience with PySpark and distributed data processing, AWS experience preferred, LLM-assisted development familiarity, and willingness to participate in on-call support.
S3, Apache Iceberg, EMR, PySpark, Dagster, Kubernetes, ClickHouse, PostgreSQL, FastAPI, Metabase, Python, SQL, AWS, AWS Athena, EHR, OMOP CDM, HIPAA, LLM
Job PostingView all
3mo
Save
Mark Applied
Hide
Sr Software Engineer
New York or Seattle or Glendale
$142k-$199k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOE5+ years backend development; AI/ML systems; AWS; Docker/Kubernetes; LangChain; prompt engineering; production ML deployments; strong communication.
AWS, Docker, Kubernetes, LangChain, LangGraph, PyTorch, TensorFlow, PySpark, Pandas, Git, CI/CD
Job PostingView all
3w
Save
Mark Applied
Hide
Software Development Engineer, Amazon MSK
Santa Monica, California, United States
$144k-$194k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOE3+ years software development, 2+ years design/architecture experience, experience with streaming data technologies and open-source platforms, strong analytical and problem-solving skills.
Apache Kafka, Amazon Kinesis, Apache Spark, Apache Flink, Apache Storm
Job PostingView all
2w
Save
Mark Applied
Hide
Entry-Level Software Engineer
Dallas or Seattle or Houston or San Francisco or Chicago or Philadelphia or El Segundo or Atlanta or New York
$80k-$92k/yr HybridFull Time
Pariveda
Pariveda: Provides technology and strategy consulting for business growth.
Pursuing a Bachelors or Masters in MIS, Computer Science, or Computer Engineering (graduation Dec 2026–Aug 2027); legal US work authorization without sponsorship; software development or internship experience; strong communication and problem-solving skills.
AWS, Azure, Google Cloud, Databricks, PySpark, CI/CD, Docker, Terraform, Azure OpenAI, AWS Bedrock, LangChain, Python, Java, SQL, JavaScript, .NET, React, Angular
Job PostingView all
4w
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or San Francisco
$170k-$200k/yr HybridFull Time
Tatari
Tatari: A platform for buying and measuring TV advertising campaigns.
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
Job PostingView all
3mo
Save
Mark Applied
Hide
Lead Data Engineer
Los Angeles, California, United States
$130k-$170k/yr HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
6+ YOE2+ MgmtLead data engineering role requiring 6-8 years of experience, Databricks stack, SQL, Python, PySpark, data warehousing, Airflow, cloud platforms, and leadership responsibilities.
Databricks, SQL, Python, PySpark, Airflow, Cron, AWS, GCP, Azure, Tableau, Power BI, Hadoop, Hive, HBase, Pig, Spark
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer, Performance Marketing
Agoura Hills, California, United States
$89k-$136k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
3+ YOE3–5 years data engineering experience; strong SQL, Python, Spark/PySpark; experience with Databricks, AWS, Snowflake or Google Cloud; familiarity with AI tools and modern lakehouse architectures.
Python, PySpark, SQL, Spark, Claude Code, Codex, GitHub Copilot, Databricks Genie, Databricks, AWS, Snowflake, Google Cloud, SFTP, APIs
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer, Performance Marketing
Agoura Hills, California, United States
$89k-$136k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
3+ YOE3–5 years in data/analytics engineering, strong SQL and Python, experience with Databricks/AWS/Snowflake/Google Cloud, Spark/PySpark, ETL/ELT pipelines, and modern lakehouse architectures.
Databricks, AWS, Snowflake, Google Cloud, GitHub Copilot, Claude Code, Codex, Databricks Genie, Python, PySpark, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Analytics Engineer Sr Director
Woodland Hills, California, United States
$237k/yr HybridFull Time
Farmers Insurance
Farmers InsuranceSIX Swiss Exchange: ZURN: Provides insurance for vehicles, homes, and businesses.
7+ YOE3+ MgmtBachelor's in CS/CE or related,7+ years experience with large-scale data engineering and analytics,3+ years managing technical resources,experience in P&C insurance,proficiency with SQL,Python,PySpark,AWS and ETL tools.
SQL, Python, PySpark, AWS Lambda, EMR, Sagemaker, Informatica, Ab Initio, Autosys, Jenkins, Terraform, AWS Step, Databricks, Snowflake, Erwin, ER/Studio
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal Software Engineer
Tampa or Thousand Oaks
$157k-$212k/yr HybridFull Time
Amgen
AmgenNASDAQ: AMGN: Develops and manufactures biotechnology medicines for serious diseases.
2+ YOEDeep expertise in ML/Generative AI, MLOps/LLMOps, cloud platforms, and scalable system architecture; proven track record delivering production-grade ML systems; advanced proficiency in Python and modern ML frameworks; degree + experience combinations required.
MLflow, Kubeflow, Airflow, CI/CD, Docker, Kubernetes, AWS, GCP, Azure, Python, PyTorch, TensorFlow, Hugging Face, LangChain, Databricks, Spark, Hadoop, Apache Spark, Apache Airflow, OLAP, OLTP
Job PostingView all
2w
Save
Mark Applied
Hide
Software Engineer II, Data Platform
San Diego or Los Angeles
$150k-$225k/yr HybridFull Time
Sony Interactive Entertainment
Sony Interactive EntertainmentNYSE: SONY: Provides PlayStation gaming hardware, software, and digital network services.
3+ YOEBachelor's in Computer Science,3+ years building scalable distributed systems,proficiency in Scala/Java/Python,cloud experience (AWS preferred),event streaming and distributed processing familiarity,CI/CD and on-call experience.
Scala, Java, Python, AWS, GCP, Kafka, Kinesis, SQS, Apache Spark, Apache Flink, Databricks
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Backend Software Engineer
Torrance, California, United States
$190k/yr HybridFull Time
Arc
Arc: Designing and manufacturing high-performance electric watercraft.
5+ YOERequires 5+ years of industry experience, backend programming expertise, technical project oversight, cloud and DevOps proficiency, API and microservices knowledge, and experience optimizing systems for performance, cost, and scale.
TypeScript, Python, Java, Go, Rust, AWS, Azure, GCP, Amazon Web Services, BigQuery, Apache Spark, Kafka, Terraform, Manufacturing Execution Systems (MESs)
Job PostingView all
4w
Save
Mark Applied
Hide
Senior Machine Learning Engineer
San Francisco or Bellevue or Atlanta or Burbank
$159k-$296k/yr HybridFull Time
Warner Bros. Discovery
Warner Bros. DiscoveryNasdaq: WBD: Produces and distributes multimedia entertainment content and news worldwide.
5+ YOE5+ years ML engineering experience, deep Python, Databricks and Snowflake proficiency, production ML deployment, ML evaluation and experimentation, strong software engineering and communication skills.
Databricks, PySpark, Delta, Workflows, DLT, Unity Catalog, Databricks Genie, Databricks Feature Store, Snowflake, Snowflake Cortex, AWS, SageMaker, S3, Lambda, MLflow, Mosaic, FreeWheel, Google Ad Manager, Cursor, GitHub Copilot, Amazon Q, MCP, LangChain, LangGraph, AutoGen, Python, SQL, Scala, XGBoost, LightGBM, Tecton, Feast
Job PostingView all
4w
Save
Mark Applied
Hide
Sr. Software Engineer, Data (Starlink)
Redmond or Hawthorne
$160k-$270k/yr OnsiteFull Time
SpaceX
SpaceX: Designs and launches advanced rockets and satellite internet constellations.
5+ YOE5+ years software/data engineering experience; BS in CS or 7+ years alternative; proficiency in Scala/Java/C#/Python/Go; experience with big data frameworks, databases, and frontend frameworks; strong communication and problem-solving.
Scala, Java, C#, Python, Go, Angular, React, Apache Kafka, Apache Spark, Apache Flink, Hive, Delta Lake, PostgreSQL, CockroachDB, Grafana, Metabase, PowerBI
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
Versant
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
Job PostingView all

Explore Jobs

Expand Your Job Search