HiringCafe
Join our community

34 pyspark developer jobs at 20 companies in Lancaster, CA

2w
Save
Mark Applied
Hide
Software Engineer, Business Systems
Los Angeles, California, United States
$120k-$150k/yr OnsiteFull Time
Apex
Apex: Mass-manufactures standardized satellite buses for commercial and government use.
2+ YOEU.S. Person required. Bachelor's in related field or equivalent experience. 2+ years Palantir Foundry and 2+ years Python/PySpark or SQL. ERP implementation experience, data profiling, and strong verbal/written communication.
Palantir Foundry, Python, PySpark, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
New York or Los Angeles or San Francisco
$140k-$175k/yr HybridFull Time
Regard
Regard: A that builds AI-powered software to improve clinical documentation and advance patient care.
3+ YOEBS or equivalent, 3+ years data engineering experience, Python and SQL proficiency, experience with PySpark and distributed data processing, AWS experience preferred, LLM-assisted development familiarity, and willingness to participate in on-call support.
S3, Apache Iceberg, EMR, PySpark, Dagster, Kubernetes, ClickHouse, PostgreSQL, FastAPI, Metabase, Python, SQL, AWS, AWS Athena, EHR, OMOP CDM, HIPAA, LLM
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr Software Engineer
New York or Seattle or Glendale
$142k-$199k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOE5+ years backend development; AI/ML systems; AWS; Docker/Kubernetes; LangChain; prompt engineering; production ML deployments; strong communication.
AWS, Docker, Kubernetes, LangChain, LangGraph, PyTorch, TensorFlow, PySpark, Pandas, Git, CI/CD
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Boston or Atlanta or Charlotte or Chicago or Dallas or Houston or Los Angeles or New York
$135k-$195k/yr RemoteFull Time
Paul Hastings
Paul Hastings: International law firm providing legal and regulatory consulting services.
7+ YOE7+ years data engineering or BI development; 3+ years Azure cloud; 2+ years Azure DevOps; Bachelor's in CS/Engineering; SQL/ETL; PySpark; familiarity with Power BI; professional services experience preferred.
Azure Data Factory, Azure Data Lake Storage, Azure Databricks, Azure DevOps, SQL, PySpark, Git, Power BI, Microsoft Purview
Job PostingView all
2mo
Save
Mark Applied
Hide
Software Engineer II
Glendale or New York City or Seattle
$118k-$158k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
3+ YOEBachelor’s degree in Computer Science or Engineering; 3+ years backend or AI-driven development; experience with API design and cloud deployments; strong collaboration and problem-solving skills.
FastAPI, Flask, PyTorch, TensorFlow, GitHub, Docker, AWS, EKS, LangChain, LangGraph, Claude, GPT-4, PySpark, Pandas, Datadog, Grafana, Conviva, Snowflake, Databricks
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or New York City or United States or India
$185k-$200k/yr HybridFull Time
Fuel Cycle
Fuel Cycle: Cloud platform for market research and customer feedback analysis.
5+ YOE5+ years building production Databricks lakehouses; strong PySpark, Python, SQL; experience with Unity Catalog, Delta Lake, dbt, orchestrators (Dagster/Prefect/Workflows), and AWS data services.
Databricks, Unity Catalog, Delta Live Tables, Databricks SQL, Workflows, Delta Lake, dbt, PySpark, Python, MySQL, PostgreSQL, Dagster, Prefect, Databricks Workflows, Databricks Vector Search, pgvector, Amazon OpenSearch, Amazon Bedrock, AgentCore, Strands, OpenMetadata, S3, IAM, Databricks Asset Bundles, Terraform, Apache Iceberg, AWS Glue, Athena, DynamoDB, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior BI & Analytics Developer
San Ramon or Atlanta or Century City or Los Angeles or El Segundo or Duluth
$119k-$162k/yr OnsiteFull Time
Armanino
Armanino: Provides accounting, tax, and consulting services to diverse organizations.
3+ YOE3+ years in analytics/BI/data engineering; hands-on Microsoft Fabric, Microsoft Power BI, SQL, Python/PySpark, and Git; strong dimensional modeling, governance, and stakeholder collaboration skills.
Microsoft Fabric, Microsoft Power BI, SQL, Python, PySpark, DAX, Git
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Los Angeles, California, United States
$130k-$170k/yr HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
6+ YOE2+ MgmtLead data engineering role requiring 6-8 years of experience, Databricks stack, SQL, Python, PySpark, data warehousing, Airflow, cloud platforms, and leadership responsibilities.
Databricks, SQL, Python, PySpark, Airflow, Cron, AWS, GCP, Azure, Tableau, Power BI, Hadoop, Hive, HBase, Pig, Spark
Job PostingView all
3mo
Save
Mark Applied
Hide
AI Engineer
Pasadena, California, United States
$110k-$150k/yr OnsiteFull Time
GEI Consultants
GEI Consultants: Provides multi-disciplinary engineering and environmental consulting services.
4+ YOE4+ years software engineering; 1+ year building Generative AI apps; Python/SQL; Azure AI; experience with LLMs; Azure Databricks/TensorFlow/PyTorch a plus.
Python, PySpark, R, SQL, Azure AI APIs, Databricks Mosaic, TensorFlow, PyTorch
Job PostingView all
1w
Save
Mark Applied
Hide
Analytics Engineer Sr Director
Woodland Hills, California, United States
$237k/yr HybridFull Time
Farmers Insurance
Farmers InsuranceSIX Swiss Exchange: ZURN: Provides insurance for vehicles, homes, and businesses.
7+ YOE3+ MgmtBachelor's in CS/CE or related,7+ years experience with large-scale data engineering and analytics,3+ years managing technical resources,experience in P&C insurance,proficiency with SQL,Python,PySpark,AWS and ETL tools.
SQL, Python, PySpark, AWS Lambda, EMR, Sagemaker, Informatica, Ab Initio, Autosys, Jenkins, Terraform, AWS Step, Databricks, Snowflake, Erwin, ER/Studio
Job PostingView all
6d
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
Versant
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Engineer
Wakefield or Denver or New York or Atlanta or Cary or Dallas or Pasadena or Rancho Cordova or West Palm Beach
$90k-$150k/yr HybridFull Time
GEI Consultants
GEI Consultants: Professional engineering and environmental consulting services.
4+ YOE4+ years of data engineering; Python and SQL; Azure data services; ETL/ELT; data governance; supports AI/RAG and analytics.
Python, SQL, PySpark, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure SQL, Cosmos DB, Databricks, Delta Lake, Unity Catalog, Power BI, API, Graph connectors, CI/CD, Terraform
Job PostingView all
2mo
Save
Mark Applied
Hide
Databricks Engineer
Atlanta or Austin or Boston or Charlotte or Chicago or Dallas or Denver or Detroit or Hartford or Houston or Los Angeles or Miami or Nashville or New Brunswick or New York or Raleigh or Seattle or Tampa or Washington
$90k-$147k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
5+ YOE5+ years data engineering experience, 2+ years building Databricks pipelines and platform features; proficiency with Spark, SQL, Python/Java, EMR/Redshift/Snowflake/BigQuery, orchestration (Airflow/dbt), and data quality tools.
Databricks, Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), Unity Catalog, Auto Loader, Airflow, dbt, Great Expectations, Collibra, Apache Spark, Presto, Amazon EMR, Amazon Redshift, Snowflake, Google BigQuery, SQL, Stored Procedures, Java, Python, PySpark, Databricks Asset Bundles, Terraform, NoSQL Databases, Container Management Systems, GitHub Copilot, Codex, Claude, Cursor, Windsurf
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
Berkeley or Los Angeles
$111k-$166k/yr HybridFull Time
PBK
PBK: Provides architectural and engineering design for specialized facilities.
5+ YOE5+ years building production data pipelines and integrations; strong SQL (PostgreSQL), Python, Microsoft Azure and Microsoft Fabric experience; API and data governance knowledge; Bachelor's degree or equivalent experience.
Salesforce, Deltek Vantagepoint, Autodesk Forma, Microsoft Azure, Microsoft Fabric, Microsoft Fabric Data Pipelines, Microsoft Fabric notebooks, Microsoft Azure Data Factory, Microsoft Azure Logic Apps, Microsoft Azure Functions, Microsoft Azure Event Grid, Microsoft Azure Service Bus, Databricks, Snowflake, dbt, Apache Spark, Spark, Apache Kafka, MuleSoft, Microsoft 365, Microsoft Power BI, GitHub Enterprise, Microsoft Azure DevOps, REST, JSON, SOAP, PostgreSQL, Python, Apache Airflow
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Seattle or Chicago or Los Angeles or New York
$160k-$220k/yr OnsiteFull Time
Metropolis
Metropolis: Computer vision technology for checkout-free parking and retail payments.
5+ YOEBachelor's in CS/Engineering; 5+ years in data engineering; Python; SQL; Snowflake/dbt; AWS; ETL/ELT; on-site 4 days/week.
Python, SQL, Snowflake, dbt, Airflow, MWAA, DMS, EKS, SNS, Glue, AWS, MySQL, MS SQL Server, Postgres, Spark, PySpark, Automic, CI/CD, ETL/ELT
Job PostingView all
3mo
Save
Mark Applied
Hide
Machine Learning Engineer
Chatsworth, California, United States
$160k-$190k/yr HybridFull Time
Machina Labs
Machina Labs: Software-defined robotic platforms for flexible sheet metal manufacturing.
3+ YOEMaster’s or PhD in CS/ML/AI with 3-6+ years of ML experience; Python; Azure; Databricks/Spark; data wrangling; end-to-end ML; manufacturing context.
Microsoft Azure, Databricks, Apache Spark, Python
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Calabasas, California, United States
$123k-$132k/yr OnsiteFull Time
AMH
AMHNYSE: AMH: Leasing and developing single-family rental homes across the United States.
8+ YOESenior data engineer with 8+ years experience; design/build data pipelines and platforms; ML model deployment; leadership and CI/CD.
Azure, AWS, Google Cloud, Databricks, Apache Spark, Kafka, Event Hub, IoT Hub, Power BI, Tableau, Python, CI/CD, RESTful APIs, Azure Data Factory, HDInsight, Cosmos DB, ML Studio, Azure Analysis Services, Cosmo DB, Cosmos DB
Job PostingView all
2w
Save
Mark Applied
Hide
Data/Analytics Engineer
Los Angeles, California, United States
$10k-$13k/mo OnsiteFull Time
Heluna Health
Heluna Health: Supports population health through program management and fiscal sponsorship.
2+ YOE2+ MgmtLead Databricks architect building governed Medallion Lakehouse, automated ETL/ELT pipelines, Terraform and GitHub CI/CD, strong Python and SQL, experience with regulated PHI/CJI data and public-sector integrations.
Databricks, Terraform, GitHub, GitHub Actions, Unity Catalog, SQL, Python, Pandas, PySpark, Tableau, Power BI
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Data Platform Engineer
San Francisco or Los Angeles or New York City
$190k-$240k/yr HybridFull Time
Tatari
Tatari: A platform for buying and measuring TV advertising campaigns.
3+ YOE3+ years cloud infrastructure/SRE or platform engineering; strong operational discipline; experience with HA architectures, workflow orchestration, Linux scripting, containers, distributed processing, IaC, observability, databases, streaming, and managed data platforms.
AWS, GCP, Azure, Airflow, Bash, Python, Spark, PySpark, Kubernetes, Docker, Kafka, Flink, Terraform, Helm, Clickhouse, Postgres, Redshift, Datadog, Prometheus, Kibana, Databricks
Job PostingView all

Explore Jobs

Expand Your Job Search