HiringCafe
Join our community

29 pyspark data engineer jobs at 21 companies in Lancaster, CA

1mo
Save
Mark Applied
Hide
Data Engineer
New York or Los Angeles or San Francisco
$140k-$175k/yr HybridFull Time
Regard
Regard: A that builds AI-powered software to improve clinical documentation and advance patient care.
3+ YOEBS or equivalent, 3+ years data engineering experience, Python and SQL proficiency, experience with PySpark and distributed data processing, AWS experience preferred, LLM-assisted development familiarity, and willingness to participate in on-call support.
S3, Apache Iceberg, EMR, PySpark, Dagster, Kubernetes, ClickHouse, PostgreSQL, FastAPI, Metabase, Python, SQL, AWS, AWS Athena, EHR, OMOP CDM, HIPAA, LLM
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Los Angeles, California, United States
$130k-$170k/yr HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
6+ YOE2+ MgmtLead data engineering role requiring 6-8 years of experience, Databricks stack, SQL, Python, PySpark, data warehousing, Airflow, cloud platforms, and leadership responsibilities.
Databricks, SQL, Python, PySpark, Airflow, Cron, AWS, GCP, Azure, Tableau, Power BI, Hadoop, Hive, HBase, Pig, Spark
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or San Francisco
$170k-$200k/yr HybridFull Time
Tatari
Tatari: A platform for buying and measuring TV advertising campaigns.
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
Versant
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or New York City or United States or India
$185k-$200k/yr HybridFull Time
Fuel Cycle
Fuel Cycle: Cloud platform for market research and customer feedback analysis.
5+ YOE5+ years building production Databricks lakehouses; strong PySpark, Python, SQL; experience with Unity Catalog, Delta Lake, dbt, orchestrators (Dagster/Prefect/Workflows), and AWS data services.
Databricks, Unity Catalog, Delta Live Tables, Databricks SQL, Workflows, Delta Lake, dbt, PySpark, Python, MySQL, PostgreSQL, Dagster, Prefect, Databricks Workflows, Databricks Vector Search, pgvector, Amazon OpenSearch, Amazon Bedrock, AgentCore, Strands, OpenMetadata, S3, IAM, Databricks Asset Bundles, Terraform, Apache Iceberg, AWS Glue, Athena, DynamoDB, SQL
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer - Data Architecture & Engineering
Los Angeles or Denver or Seattle or Orange County
$91k-$165k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
4+ YOE4+ years building and optimizing production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java, strong communication and problem-solving skills.
Amazon Redshift, Snowflake, GoogleBigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
Job PostingView all
1d
Save
Mark Applied
Hide
Copy of Senior Data Engineer
Pasadena, California, United States
$143k-$175k/yr RemoteFull Time
Spokeo
Spokeo: People search engine that aggregates public records and data.
7+ YOE7+ years in production data engineering; 5+ years with AWS, EMR, Python, Spark, SQL, data modeling, and Airflow; 2+ years with non-relational databases; bachelor's degree required.
Amazon Web Services (AWS), Apache Airflow, PySpark, Apache Spark, Amazon EMR, Amazon S3, Amazon DynamoDB, Elasticsearch, Python, SQL
Job PostingView all
1w
Save
Mark Applied
Hide
Data Solutions Engineer
Cleveland or Cincinnati or Columbus or Philadelphia or Washington or Orlando or Atlanta or Austin or Dallas or Houston or Los Angeles or Seattle
$120k-$165k/yr OnsiteFull Time
BakerHostetler
BakerHostetler: Provides legal counsel and litigation services for corporate clients.
5+ YOEBachelor's in CS/IT,5+ years building data solutions; expertise with Azure data platform, Microsoft Fabric, Power Platform, data modeling, medallion architecture, MDM, DevOps, and strong communication skills.
Azure Data Factory, Azure Data Lake, Azure Data Lake Storage, Azure Synapse Analytics, Azure SQL Database, PostgreSQL, Azure Blob Storage, Azure Databricks, Apache Spark, Apache Airflow, Azure Logic Apps, Azure DevOps, Power Automate, REST API, Azure OpenAI, Document Intelligence, Delta Lake, Microsoft Fabric, Lakehouse, Power Apps, Power BI, Git
Job PostingView all
1mo
Save
Mark Applied
Hide
Data/Analytics Engineer
Los Angeles, California, United States
$10k-$13k/mo OnsiteFull Time
Heluna Health
Heluna Health: Supports population health through program management and fiscal sponsorship.
2+ YOE2+ MgmtLead Databricks architect building governed Medallion Lakehouse, automated ETL/ELT pipelines, Terraform and GitHub CI/CD, strong Python and SQL, experience with regulated PHI/CJI data and public-sector integrations.
Databricks, Terraform, GitHub, GitHub Actions, Unity Catalog, SQL, Python, Pandas, PySpark, Tableau, Power BI
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer
Indianapolis or Woodland Hills or Ashburn or Costa Mesa or Miami or Richmond or Chicago or New York City or Seattle or Grand Prairie or Chicago or Atlanta or Iselin or Overland Park or Tampa or Woburn
$127k-$229k/yr HybridFull Time
Elevance Health
Elevance HealthNYSE: ELV: Provides health insurance plans and integrated healthcare services.
8+ YOEBS/BA and 8+ years technical experience in systems administration/security, data platform architecture, Microsoft Fabric/Azure, data pipelines, SQL/Python, and regulatory compliance (HIPAA,NIST,SOC2).
Microsoft Fabric, Apache Spark, SQL, Python, PySpark, Spark, Delta Lake, Parquet, REST APIs, JSON, Git, Azure DevOps, CI/CD
Job PostingView all
2mo
Save
Mark Applied
Hide
Enterprise Data Engineering Manager, FVP
San Diego or Irvine or Los Angeles or Centennial or Las Vegas or Kansas City or Edison or Omaha
$145k-$180k/yr OnsiteFull Time
Axos Financial
Axos FinancialNYSE: AX: Provides digital-first banking and diverse financial services to customers.
10+ YOE7+ Mgmt10+ years in data engineering leadership; SQL Server; cloud data ecosystems (GCP/AWS/Azure); Databricks and Spark; PySpark; Python; SQL; ETL/ELT tools (Fivetran, dbt); leadership and collaboration skills.
Databricks, Spark, PySpark, Python, SQL, Fivetran, dbt, GCP, Azure, AWS, BigQuery, Snowflake, SQL Server
Job PostingView all
4w
Save
Mark Applied
Hide
Analytics Engineer Sr Director
Woodland Hills, California, United States
$237k/yr HybridFull Time
Farmers Insurance
Farmers InsuranceSIX Swiss Exchange: ZURN: Provides insurance for vehicles, homes, and businesses.
7+ YOE3+ MgmtBachelor's in CS/CE or related,7+ years experience with large-scale data engineering and analytics,3+ years managing technical resources,experience in P&C insurance,proficiency with SQL,Python,PySpark,AWS and ETL tools.
SQL, Python, PySpark, AWS Lambda, EMR, Sagemaker, Informatica, Ab Initio, Autosys, Jenkins, Terraform, AWS Step, Databricks, Snowflake, Erwin, ER/Studio
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior BI & Analytics Developer
San Ramon or Atlanta or Century City or Los Angeles or El Segundo or Duluth
$119k-$162k/yr OnsiteFull Time
Armanino
Armanino: Provides accounting, tax, and consulting services to diverse organizations.
3+ YOE3+ years in analytics/BI/data engineering; hands-on Microsoft Fabric, Microsoft Power BI, SQL, Python/PySpark, and Git; strong dimensional modeling, governance, and stakeholder collaboration skills.
Microsoft Fabric, Microsoft Power BI, SQL, Python, PySpark, DAX, Git
Job PostingView all
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
2mo
Save
Mark Applied
Hide
Full Stack Developer, Business Systems
Los Angeles, California, United States
$120k-$150k/yr OnsiteFull Time
Apex
Apex: Mass-manufactures standardized satellite buses for commercial and government use.
2+ YOEU.S. Person required. Bachelor's in data science/computer science/engineering/mathematics or equivalent. 2+ years Palantir Foundry and 2+ years Python/PySpark or SQL. ERP implementation experience and data integration/profiling skills.
Palantir Foundry, Python, PySpark, SQL
Job PostingView all
3d
Save
Mark Applied
Hide
Software Engineer II, Data Platform
San Diego or Los Angeles
$150k-$225k/yr HybridFull Time
Sony Interactive Entertainment
Sony Interactive EntertainmentNYSE: SONY: Provides PlayStation gaming hardware, software, and digital network services.
3+ YOEBachelor's in Computer Science,3+ years building scalable distributed systems,proficiency in Scala/Java/Python,cloud experience (AWS preferred),event streaming and distributed processing familiarity,CI/CD and on-call experience.
Scala, Java, Python, AWS, GCP, Kafka, Kinesis, SQS, Apache Spark, Apache Flink, Databricks
Job PostingView all
2w
Save
Mark Applied
Hide
Machine Learning Engineer II
Diamond Bar, California, United States
$100k-$146k/yr OnsiteFull Time
Niagara Bottling
Niagara Bottling: Manufactures and distributes private label bottled water and beverages.
5+ YOEBachelor's in a quantitative field required (Master/PhD preferred); strong Python and ML framework experience (PyTorch/TensorFlow); production MLOps, cloud, and industrial data experience; preferred 5+ years in ML/industrial AI.
Azure Machine Learning Studio, Azure Machine Learning, XGBoost, Random Forests, LSTMs, Autoencoders, Isolation Forests, One-Class SVMs, Dynamic Time Warping, PCA, MLflow, Kubeflow, Docker, Kubernetes, PySpark, Databricks, Python, C++, C#, JavaScript, R, PyTorch, TensorFlow, Scikit-Learn, NumPy, Pandas, SciPy, SQL, NoSQL, InfluxDB, TimescaleDB, Google Cloud Platform, AWS, GCP, LangChain, LlamaIndex, Microsoft Semantic Kernel, AutoGen, CrewAI, Azure AI Foundry, OpenAI API, Hive, Pig, MATLAB, Weka, Matplotlib
Job PostingView all
2w
Save
Mark Applied
Hide
Staff II Software Engineer AI/ML Ops
Pleasanton or New York City or Los Angeles
$245k-$307k/yr HybridFull Time
BlackLine
BlackLineNASDAQ: BL: Provides cloud-based financial close and accounting automation software.
Extensive experience building and operating ML/AI production systems, designing scalable data pipelines, distributed training, model deployment, CI/CD, observability, and cloud infrastructure.
PySpark, FiveTran, Plaid, PyTorch, TensorFlow, scikit-learn, Airflow, Kubeflow, Vertex AI, MLflow, W&B, LangChain, LangGraph, ADK, Prometheus, Grafana, Newrelic, Docker, Kubernetes, Python, Java, Scala, GCP, AWS, Azure, Bash, Apache Airflow
Job PostingView all
20h
Save
Mark Applied
Hide
Software Engineer Project Intern (Global E-Commerce Search Infrastructure) - 2026 Start
Seattle or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
OnsiteInternship, Full Time
TikTok
TikTok: Global short-form video hosting and social media platform.
Currently pursuing a bachelor's or master's degree in a technical discipline; available for a 12-week full-time Fall 2026 internship; proficiency in C++, Go, Java, or Python; knowledge of data structures, algorithms, and system design.
C++, Go, Java, Python, Flink, Kafka, Spark, Lucene, Elasticsearch, Vespa, RocksDB, Redis, Apache Spark, FAISS, HNSW
Job PostingView all
3mo
Save
Mark Applied
Hide
Azure Databricks Senior Architect
Los Angeles, California, United States
OnsiteFull Time
Tiger Analytics
Tiger Analytics: Provides AI and advanced analytics consulting for global enterprises.
18+ YOE18+ years in data solutions, manufacturing domain expertise, Azure and GCP, Informatica, Kubernetes, Python (ETL), Master’s in Software Engineering.
Azure, GCP, Hadoop, Hive, Spark, Informatica, Kubernetes, Python, Tableau, SQL, Databricks, PySpark
Job PostingView all

Explore Jobs

Expand Your Job Search