HiringCafe
Join our community

56 pyspark data engineer jobs at 32 companies in Arcadia, CA

1mo
Save
Mark Applied
Hide
Data Engineer
New York or Los Angeles or San Francisco
$140k-$175k/yr HybridFull Time
Regard
Regard: A that builds AI-powered software to improve clinical documentation and advance patient care.
3+ YOEBS or equivalent, 3+ years data engineering experience, Python and SQL proficiency, experience with PySpark and distributed data processing, AWS experience preferred, LLM-assisted development familiarity, and willingness to participate in on-call support.
S3, Apache Iceberg, EMR, PySpark, Dagster, Kubernetes, ClickHouse, PostgreSQL, FastAPI, Metabase, Python, SQL, AWS, AWS Athena, EHR, OMOP CDM, HIPAA, LLM
Job PostingView all
4w
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
Cotality
Cotality: Provides property data, analytics, and workflow intelligence solutions.
7+ YOE7+ years IT experience, bachelor's in CS/Engineering or equivalent, expertise in cloud data platforms, Python/PySpark, data modeling, big data technologies, graph DBs, orchestration tools, and enterprise data architecture.
AWS, Google Cloud Platform (GCP), Python, PySpark, Neo4j, Google Spanner, Hadoop, Spark, Elasticsearch, Google Cloud Dataflow, Apache Beam, Apache Airflow, BMAD, Spec Kit, SQL, NoSQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica, California, United States
$142k-$190k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOE5+ years data engineering experience building large data pipelines; strong SQL, Python/PySpark; experience with Snowflake/Redshift, Databricks, Spark, Airflow, AWS; data modeling and performance tuning; Bachelor's degree or equivalent.
AWS, Databricks, Snowflake, Spark, Airflow, Python, PySpark, SQL, Redshift, EMR
Job PostingView all
4w
Save
Mark Applied
Hide
Senior Data Engineer
Costa Mesa, California, United States
$166k-$220k/yr OnsiteFull Time
Anduril Industries
Anduril Industries: Defense technology building autonomous military hardware and software.
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
Palantir Foundry, SQLMesh, Athena, Apache Iceberg, Flyte, Python, Spark, PySpark, SQL, dbt, AWS, Azure, GCP, Tableau
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Los Angeles, California, United States
$130k-$170k/yr HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
6+ YOE2+ MgmtLead data engineering role requiring 6-8 years of experience, Databricks stack, SQL, Python, PySpark, data warehousing, Airflow, cloud platforms, and leadership responsibilities.
Databricks, SQL, Python, PySpark, Airflow, Cron, AWS, GCP, Azure, Tableau, Power BI, Hadoop, Hive, HBase, Pig, Spark
Job PostingView all
6d
Save
Mark Applied
Hide
Data Engineer, Performance Marketing
Agoura Hills, California, United States
$89k-$136k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
3+ YOE3–5 years in data/analytics engineering, strong SQL and Python, experience with Databricks/AWS/Snowflake/Google Cloud, Spark/PySpark, ETL/ELT pipelines, and modern lakehouse architectures.
Databricks, AWS, Snowflake, Google Cloud, GitHub Copilot, Claude Code, Codex, Databricks Genie, Python, PySpark, SQL
Job PostingView all
6d
Save
Mark Applied
Hide
Data Engineer, Performance Marketing
Agoura Hills, California, United States
$89k-$136k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
3+ YOE3–5 years data engineering experience; strong SQL, Python, Spark/PySpark; experience with Databricks, AWS, Snowflake or Google Cloud; familiarity with AI tools and modern lakehouse architectures.
Python, PySpark, SQL, Spark, Claude Code, Codex, GitHub Copilot, Databricks Genie, Databricks, AWS, Snowflake, Google Cloud, SFTP, APIs
Job PostingView all
3w
Save
Mark Applied
Hide
Principal, Data Engineer
Irvine or Dallas
$155k-$195k/yr OnsiteFull Time
Cotality
Cotality: Provider of property intelligence, data, and analytics solutions.
7+ YOE7+ years IT experience in data architecture; hands-on GCP, Dataflow, BigQuery, Python/PySpark, Airflow; experience with graph and SQL/NoSQL databases; strong communication and leadership skills.
Google Cloud Platform (GCP), Dataflow, BigQuery, Python, PySpark, Neo4j, Google Spanner, Apache Airflow, AWS, Hadoop, Spark, Elasticsearch, Apache Beam, BMAD, Spec Kit, SQL, NoSQL
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or San Francisco
$170k-$200k/yr HybridFull Time
Tatari
Tatari: A platform for buying and measuring TV advertising campaigns.
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
Versant
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or New York City or United States or India
$185k-$200k/yr HybridFull Time
Fuel Cycle
Fuel Cycle: Cloud platform for market research and customer feedback analysis.
5+ YOE5+ years building production Databricks lakehouses; strong PySpark, Python, SQL; experience with Unity Catalog, Delta Lake, dbt, orchestrators (Dagster/Prefect/Workflows), and AWS data services.
Databricks, Unity Catalog, Delta Live Tables, Databricks SQL, Workflows, Delta Lake, dbt, PySpark, Python, MySQL, PostgreSQL, Dagster, Prefect, Databricks Workflows, Databricks Vector Search, pgvector, Amazon OpenSearch, Amazon Bedrock, AgentCore, Strands, OpenMetadata, S3, IAM, Databricks Asset Bundles, Terraform, Apache Iceberg, AWS Glue, Athena, DynamoDB, SQL
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Data Engineer - MSS
Irvine, California, United States
$110k-$140k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOEHands-on experience with Databricks, dbt, Python, PySpark, Spark, and SQL; 6+ years experience; proven track record in data platform migration to Databricks Lakehouse; leadership and mentoring experience.
Databricks, dbt, Python, PySpark, Spark, SQL, Delta Lake, Unity Catalog, Databricks Workflows, Structured Streaming, Medallion Architecture, Airflow, EBT
Job PostingView all
5d
Save
Mark Applied
Hide
Data Engineer - Data Architecture & Engineering
Los Angeles or Denver or Seattle or Orange County
$91k-$165k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
4+ YOE4+ years building and optimizing production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java, strong communication and problem-solving skills.
Amazon Redshift, Snowflake, GoogleBigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
El Segundo, California, United States
$140k-$150k/yr OnsiteFull Time
Fabletics
Fabletics: Fabletics sells activewear through a membership-based subscription model.
6+ YOESenior data engineer with 6+ years in data pipelines, SQL, Python, Databricks; Airflow, Terraform; data governance; retail/e-commerce familiarity a plus.
Databricks, PySpark, SQL, Airflow, GitHub Actions, Terraform, Snowflake, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Data Engineer, R&D
Irvine or California or United States
$121k-$171k/yr OnsiteFull Time
Edwards Lifesciences
Edwards LifesciencesNYSE: EW: Designs and manufactures medical devices for structural heart disease.
6+ YOEBachelor's in engineering/science plus 6+ years data engineering experience; experience with Databricks and Snowflake; data governance and validation experience in regulated environments.
Databricks, Snowflake, GCP, AWS, Apache Spark, Kafka, Flink, Delta Lake, Iceberg, Airflow, dbt, HL7, FHIR, IHE
Job PostingView all
1d
Save
Mark Applied
Hide
Data Engineer 5B
North Carolina or Los Angeles
$45k-$57k/yr HybridFull Time
Genpact
GenpactNYSE: G: Provides business process management and digital transformation services.
Develop and maintain data ingestion, ETL, storage and retrieval solutions; ensure data quality; collaborate with data scientists; evaluate new data technologies. Bachelor's in related field and technical certifications preferred.
Databricks, Apache Spark, Microsoft Azure, Oracle Database, Riversand
Job PostingView all
1w
Save
Mark Applied
Hide
Associate Data Engineer
Los Angeles, California, United States
$75k-$90k/yr OnsiteFull Time
Cosm
Cosm: Operates immersive entertainment venues and develops shared reality technology.
0+ YOE0-2 years building data systems; experience with Apache Spark, Databricks, AWS; Bachelor's in CS or related or equivalent experience preferred; strong communication and critical thinking.
Databricks, AWS, Apache Spark, Python, SQL, PostHog, Mixpanel
Job PostingView all
5d
Save
Mark Applied
Hide
Data Solutions Engineer
Cleveland or Cincinnati or Columbus or Philadelphia or Washington or Orlando or Atlanta or Austin or Dallas or Houston or Los Angeles or Seattle
$120k-$165k/yr OnsiteFull Time
BakerHostetler
BakerHostetler: Provides legal counsel and litigation services for corporate clients.
5+ YOEBachelor's in CS/IT,5+ years building data solutions; expertise with Azure data platform, Microsoft Fabric, Power Platform, data modeling, medallion architecture, MDM, DevOps, and strong communication skills.
Azure Data Factory, Azure Data Lake, Azure Data Lake Storage, Azure Synapse Analytics, Azure SQL Database, PostgreSQL, Azure Blob Storage, Azure Databricks, Apache Spark, Apache Airflow, Azure Logic Apps, Azure DevOps, Power Automate, REST API, Azure OpenAI, Document Intelligence, Delta Lake, Microsoft Fabric, Lakehouse, Power Apps, Power BI, Git
Job PostingView all
1mo
Save
Mark Applied
Hide
Data/Analytics Engineer
Los Angeles, California, United States
$10k-$13k/mo OnsiteFull Time
Heluna Health
Heluna Health: Supports population health through program management and fiscal sponsorship.
2+ YOE2+ MgmtLead Databricks architect building governed Medallion Lakehouse, automated ETL/ELT pipelines, Terraform and GitHub CI/CD, strong Python and SQL, experience with regulated PHI/CJI data and public-sector integrations.
Databricks, Terraform, GitHub, GitHub Actions, Unity Catalog, SQL, Python, Pandas, PySpark, Tableau, Power BI
Job PostingView all
3h
Save
Mark Applied
Hide
Data Engineer
Pasadena, California, United States
$106k-$143k/yr OnsiteFull Time
Sunbelt Controls
Sunbelt Controls: Provides building automation and systems integration for energy-efficient facilities.
Implement and manage scalable data infrastructure; build ETL/ELT pipelines; strong Python and SQL; cloud and Spark experience; Docker/Kubernetes, Airflow, Databricks, Fabric, BI tools; data governance and security.
Python, SQL, Docker, Kubernetes, AWS, Azure, Google Cloud, Apache Spark, Databricks, Apache Airflow, Fabric, Power BI, Tableau, LLMs
Job PostingView all

Explore Jobs

Expand Your Job Search