65 pyspark data engineer jobs at 36 companies in Venice, CA
1mo
Save
Mark Applied
Hide
1mo
Data Engineer
New York or Los Angeles or San Francisco
$140k-$175k/yrHybridFull Time
Regard: A that builds AI-powered software to improve clinical documentation and advance patient care.
3+ YOEBS or equivalent, 3+ years data engineering experience, Python and SQL proficiency, experience with PySpark and distributed data processing, AWS experience preferred, LLM-assisted development familiarity, and willingness to participate in on-call support.
Cotality: Provides property data, analytics, and workflow intelligence solutions.
7+ YOE7+ years IT experience, bachelor's in CS/Engineering or equivalent, expertise in cloud data platforms, Python/PySpark, data modeling, big data technologies, graph DBs, orchestration tools, and enterprise data architecture.
AWS, Google Cloud Platform (GCP), Python, PySpark, Neo4j, Google Spanner, Hadoop, Spark, Elasticsearch, Google Cloud Dataflow, Apache Beam, Apache Airflow, BMAD, Spec Kit, SQL, NoSQL
United States or Foster City or Orange County or Morristown
RemoteFull Time
Bridgepointe Technologies: Vendor-agnostic IT strategy and technology procurement services.
5+ YOERequires 5+ years in data engineering, advanced SQL, Python, Spark/PySpark, Microsoft Fabric, Azure data services, APIs, data modeling, CI/CD, Git, and Azure DevOps; bachelor's degree or equivalent experience.
Microsoft Fabric, Lakehouse, Warehouse, Data Pipelines, Notebooks, OneLake, Git, Azure DevOps, Spark, PySpark, SQL, Python, Azure, Delta Lake, Parquet, REST APIs, JSON, Power BI, DP-600, DP-700
Anduril Industries: Defense technology building autonomous military hardware and software.
3+ YOE3+ years in data engineering, strong Python and SQL skills, experience with Spark/PySpark, dbt, SQLMesh, Palantir Foundry, cloud platforms (AWS/Azure/GCP), data orchestration (Flyte), and data formats (Apache Iceberg).
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
5+ YOE5+ years data engineering experience building large data pipelines; strong SQL, Python/PySpark; experience with Snowflake/Redshift, Databricks, Spark, Airflow, AWS; data modeling and performance tuning; Bachelor's degree or equivalent.
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
6+ YOE2+ MgmtLead data engineering role requiring 6-8 years of experience, Databricks stack, SQL, Python, PySpark, data warehousing, Airflow, cloud platforms, and leadership responsibilities.
Adastra: Global provider of data, AI, and digital transformation consulting services.
5+ YOEBachelor's degree in a related field and 5+ years of data engineering experience. Requires Databricks, PySpark, Spark SQL, SQL, Python, cloud, data modeling, ETL/ELT, Git, CI/CD, and testing expertise.
Databricks, Databricks Lakehouse Platform, PySpark, Spark SQL, Delta Lake, Databricks Workflows, Unity Catalog, SQL, Python, Git, CI/CD, AWS, Azure, GCP, Power BI, Structured Streaming, Auto Loader, Kafka, Kinesis, Braze
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
3+ YOE3–5 years in data/analytics engineering, strong SQL and Python, experience with Databricks/AWS/Snowflake/Google Cloud, Spark/PySpark, ETL/ELT pipelines, and modern lakehouse architectures.
Databricks, AWS, Snowflake, Google Cloud, GitHub Copilot, Claude Code, Codex, Databricks Genie, Python, PySpark, SQL
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
3+ YOE3–5 years data engineering experience; strong SQL, Python, Spark/PySpark; experience with Databricks, AWS, Snowflake or Google Cloud; familiarity with AI tools and modern lakehouse architectures.
Python, PySpark, SQL, Spark, Claude Code, Codex, GitHub Copilot, Databricks Genie, Databricks, AWS, Snowflake, Google Cloud, SFTP, APIs
Cotality: Provider of property intelligence, data, and analytics solutions.
7+ YOE7+ years IT experience in data architecture; hands-on GCP, Dataflow, BigQuery, Python/PySpark, Airflow; experience with graph and SQL/NoSQL databases; strong communication and leadership skills.
Tatari: A platform for buying and measuring TV advertising campaigns.
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
Los Angeles Lakers: Operates the Los Angeles Lakers professional basketball team.
2+ YOEBachelor's in statistics, computer science, engineering, or related field or equivalent experience; 2–4 years in data engineering; strong Python, SQL, database, cloud pipeline, orchestration, and Spark skills.
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOEHands-on experience with Databricks, dbt, Python, PySpark, Spark, and SQL; 6+ years experience; proven track record in data platform migration to Databricks Lakehouse; leadership and mentoring experience.
Slalom: Provides business and technology consulting and software engineering services.
4+ YOE4+ years building and optimizing production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java, strong communication and problem-solving skills.
Fabletics: Fabletics sells activewear through a membership-based subscription model.
6+ YOESenior data engineer with 6+ years in data pipelines, SQL, Python, Databricks; Airflow, Terraform; data governance; retail/e-commerce familiarity a plus.
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Seattle or Toronto or Santa Barbara or San Diego
$127k-$190k/yrRemoteFull Time
Invoca: AI platform for conversation intelligence and revenue execution.
5+ YOE5+ years in data or software engineering; advanced Python, SQL, Databricks, Spark, and data modeling; experience with orchestration, streaming, cloud infrastructure, data quality, ML datasets, and privacy; bachelor's degree or equivalent.
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yrRemoteFull Time
Marsh McLennanNYSE: MRSH: Global professional services firm providing risk, strategy, and people solutions.
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
Rivian and Volkswagen Group Technologies: A joint venture developing software, cloud, and connectivity solutions for next-generation electric vehicles.
3+ YOEBachelor's or Master's in CS/Data Science, 3+ years building large-scale data processing systems, Databricks and Terraform experience, cloud (AWS/GCP/Azure) familiarity, PySpark preferred, strong communication and problem-solving.
Edwards LifesciencesNYSE: EW: Designs and manufactures medical devices for structural heart disease.
6+ YOEBachelor's in engineering/science plus 6+ years data engineering experience; experience with Databricks and Snowflake; data governance and validation experience in regulated environments.
Databricks, Snowflake, GCP, AWS, Apache Spark, Kafka, Flink, Delta Lake, Iceberg, Airflow, dbt, HL7, FHIR, IHE