53 pyspark data engineer jobs at 25 companies in Lathrop, CA
4d
Save
Mark Applied
Hide
Data Engineer
Santa Clara or United States
$110k-$120k/yr RemoteFull Time
Requires Python and PySpark, cloud data platform experience with Snowflake or Databricks, pipeline design and orchestration, Spark tuning, CI/CD, DevOps, version control, and scalable data solution collaboration.
Python, PySpark, Snowflake, Databricks, Terraform, CI/CD, DevOps, QCraft, Microsoft Azure
1mo
Save
Mark Applied
Hide
Data Science Engineer
San Jose or California or United States
$109k-$201k/yr OnsiteFull Time
8+ YOESenior data engineer with 8+ years experience, distributed data and cloud technologies (Hadoop, Spark, Databricks, S3, EMR), streaming (Kafka/Kinesis), strong SQL and Python/PySpark/Scala skills, CI/CD and orchestration experience, and strong communication.
Hadoop, Hive, Presto, Spark, Databricks, S3, Azure Blob Storage, Notebooks, AWS EMR, Athena, Glue, Delta, Parquet, ORC, Kafka, Kinesis, SQL, Python, PySpark, Scala, Pandas, NumPy, Koalas, APIs, GitHub, Jenkins, Apache Air Flow, Azkaban, AEP, AJO, CJA, Adobe Experience Platform, Adobe Analytics, Customer Journey Analytics, Adobe Journey Optimizer, Collibra, JIRA, Confluence, Copilot, Claude, LLAMA, Databricks Genie, n8n, RAG, MCPs, GenStudio, Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud
3w
Save
Mark Applied
Hide
GCP Data Engineer
San Jose, California, United States
RemoteFull Time
4+ YOERequires 4+ years in data engineering, big data, or cloud data platforms; Scala, Apache Spark, GCP, SQL, ETL/ELT, Git, CI/CD, and DevOps expertise; bachelor's or master's degree preferred.
Scala, Apache Spark, Spark SQL, Spark Streaming, DataFrames, Datasets, Google Cloud Platform (GCP), BigQuery, Cloud Storage, Dataproc, Dataflow, Pub/Sub, Composer (Airflow), Cloud Functions, Cloud Run, SQL, Git, Kafka, Python, Docker, Kubernetes, GKE, Terraform, AWS, Azure
4d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
3d
Save
Mark Applied
Hide
Data Engineer/Senior Data Engineer
Santa Clara, California, United States
$130k-$200k/yr HybridFull Time
BS, MS, PhD, or equivalent experience; Python proficiency; scalable data processing or evaluation frameworks; large-scale time-series, event, or geospatial analysis; LLM-powered workflows; strong problem-solving and communication.
Python, Apache Spark, Airflow, Argo Workflows, LangChain, LangGraph, PostGIS, GeoPandas
2mo
Save
Mark Applied
Hide
Data & Analytics Engineer
San Leandro, California, United States
$105k-$125k/yr OnsiteFull Time
3+ YOEBachelor's in a related field or equivalent, 3+ years data engineering or analytics experience, strong SQL, cloud data platform experience (Snowflake, Microsoft Fabric), Python, Microsoft Power BI, SSIS/Azure Data Factory, and experience building ETL/ELT pipelines and analytics-ready datasets.
Snowflake, Microsoft Fabric, SQL Server Integration Services (SSIS), Microsoft Azure Data Factory, SQL, Python, Microsoft Power BI, Microsoft Dynamics, Spark, PySpark, Microsoft 365
3d
Save
Mark Applied
Hide
Data Engineer Intern (Monetization Data) - 2027 Summer
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
OnsiteInternship
Currently pursuing an undergraduate or master's degree in computer science, engineering, or related field; strong SQL, database, programming, data modeling, ETL/ELT, communication, and problem-solving skills.
SQL, Python, Java, Go, Apache Hadoop, Apache Spark, Apache Kafka, Apache Flink, Snowflake, Databricks, BigQuery
3d
Save
Mark Applied
Hide
Data Engineer - USDS (Multiple Positions)
San Jose, California, United States
$150k-$259k/yr OnsiteFull Time
1+ YOEMaster's degree plus 1 year, or bachelor's degree plus 3 years, in a quantitative field; experience with data warehousing, ETL, SQL/Python/Java, data pipelines, and query engines.
Hive, Apache Spark, Hadoop, SQL Server, SQL, Python, Java, HBase, Elasticsearch, ClickHouse
2w
Save
Mark Applied
Hide
Data DevOps Engineer
Santa Clara, California, United States
$200k-$220k/yr OnsiteFull Time
8+ YOE8+ years experience building and operating multitenant Spark and Kafka clusters; infrastructure automation with Jenkins/Ansible/Terraform; strong Python/Scala/Java skills; data processing and database experience.
Apache Spark, Apache Kafka, Jenkins, Ansible, Terraform, Python, Scala, Java
1mo
Save
Mark Applied
Hide
Senior Databricks Developer, SAP S/4 Data Products and Governance
Santa Clara, California, United States
$184k-$288k/yr OnsiteFull Time
12+ YOE12+ years in data engineering or analytics engineering with strong Databricks, PySpark/Apache Spark, SQL, Delta Lake, and SAP S/4HANA or ECC experience; governance and mentoring experience.
Databricks, PySpark, Apache Spark, SQL, Delta Lake, Unity Catalog, Immuta, SAP S/4HANA, SAP ECC, CDS views, ODP/ODQ, SLT, SAP Datasphere, SAP BW, BODS, APIs/OData, Tableau, Power BI, Alteryx, Dataiku, Git, Databricks Asset Bundles
1mo
Save
Mark Applied
Hide
Senior Databricks Developer, SAP S/4 Data Products and Governance
Santa Clara, California, United States
$184k-$288k/yr OnsiteFull Time
12+ YOE12+ years data engineering experience; bachelor's or master's in computer science/IS/business or equivalent; strong Databricks, PySpark, SQL, Delta Lake skills; SAP S/4HANA data experience; Unity Catalog and governance experience.
Databricks, Apache Spark, PySpark, SQL, Delta Lake, Unity Catalog, Immuta, SAP Business Data Cloud, SAP Datasphere, SAP BW, SAP SLT, ODP/ODQ, CDS views, BODS, APIs/OData, Tableau, Power BI, Alteryx, Dataiku, Git, Databricks Asset Bundles
2mo
Save
Mark Applied
Hide
Senior Software Engineer - Data Insights
San Jose, California, United States
$323k-$428k/yr HybridFull Time
8+ YOE8+ years software/data engineering; big data tech; Spark/Airflow; distributed systems; SQL; cloud and containers; Python/Java/Scala; AdTech experience preferred.
Apache Spark, Apache Airflow, Druid, StarRocks, Trino, Spring Boot, Looker, Python, Java, Scala, AWS, GCP, Azure, Docker, Kubernetes, Hadoop, Kafka
4d
Save
Mark Applied
Hide
Senior Data Scientist
Santa Clara, California, United States
$125k-$201k/yr HybridFull Time
5+ YOEBachelor's or master's degree in a technical field and 5+ years in data science, engineering, or analytics. Requires Python, SQL, distributed data frameworks, data modeling, cloud platforms, machine learning, and cross-functional communication.
Python, SQL, Apache Spark, Databricks, AWS, Microsoft Azure, Power BI, Delta Lake, ERP, CRM
2w
Save
Mark Applied
Hide
Principal Data Architect
Pleasanton, California, United States
$114k-$228k/yr OnsiteFull Time
8+ YOE8+ years in data architecture/engineering, 5+ years building enterprise cloud data platforms; deep Databricks, AWS, Azure, SQL and Python experience; data governance, security, and healthcare data knowledge preferred.
Databricks, Delta Lake, Unity Catalog, Databricks Workflows, Databricks SQL, Spark, PySpark, AWS, S3, Glue, IAM, Redshift, Lambda, Kinesis, Lake Formation, Microsoft Azure, Azure Data Lake Storage (ADLS), Azure Data Factory, Synapse, Azure Key Vault, Microsoft Purview, SQL, Python, Kafka, Spark Structured Streaming, EMR/EHR, FHIR, HL7, MLOps
4d
Save
Mark Applied
Hide
Senior Data Scientist
Santa Clara, California, United States
$125k-$201k/yr HybridFull Time
5+ YOEBachelor's or master's degree in a technical field, 5+ years in data science, engineering, or analytics, and advanced Python, SQL, Spark, cloud, statistical modeling, and machine learning expertise.
Python, SQL, Apache Spark, Databricks, AWS, Microsoft Azure, Power BI, Delta Lake, ERP, CRM
1w
Save
Mark Applied
Hide
Data Platform Architect
Fremont, California, United States
$137k-$287k/yr HybridFull Time
12+ YOERequires 12+ years in data architecture or platform engineering, deep Palantir Foundry expertise, cloud data platform experience, governance knowledge, and strong business-facing communication skills.
Palantir Foundry, Palantir Foundry Ontologies, Palantir Code Repositories, Pipeline Builder, Microsoft Fabric, Databricks, Power BI, SQL, Python, PySpark, Foundry Ontology SDK, Snowflake, Azure Synapse, SAP, MES, Kinaxis, APIs
2w
Save
Mark Applied
Hide
Principal Data Architect
Pleasanton, California, United States
$114k-$228k/yr OnsiteFull Time
8+ YOEBachelor's degree required; 8+ years in data/solution architecture; 5+ years designing enterprise cloud data platforms; deep Databricks, AWS, Azure, SQL and Python experience; governance and healthcare data experience preferred.
Databricks, Delta Lake, Unity Catalog, Databricks Workflows, Databricks SQL, Spark, PySpark, Amazon S3, AWS Glue, AWS IAM, Amazon Redshift, AWS Lambda, Amazon Kinesis, AWS Lake Formation, Azure Data Lake Storage (ADLS), Azure Data Factory, Azure Synapse, Azure Key Vault, Microsoft Purview, SQL, Python, Kafka, Spark Structured Streaming
2mo
Save
Mark Applied
Hide
Senior DevOps Engineer - Data Infra
San Jose or Austin
$144k-$213k/yr HybridFull Time
3+ YOE3+ years experience in software/dev or operating distributed systems; bachelor’s/master’s in CS or related; hands-on with AWS, message streaming (Kafka, SQS), SQL/NoSQL, IaC, Python/Java/Bash; strong troubleshooting and communication.
AWS SQS, Apache Kafka, AWS CLI, AWS CloudFormation, Terraform, Ansible, Puppet, Lambda, API GW, Python, Java, Bash, AWS S3, AWS DMS, Luigi, AWS EKS, Apache Spark, AWS Glue, SQL, NoSQL
12h
Save
Mark Applied
Hide
Senior Cloud Data Architect – Azure / Databricks
San Jose, California, United States
OnsiteContract
15+ YOERequires 15+ years of experience, including 7+ years in data engineering or architecture and 3+ years in cloud data architecture, plus a bachelor's degree in computer science.
Azure Data Lake, Azure Data Factory (ADF), Azure Synapse Analytics, Databricks, Apache Spark, Python, SQL
1mo
Save
Mark Applied
Hide
Sr. Data Platform Architect
San Jose or Durham or Mexico City or Bengaluru or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$179k-$299k/yr HybridFull Time
12+ YOE12+ years in data architecture/engineering with 5+ years on large-scale data platforms; expertise in SQL, Apache Spark, Kubernetes, Trino, Dremio, Informatica, CI/CD, security controls, and cloud platforms; Bachelor's required, advanced degree preferred.
SQL, Apache Spark, ETL/ELT, Kubernetes, Trino, Dremio, Informatica, CI/CD
Explore Jobs