32 pyspark data engineer jobs at 18 companies in Patterson, CA
1mo
Save
Mark Applied
Hide
Data Science Engineer
San Jose or California or United States
$109k-$201k/yr OnsiteFull Time
8+ YOESenior data engineer with 8+ years experience, distributed data and cloud technologies (Hadoop, Spark, Databricks, S3, EMR), streaming (Kafka/Kinesis), strong SQL and Python/PySpark/Scala skills, CI/CD and orchestration experience, and strong communication.
Hadoop, Hive, Presto, Spark, Databricks, S3, Azure Blob Storage, Notebooks, AWS EMR, Athena, Glue, Delta, Parquet, ORC, Kafka, Kinesis, SQL, Python, PySpark, Scala, Pandas, NumPy, Koalas, APIs, GitHub, Jenkins, Apache Air Flow, Azkaban, AEP, AJO, CJA, Adobe Experience Platform, Adobe Analytics, Customer Journey Analytics, Adobe Journey Optimizer, Collibra, JIRA, Confluence, Copilot, Claude, LLAMA, Databricks Genie, n8n, RAG, MCPs, GenStudio, Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud
1w
Save
Mark Applied
Hide
Data DevOps Engineer
Santa Clara, California, United States
$200k-$220k/yr OnsiteFull Time
8+ YOE8+ years experience building and operating multitenant Spark and Kafka clusters; infrastructure automation with Jenkins/Ansible/Terraform; strong Python/Scala/Java skills; data processing and database experience.
Apache Spark, Apache Kafka, Jenkins, Ansible, Terraform, Python, Scala, Java
1w
Save
Mark Applied
Hide
Data Validation & QA Engineer (Databricks, Power BI & Analytics) IRC301014
San Jose, California, United States
$95k-$100k/yr HybridFull Time
4+ YOEBachelor's degree required,4+ years in data QA or BI QA,proficient with SQL and PySpark,Databricks and Delta Lake experience,Power BI and DAX knowledge,and defect tracking with Jira.
Databricks, Delta Lake, PySpark, SQL, Power BI, DAX, Jira
3w
Save
Mark Applied
Hide
Senior Databricks Developer, SAP S/4 Data Products and Governance
Santa Clara, California, United States
$184k-$288k/yr OnsiteFull Time
12+ YOE12+ years in data engineering or analytics engineering with strong Databricks, PySpark/Apache Spark, SQL, Delta Lake, and SAP S/4HANA or ECC experience; governance and mentoring experience.
Databricks, PySpark, Apache Spark, SQL, Delta Lake, Unity Catalog, Immuta, SAP S/4HANA, SAP ECC, CDS views, ODP/ODQ, SLT, SAP Datasphere, SAP BW, BODS, APIs/OData, Tableau, Power BI, Alteryx, Dataiku, Git, Databricks Asset Bundles
3w
Save
Mark Applied
Hide
Senior Databricks Developer, SAP S/4 Data Products and Governance
Santa Clara, California, United States
$184k-$288k/yr OnsiteFull Time
12+ YOE12+ years data engineering experience; bachelor's or master's in computer science/IS/business or equivalent; strong Databricks, PySpark, SQL, Delta Lake skills; SAP S/4HANA data experience; Unity Catalog and governance experience.
Databricks, Apache Spark, PySpark, SQL, Delta Lake, Unity Catalog, Immuta, SAP Business Data Cloud, SAP Datasphere, SAP BW, SAP SLT, ODP/ODQ, CDS views, BODS, APIs/OData, Tableau, Power BI, Alteryx, Dataiku, Git, Databricks Asset Bundles
2mo
Save
Mark Applied
Hide
Senior Software Engineer - Data Insights
San Jose, California, United States
$323k-$428k/yr HybridFull Time
8+ YOE8+ years software/data engineering; big data tech; Spark/Airflow; distributed systems; SQL; cloud and containers; Python/Java/Scala; AdTech experience preferred.
Apache Spark, Apache Airflow, Druid, StarRocks, Trino, Spring Boot, Looker, Python, Java, Scala, AWS, GCP, Azure, Docker, Kubernetes, Hadoop, Kafka
6d
Save
Mark Applied
Hide
Principal Data Architect
Pleasanton, California, United States
$114k-$228k/yr OnsiteFull Time
8+ YOE8+ years in data architecture/engineering, 5+ years building enterprise cloud data platforms; deep Databricks, AWS, Azure, SQL and Python experience; data governance, security, and healthcare data knowledge preferred.
Databricks, Delta Lake, Unity Catalog, Databricks Workflows, Databricks SQL, Spark, PySpark, AWS, S3, Glue, IAM, Redshift, Lambda, Kinesis, Lake Formation, Microsoft Azure, Azure Data Lake Storage (ADLS), Azure Data Factory, Synapse, Azure Key Vault, Microsoft Purview, SQL, Python, Kafka, Spark Structured Streaming, EMR/EHR, FHIR, HL7, MLOps
6d
Save
Mark Applied
Hide
Principal Data Architect
Pleasanton, California, United States
$114k-$228k/yr OnsiteFull Time
8+ YOEBachelor's degree required; 8+ years in data/solution architecture; 5+ years designing enterprise cloud data platforms; deep Databricks, AWS, Azure, SQL and Python experience; governance and healthcare data experience preferred.
Databricks, Delta Lake, Unity Catalog, Databricks Workflows, Databricks SQL, Spark, PySpark, Amazon S3, AWS Glue, AWS IAM, Amazon Redshift, AWS Lambda, Amazon Kinesis, AWS Lake Formation, Azure Data Lake Storage (ADLS), Azure Data Factory, Azure Synapse, Azure Key Vault, Microsoft Purview, SQL, Python, Kafka, Spark Structured Streaming
1mo
Save
Mark Applied
Hide
Senior DevOps Engineer - Data Infra
San Jose or Austin
$144k-$213k/yr HybridFull Time
3+ YOE3+ years experience in software/dev or operating distributed systems; bachelor’s/master’s in CS or related; hands-on with AWS, message streaming (Kafka, SQS), SQL/NoSQL, IaC, Python/Java/Bash; strong troubleshooting and communication.
AWS SQS, Apache Kafka, AWS CLI, AWS CloudFormation, Terraform, Ansible, Puppet, Lambda, API GW, Python, Java, Bash, AWS S3, AWS DMS, Luigi, AWS EKS, Apache Spark, AWS Glue, SQL, NoSQL
5d
Save
Mark Applied
Hide
Software Engineer, Data Foundation – USDS
San Jose, California, United States
$137k-$360k/yr OnsiteFull Time
1+ YOEBS/MS in CS or engineering; 1+ year distributed systems experience; proficiency in Java, Scala, C++, or Python; experience with big data engines (Spark, ClickHouse, Doris) preferred.
Apache Spark, Kafka, ClickHouse, Doris, Java, Scala, C++, Python
1mo
Save
Mark Applied
Hide
Sr. Data Platform Architect
San Jose or Durham or Mexico City or Bengaluru or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$179k-$299k/yr HybridFull Time
12+ YOE12+ years in data architecture/engineering with 5+ years on large-scale data platforms; expertise in SQL, Apache Spark, Kubernetes, Trino, Dremio, Informatica, CI/CD, security controls, and cloud platforms; Bachelor's required, advanced degree preferred.
SQL, Apache Spark, ETL/ELT, Kubernetes, Trino, Dremio, Informatica, CI/CD
3w
Save
Mark Applied
Hide
Principal IT Software Engineer
Santa Clara, California, United States
$167k-$271k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; strong SQL, ETL, cloud (GCP) and BI skills; ability to design scalable data pipelines; experience with Spark/Airflow; demonstrated use of AI/GenAI in data workflows.
SQL, Apache Spark, Apache Airflow, GCP, Dataflow, DataProc, BigQuery, Cloud Composer, Kafka, Python, Scala, Tableau
1mo
Save
Mark Applied
Hide
Senior Software Engineer - Back-end/Data Pipeline - VenturaOS
San Jose, California, United States
$125k-$229k/yr OnsiteFull Time
7+ YOE7+ years software development (5+ in data engineering), experience with Vertica/Snowflake/Databricks, Apache Spark, Kafka, Java/Scala/Python, cloud (AWS/GCP/Azure), Kubernetes, data governance, ML pipelines, content metadata and distributed systems.
Vertica, Snowflake, Databricks, Apache Spark, Kafka, Java, Scala, Python, Kubernetes, AWS, GCP, Azure, MLOps
4d
Save
Mark Applied
Hide
Software Engineer/Senior Software Engineer, Data & ML Platform
Santa Clara, California, United States
$135k-$200k/yr HybridFull Time
Hands-on production Kubernetes experience, GPU/ML workload scheduling knowledge, GitOps and infrastructure-as-code exposure, strong ownership and distributed data/workflow experience; BS/MS/PhD or equivalent experience in CS or related field.
Kubernetes, Argo CD, Helm, Kustomize, Ray, Kubeflow, Delta Lake, Apache Iceberg, Apache Spark, Argo Workflows
3mo
Save
Mark Applied
Hide
Engineering Manager, Data Platform Orchestration
Los Gatos, California, United States
$436k-$791k/yr OnsiteFull Time
Experienced engineering leader with platform engineering background; experience running highly reliable, high-scale systems, building teams, partnering cross-functionally, and making technical trade-offs. Knowledge of orchestration and big data technologies desirable.
Maestro, Iceberg, Apache Spark, Trino/Presto, Snowflake, BigQuery, Amazon RedShift, Druid, LanceDB, Pensive, Nightingale
3w
Save
Mark Applied
Hide
Machine Learning Engineer - Demand Forecasting (TikTok Global E-commerce Supply Chain and Logistics)
San Jose, California, United States
$150k-$388k/yr OnsiteFull Time
Master's degree in CS/ML/Statistics, proven ML experience in demand forecasting, time series methods, big-data preprocessing (e.g., pyspark), model deployment and monitoring, strong analytical and communication skills.
pyspark
2w
Save
Mark Applied
Hide
Lead Principal Application Software Engineer- Forward Deployed Engineer
Pleasanton or California or United States
$105k-$264k/yr OnsiteFull Time
10+ YOE10+ years designing and delivering enterprise data platforms; expert with Oracle AI Data Platform, Databricks, Snowflake, Apache Spark, Delta Lake, cloud platforms, and stakeholder communication.
Oracle AI Data Platform, OCI services, Databricks, Snowflake, Apache Spark, Delta Lake, Azure, AWS, Kafka, Python, SQL, Scala, Java, OCI - DevOps, OCI Generative AI, OCI - Generative AI Agent Hub
3w
Save
Mark Applied
Hide
Senior Software Engineer, Ads Measurement Signal (Multiple Positions)
San Jose, California, United States
$265k-$450k/yr OnsiteFull Time
2+ YOEMaster's (+2yrs) or Bachelor's (+5yrs) in CS/Engineering/Data Science/Mathematics or related; 2+ yrs experience designing RCTs, C++, Apache Spark, and Go for large-scale ad measurement; strong communication and analytical skills.
C++, Apache Spark, Go
2w
Save
Mark Applied
Hide
Staff II Software Engineer AI/ML Ops
Pleasanton or New York City or Los Angeles
$245k-$307k/yr HybridFull Time
Extensive experience building and operating ML/AI production systems, designing scalable data pipelines, distributed training, model deployment, CI/CD, observability, and cloud infrastructure.
PySpark, FiveTran, Plaid, PyTorch, TensorFlow, scikit-learn, Airflow, Kubeflow, Vertex AI, MLflow, W&B, LangChain, LangGraph, ADK, Prometheus, Grafana, Newrelic, Docker, Kubernetes, Python, Java, Scala, GCP, AWS, Azure, Bash, Apache Airflow
13h
Save
Mark Applied
Hide
Senior Full Stack Software Engineer
San Jose, California, United States
$182k-$226k/yr HybridFull Time
Significant professional software development experience; proficiency with JavaScript/Node.js/React/TypeScript and Python; experience with data pipelines, relational databases, AWS, and on-call support.
JavaScript, Node.js, React, TypeScript, Python, Pandas, PySpark, REST APIs, PostgreSQL, MySQL, Microsoft SQL Server, AWS, Ignition SCADA, CI/CD
Explore Jobs