14 pyspark data engineer jobs at 8 companies in Gustine, CA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
1mo
Save
Mark Applied
Hide
Data Science Engineer
San Jose or California or United States
$109k-$201k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
8+ YOESenior data engineer with 8+ years experience, distributed data and cloud technologies (Hadoop, Spark, Databricks, S3, EMR), streaming (Kafka/Kinesis), strong SQL and Python/PySpark/Scala skills, CI/CD and orchestration experience, and strong communication.
Hadoop, Hive, Presto, Spark, Databricks, S3, Azure Blob Storage, Notebooks, AWS EMR, Athena, Glue, Delta, Parquet, ORC, Kafka, Kinesis, SQL, Python, PySpark, Scala, Pandas, NumPy, Koalas, APIs, GitHub, Jenkins, Apache Air Flow, Azkaban, AEP, AJO, CJA, Adobe Experience Platform, Adobe Analytics, Customer Journey Analytics, Adobe Journey Optimizer, Collibra, JIRA, Confluence, Copilot, Claude, LLAMA, Databricks Genie, n8n, RAG, MCPs, GenStudio, Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud
2mo
Save
Mark Applied
Hide
Cloud Data Engineer
San Jose, California, United States
$137k-$277k/yr OnsiteFull Time
Hewlett Packard Enterprise
Hewlett Packard EnterpriseNYSE: HPE: Provides edge-to-cloud IT infrastructure and platform services.
4+ YOE4+ years of data engineering experience; strong Python and Java; Spark/Kafka; Kubernetes/Airflow; CI/CD; cloud environments.
Python, Java, Apache Spark, Kafka, Kubernetes, Airflow, CI/CD, Cloud computing environments
2mo
Save
Mark Applied
Hide
Cloud Data Engineer
San Jose, California, United States
$137k-$277k/yr OnsiteFull Time
Hewlett Packard Enterprise
Hewlett Packard EnterpriseNYSE: HPE: Providing global edge-to-cloud infrastructure and IT solutions for businesses.
4+ YOEDegree in Computer Science or Information Systems; Master’s with 2 years data engineering experience; at least 4 years in relevant technologies; Python and Java programming; big data (Spark/Kafka); AI/Generative AI experience; containerization (Kubernetes, Airflow); cloud development.
Python, Java, Apache Spark, Kafka, Containerization, Kubernetes, Airflow, CI/CD, Cloud computing
2mo
Save
Mark Applied
Hide
Cloud Data Engineer
San Jose, California, United States
$137k-$277k/yr OnsiteFull Time
Hewlett Packard Enterprise
Hewlett Packard EnterpriseNYSE: HPE: Provides global edge-to-cloud technology solutions and IT infrastructure services.
4+ YOESenior data engineer to build data pipelines, AI/ML enablement, and CI/CD infrastructure.
Python, Java, Apache Spark, Kafka, Kubernetes, Airflow
1mo
Save
Mark Applied
Hide
Senior Software Engineer - Data Insights
San Jose, California, United States
$323k-$428k/yr HybridFull Time
Roku
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
8+ YOE8+ years software/data engineering; big data tech; Spark/Airflow; distributed systems; SQL; cloud and containers; Python/Java/Scala; AdTech experience preferred.
Apache Spark, Apache Airflow, Druid, StarRocks, Trino, Spring Boot, Looker, Python, Java, Scala, AWS, GCP, Azure, Docker, Kubernetes, Hadoop, Kafka
1mo
Save
Mark Applied
Hide
Senior DevOps Engineer - Data Infra
San Jose or Austin
$144k-$213k/yr HybridFull Time
PayPal
PayPalNASDAQ: PYPL: Global digital payments platform for consumers and merchants.
3+ YOEBachelors in CS or related (or equivalent experience), 3+ years software development and distributed systems experience, experience with AWS, Kafka/SQS, infrastructure-as-code, scripting (Python/Java/Bash), and big data operations.
AWS SQS, Apache Kafka, SQL, NoSQL, AWS CLI, AWS CloudFormation, Terraform, Ansible, Puppet, Lambda, API GW, Python, Java, Bash, AWS S3, AWS DMS, Luigi, AWS EKS, Apache Spark, AWS Glue
3mo
Save
Mark Applied
Hide
Senior AI Data Platform Engineer
San Jose, California, United States
$159k-$302k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
6+ YOE6+ years in data platform engineering; strong Spark/Databricks; real-time streaming; Python/SQL; cloud (AWS/Azure); CI/CD; experience with agentic AI and ML feature stores.
Apache Spark, Databricks, Delta Lake, Iceberg, Hudi, Kafka, Kinesis, Flink, Spark Structured Streaming, Delta Live Tables, Python, SQL, Scala, Java, Go, AWS, Azure, Docker, Kubernetes, CI/CD, LangChain, LangGraph, CrewAI, AutoGen
1mo
Save
Mark Applied
Hide
Software Development Engineer – Data & Cloud Engineering
San Jose, California, United States
$139k-$258k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
3+ YOE3+ years software development experience (Java, C++), experience with PySpark/Spark and cloud platforms (AWS or Azure); BS in CS/Engineering or equivalent experience; strong problem-solving and communication skills.
Java, C++, PySpark, Spark, Hadoop, Databricks, AWS, Azure, Docker, Kubernetes
1mo
Save
Mark Applied
Hide
Senior DevOps Engineer - Data Infra
San Jose or Austin
$144k-$213k/yr HybridFull Time
PayPal
PayPalNASDAQ: PYPL: Digital platform for sending money and processing online payments.
3+ YOE3+ years experience in software/dev or operating distributed systems; bachelor’s/master’s in CS or related; hands-on with AWS, message streaming (Kafka, SQS), SQL/NoSQL, IaC, Python/Java/Bash; strong troubleshooting and communication.
AWS SQS, Apache Kafka, AWS CLI, AWS CloudFormation, Terraform, Ansible, Puppet, Lambda, API GW, Python, Java, Bash, AWS S3, AWS DMS, Luigi, AWS EKS, Apache Spark, AWS Glue, SQL, NoSQL
3w
Save
Mark Applied
Hide
Sr. Data Platform Architect
San Jose or Durham or Mexico City or Bengaluru or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$179k-$299k/yr HybridFull Time
Nutanix
NutanixNASDAQ: NTNX: Sells cloud software and hyperconverged infrastructure for enterprises.
12+ YOE12+ years in data architecture/engineering with 5+ years on large-scale data platforms; expertise in SQL, Apache Spark, Kubernetes, Trino, Dremio, Informatica, CI/CD, security controls, and cloud platforms; Bachelor's required, advanced degree preferred.
SQL, Apache Spark, ETL/ELT, Kubernetes, Trino, Dremio, Informatica, CI/CD
1mo
Save
Mark Applied
Hide
Senior Software Engineer - Back-end/Data Pipeline - VenturaOS
San Jose, California, United States
$125k-$229k/yr OnsiteFull Time
The Trade Desk
The Trade DeskNASDAQ: TTD: Cloud-based programmatic advertising platform for data-driven media buying.
7+ YOE7+ years software development (5+ in data engineering), experience with Vertica/Snowflake/Databricks, Apache Spark, Kafka, Java/Scala/Python, cloud (AWS/GCP/Azure), Kubernetes, data governance, ML pipelines, content metadata and distributed systems.
Vertica, Snowflake, Databricks, Apache Spark, Kafka, Java, Scala, Python, Kubernetes, AWS, GCP, Azure, MLOps
1w
Save
Mark Applied
Hide
Machine Learning Engineer - Demand Forecasting (TikTok Global E-commerce Supply Chain and Logistics)
San Jose, California, United States
$150k-$388k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
Master's degree in CS/ML/Statistics, proven ML experience in demand forecasting, time series methods, big-data preprocessing (e.g., pyspark), model deployment and monitoring, strong analytical and communication skills.
pyspark
2mo
Save
Mark Applied
Hide
Senior Software Engineer, Content Platform
San Jose, California, United States
$300k-$425k/yr HybridFull Time
Roku
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
7+ YOESenior backend engineer with 7+ years in distributed data processing, expert in Java, Spark/Kafka/Flink, and cloud platforms; strong distributed systems and real-time data pipelines.
Java, Akka, Spring Boot, Apache Spark, Kafka, Flink, DynamoDB, Aerospike, AWS, Azure, Google Cloud, Docker, Kubernetes, SQL, NoSQL
1w
Save
Mark Applied
Hide
Senior Software Engineer, Ads Measurement Signal (Multiple Positions)
San Jose, California, United States
$265k-$450k/yr OnsiteFull Time
ByteDance
ByteDance: Developing AI-driven content platforms and mobile applications.
2+ YOEMaster's (+2yrs) or Bachelor's (+5yrs) in CS/Engineering/Data Science/Mathematics or related; 2+ yrs experience designing RCTs, C++, Apache Spark, and Go for large-scale ad measurement; strong communication and analytical skills.
C++, Apache Spark, Go