14 pyspark data engineer jobs at 8 companies in Gustine, CA
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
8+ YOESenior data engineer with 8+ years experience, distributed data and cloud technologies (Hadoop, Spark, Databricks, S3, EMR), streaming (Kafka/Kinesis), strong SQL and Python/PySpark/Scala skills, CI/CD and orchestration experience, and strong communication.
Hewlett Packard EnterpriseNYSE: HPE: Providing global edge-to-cloud infrastructure and IT solutions for businesses.
4+ YOEDegree in Computer Science or Information Systems; Master’s with 2 years data engineering experience; at least 4 years in relevant technologies; Python and Java programming; big data (Spark/Kafka); AI/Generative AI experience; containerization (Kubernetes, Airflow); cloud development.
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
8+ YOE8+ years software/data engineering; big data tech; Spark/Airflow; distributed systems; SQL; cloud and containers; Python/Java/Scala; AdTech experience preferred.
PayPalNASDAQ: PYPL: Global digital payments platform for consumers and merchants.
3+ YOEBachelors in CS or related (or equivalent experience), 3+ years software development and distributed systems experience, experience with AWS, Kafka/SQS, infrastructure-as-code, scripting (Python/Java/Bash), and big data operations.
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
6+ YOE6+ years in data platform engineering; strong Spark/Databricks; real-time streaming; Python/SQL; cloud (AWS/Azure); CI/CD; experience with agentic AI and ML feature stores.
Software Development Engineer – Data & Cloud Engineering
San Jose, California, United States
$139k-$258k/yrOnsiteFull Time
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
3+ YOE3+ years software development experience (Java, C++), experience with PySpark/Spark and cloud platforms (AWS or Azure); BS in CS/Engineering or equivalent experience; strong problem-solving and communication skills.
PayPalNASDAQ: PYPL: Digital platform for sending money and processing online payments.
3+ YOE3+ years experience in software/dev or operating distributed systems; bachelor’s/master’s in CS or related; hands-on with AWS, message streaming (Kafka, SQS), SQL/NoSQL, IaC, Python/Java/Bash; strong troubleshooting and communication.
San Jose or Durham or Mexico City or Bengaluru or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$179k-$299k/yrHybridFull Time
NutanixNASDAQ: NTNX: Sells cloud software and hyperconverged infrastructure for enterprises.
12+ YOE12+ years in data architecture/engineering with 5+ years on large-scale data platforms; expertise in SQL, Apache Spark, Kubernetes, Trino, Dremio, Informatica, CI/CD, security controls, and cloud platforms; Bachelor's required, advanced degree preferred.
The Trade DeskNASDAQ: TTD: Cloud-based programmatic advertising platform for data-driven media buying.
7+ YOE7+ years software development (5+ in data engineering), experience with Vertica/Snowflake/Databricks, Apache Spark, Kafka, Java/Scala/Python, cloud (AWS/GCP/Azure), Kubernetes, data governance, ML pipelines, content metadata and distributed systems.
Machine Learning Engineer - Demand Forecasting (TikTok Global E-commerce Supply Chain and Logistics)
San Jose, California, United States
$150k-$388k/yrOnsiteFull Time
TikTok: Global short-form video hosting and social media platform.
Master's degree in CS/ML/Statistics, proven ML experience in demand forecasting, time series methods, big-data preprocessing (e.g., pyspark), model deployment and monitoring, strong analytical and communication skills.
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
7+ YOESenior backend engineer with 7+ years in distributed data processing, expert in Java, Spark/Kafka/Flink, and cloud platforms; strong distributed systems and real-time data pipelines.
Java, Akka, Spring Boot, Apache Spark, Kafka, Flink, DynamoDB, Aerospike, AWS, Azure, Google Cloud, Docker, Kubernetes, SQL, NoSQL
Senior Software Engineer, Ads Measurement Signal (Multiple Positions)
San Jose, California, United States
$265k-$450k/yrOnsiteFull Time
ByteDance: Developing AI-driven content platforms and mobile applications.
2+ YOEMaster's (+2yrs) or Bachelor's (+5yrs) in CS/Engineering/Data Science/Mathematics or related; 2+ yrs experience designing RCTs, C++, Apache Spark, and Go for large-scale ad measurement; strong communication and analytical skills.