HiringCafe
Join our community

27 pyspark data engineer jobs at 16 companies in Manteca, CA

1mo
Save
Mark Applied
Hide
Data Science Engineer
San Jose or California or United States
$109k-$201k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
8+ YOESenior data engineer with 8+ years experience, distributed data and cloud technologies (Hadoop, Spark, Databricks, S3, EMR), streaming (Kafka/Kinesis), strong SQL and Python/PySpark/Scala skills, CI/CD and orchestration experience, and strong communication.
Hadoop, Hive, Presto, Spark, Databricks, S3, Azure Blob Storage, Notebooks, AWS EMR, Athena, Glue, Delta, Parquet, ORC, Kafka, Kinesis, SQL, Python, PySpark, Scala, Pandas, NumPy, Koalas, APIs, GitHub, Jenkins, Apache Air Flow, Azkaban, AEP, AJO, CJA, Adobe Experience Platform, Adobe Analytics, Customer Journey Analytics, Adobe Journey Optimizer, Collibra, JIRA, Confluence, Copilot, Claude, LLAMA, Databricks Genie, n8n, RAG, MCPs, GenStudio, Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud
Job PostingView all
3w
Save
Mark Applied
Hide
GCP Data Engineer
San Jose, California, United States
RemoteFull Time
Tredence
Tredence: Providing AI-driven data science and business analytics solutions.
4+ YOERequires 4+ years in data engineering, big data, or cloud data platforms; Scala, Apache Spark, GCP, SQL, ETL/ELT, Git, CI/CD, and DevOps expertise; bachelor's or master's degree preferred.
Scala, Apache Spark, Spark SQL, Spark Streaming, DataFrames, Datasets, Google Cloud Platform (GCP), BigQuery, Cloud Storage, Dataproc, Dataflow, Pub/Sub, Composer (Airflow), Cloud Functions, Cloud Run, SQL, Git, Kafka, Python, Docker, Kubernetes, GKE, Terraform, AWS, Azure
Job PostingView all
3d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
Marsh McLennan
Marsh McLennanNYSE: MRSH: Global professional services firm providing risk, strategy, and people solutions.
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
Job PostingView all
2d
Save
Mark Applied
Hide
Data Engineer Intern (Monetization Data) - 2027 Summer
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
OnsiteInternship
TikTok
TikTok: Global short-form video hosting and social media platform.
Currently pursuing an undergraduate or master's degree in computer science, engineering, or related field; strong SQL, database, programming, data modeling, ETL/ELT, communication, and problem-solving skills.
SQL, Python, Java, Go, Apache Hadoop, Apache Spark, Apache Kafka, Apache Flink, Snowflake, Databricks, BigQuery
Job PostingView all
2d
Save
Mark Applied
Hide
Data Engineer - USDS (Multiple Positions)
San Jose, California, United States
$150k-$259k/yr OnsiteFull Time
TikTok USDS Joint Venture
TikTok USDS Joint Venture: Operates and secures TikTok services for U.S. users.
1+ YOEMaster's degree plus 1 year, or bachelor's degree plus 3 years, in a quantitative field; experience with data warehousing, ETL, SQL/Python/Java, data pipelines, and query engines.
Hive, Apache Spark, Hadoop, SQL Server, SQL, Python, Java, HBase, Elasticsearch, ClickHouse
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Software Engineer - Data Insights
San Jose, California, United States
$323k-$428k/yr HybridFull Time
Roku
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
8+ YOE8+ years software/data engineering; big data tech; Spark/Airflow; distributed systems; SQL; cloud and containers; Python/Java/Scala; AdTech experience preferred.
Apache Spark, Apache Airflow, Druid, StarRocks, Trino, Spring Boot, Looker, Python, Java, Scala, AWS, GCP, Azure, Docker, Kubernetes, Hadoop, Kafka
Job PostingView all
2w
Save
Mark Applied
Hide
Principal Data Architect
Pleasanton, California, United States
$114k-$228k/yr OnsiteFull Time
Abbott
AbbottNYSE: ABT: Manufactures medical devices, diagnostics, and nutritional health products.
8+ YOE8+ years in data architecture/engineering, 5+ years building enterprise cloud data platforms; deep Databricks, AWS, Azure, SQL and Python experience; data governance, security, and healthcare data knowledge preferred.
Databricks, Delta Lake, Unity Catalog, Databricks Workflows, Databricks SQL, Spark, PySpark, AWS, S3, Glue, IAM, Redshift, Lambda, Kinesis, Lake Formation, Microsoft Azure, Azure Data Lake Storage (ADLS), Azure Data Factory, Synapse, Azure Key Vault, Microsoft Purview, SQL, Python, Kafka, Spark Structured Streaming, EMR/EHR, FHIR, HL7, MLOps
Job PostingView all
1w
Save
Mark Applied
Hide
Data Platform Architect
Fremont, California, United States
$137k-$287k/yr HybridFull Time
Lam Research
Lam ResearchNASDAQ: LRCX: Designs and manufactures wafer fabrication equipment for the semiconductor industry.
12+ YOERequires 12+ years in data architecture or platform engineering, deep Palantir Foundry expertise, cloud data platform experience, governance knowledge, and strong business-facing communication skills.
Palantir Foundry, Palantir Foundry Ontologies, Palantir Code Repositories, Pipeline Builder, Microsoft Fabric, Databricks, Power BI, SQL, Python, PySpark, Foundry Ontology SDK, Snowflake, Azure Synapse, SAP, MES, Kinaxis, APIs
Job PostingView all
2w
Save
Mark Applied
Hide
Principal Data Architect
Pleasanton, California, United States
$114k-$228k/yr OnsiteFull Time
Abbott
AbbottNYSE: ABT: Provides medical devices, diagnostics, and science-based nutritional products.
8+ YOEBachelor's degree required; 8+ years in data/solution architecture; 5+ years designing enterprise cloud data platforms; deep Databricks, AWS, Azure, SQL and Python experience; governance and healthcare data experience preferred.
Databricks, Delta Lake, Unity Catalog, Databricks Workflows, Databricks SQL, Spark, PySpark, Amazon S3, AWS Glue, AWS IAM, Amazon Redshift, AWS Lambda, Amazon Kinesis, AWS Lake Formation, Azure Data Lake Storage (ADLS), Azure Data Factory, Azure Synapse, Azure Key Vault, Microsoft Purview, SQL, Python, Kafka, Spark Structured Streaming
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior DevOps Engineer - Data Infra
San Jose or Austin
$144k-$213k/yr HybridFull Time
PayPal
PayPalNASDAQ: PYPL: Digital platform for sending money and processing online payments.
3+ YOE3+ years experience in software/dev or operating distributed systems; bachelor’s/master’s in CS or related; hands-on with AWS, message streaming (Kafka, SQS), SQL/NoSQL, IaC, Python/Java/Bash; strong troubleshooting and communication.
AWS SQS, Apache Kafka, AWS CLI, AWS CloudFormation, Terraform, Ansible, Puppet, Lambda, API GW, Python, Java, Bash, AWS S3, AWS DMS, Luigi, AWS EKS, Apache Spark, AWS Glue, SQL, NoSQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Data Platform Architect
San Jose or Durham or Mexico City or Bengaluru or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$179k-$299k/yr HybridFull Time
Nutanix
NutanixNASDAQ: NTNX: Sells cloud software and hyperconverged infrastructure for enterprises.
12+ YOE12+ years in data architecture/engineering with 5+ years on large-scale data platforms; expertise in SQL, Apache Spark, Kubernetes, Trino, Dremio, Informatica, CI/CD, security controls, and cloud platforms; Bachelor's required, advanced degree preferred.
SQL, Apache Spark, ETL/ELT, Kubernetes, Trino, Dremio, Informatica, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Machine Learning Engineer (Manager IC)
McLean or Cambridge or New York City or San Jose
$197k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
6+ YOE2+ MgmtBachelor's degree, 6+ years building data-intensive distributed systems, 4+ years programming in Python, Scala, or Java, and 2+ years building scalable ML systems. People leadership preferred.
Python, Scala, Java, scikit-learn, PyTorch, Dask, Apache Spark, TensorFlow, AWS, Microsoft Azure, Google Cloud Platform
Job PostingView all
1w
Save
Mark Applied
Hide
Software Engineer
San Jose, California, United States
$138k-$199k/yr HybridFull Time
PayPal
PayPalNASDAQ: PYPL: Global digital payments platform for consumers and merchants.
Master’s degree in computer science, engineering, or related field; experience building scalable microservices, APIs, distributed systems, databases, cloud deployments, security, data processing, and machine learning.
Java 21, Spring Boot 3.x, Spring Data JPA, Python 3.10+, Django REST Framework, Flask RESTful, REST, GraphQL, gRPC, Git, Google Kubernetes Engine, Google Pub/Sub, GCP, MySQL, PostgreSQL, Cloud Spanner, OAuth2, JWT, Hadoop, Apache Spark
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Principal Application Software Engineer- Forward Deployed Engineer
Pleasanton or United States or California
$105k-$264k/yr OnsiteFull Time
Oracle
OracleNYSE: ORCL: Provides cloud infrastructure and enterprise software for global businesses.
10+ YOERequires 10–12+ years in enterprise data platforms, expertise in cloud data engineering and Apache Spark, migration experience, and proficiency with Databricks, Snowflake, Azure, AWS, Kafka, Python, SQL, Scala, or Java.
Databricks, Snowflake, Azure, AWS, Oracle AI Data Platform, Apache Spark, SPARK, Delta Lake, Kafka, Python, SQL, Scala, Java, DataOps, CI/CD, Infrastructure as Code, Lakehouse, Medallion Architecture, OCI, LLMs, Retrieval-Augmented Generation (RAG), MLOps, OCI - DevOps, OCI - Generative AI Agent Hub, OCI Generative AI
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Ads Measurement Signal (Multiple Positions)
San Jose, California, United States
$265k-$450k/yr OnsiteFull Time
ByteDance
ByteDance: Developing AI-driven content platforms and mobile applications.
2+ YOEMaster's (+2yrs) or Bachelor's (+5yrs) in CS/Engineering/Data Science/Mathematics or related; 2+ yrs experience designing RCTs, C++, Apache Spark, and Go for large-scale ad measurement; strong communication and analytical skills.
C++, Apache Spark, Go
Job PostingView all
3w
Save
Mark Applied
Hide
Staff II Software Engineer AI/ML Ops
Pleasanton or New York City or Los Angeles
$245k-$307k/yr HybridFull Time
BlackLine
BlackLineNASDAQ: BL: Provides cloud-based financial close and accounting automation software.
Extensive experience building and operating ML/AI production systems, designing scalable data pipelines, distributed training, model deployment, CI/CD, observability, and cloud infrastructure.
PySpark, FiveTran, Plaid, PyTorch, TensorFlow, scikit-learn, Airflow, Kubeflow, Vertex AI, MLflow, W&B, LangChain, LangGraph, ADK, Prometheus, Grafana, Newrelic, Docker, Kubernetes, Python, Java, Scala, GCP, AWS, Azure, Bash, Apache Airflow
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Full Stack Software Engineer
San Jose, California, United States
$182k-$226k/yr HybridFull Time
Electric Hydrogen
Electric Hydrogen: Manufactures industrial-scale electrolyzers for cost-effective green hydrogen production.
Significant professional software development experience; proficiency with JavaScript/Node.js/React/TypeScript and Python; experience with data pipelines, relational databases, AWS, and on-call support.
JavaScript, Node.js, React, TypeScript, Python, Pandas, PySpark, REST APIs, PostgreSQL, MySQL, Microsoft SQL Server, AWS, Ignition SCADA, CI/CD
Job PostingView all

Explore Jobs

Expand Your Job Search