117 spark data engineer jobs at 39 companies in Lathrop, CA
1w
Save
Mark Applied
Hide
1w
Lead Data Engineer
Santa Clara, California, United States
OnsiteFull Time
Qcells: Provider of solar modules, energy storage, and EPC services.
10+ YOE10+ years in data engineering or architecture, deep SQL and Python, Azure data services experience, distributed processing (Spark), data modeling, governance, and leadership experience.
Azure Fabric, Data Lake, Data Factory, Synapse, NetSuite, SAP, Salesforce, APIs, Delta Lake, Delta Tables, Snowflake, Kafka, Event Hub, Spark, Python, SQL
PlusAI: AI-based virtual driver software for factory-built autonomous trucks.
1+ YOEMS in CS/Electrical or related, 1+ years software engineering, expertise in Python and SQL, experience with large-scale data processing (Spark, MapReduce, Kafka), AWS (S3, EC2, RDS), and building/maintaining data pipelines.
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
8+ YOE8+ years data engineering experience, strong SQL, Python preferred, expertise with big-data tech (Hadoop, Spark, Kafka, Hive, Airflow), data modeling, and cloud platforms (AWS/GCP).
PayPalNASDAQ: PYPL: Global digital payments platform for consumers and merchants.
8+ YOEMaster's in CS/Engineering plus 8 years (or Bachelor's plus 10 years). Requires data engineering, Python, Shell, SQL, ETL, BigQuery, GCP, Kafka, Airflow, Spark/Hadoop, BI tools, data modeling experience.
Python, Shell, SQL, Tableau, ThoughtSpot, Google BigQuery, Google Cloud Platform, Erwin, Apache Kafka, Apache Airflow, Automic UC4, Spark, Hadoop
Robert HalfNYSE: RHI: Provides specialized staffing and global business consulting services.
5+ YOE5+ years Python/SQL data engineering; 3+ years cloud AWS; ETL/ELT pipelines; Docker/Kubernetes; Terraform/CloudFormation; Spark; CI/CD; collaboration with data science and MLOps; mentoring.
Lam ResearchNASDAQ: LRCX: Designs and manufactures wafer fabrication equipment for the semiconductor industry.
8+ YOEBachelor's degree in CS/CE/Information Systems, 8+ years in data engineering/architecture, strong Microsoft Azure experience, proficiency in Python, SQL, Spark, experience building production-grade data pipelines and modern data architectures for AI/ML.
Microsoft Azure, Microsoft Fabric, Python, SQL, Spark, Azure Databricks, Azure Data Factory, Synapse, Neo4j, Azure AI Search, CI/CD
TikTok: Global short-form video hosting and social media platform.
BS/MS in CS or equivalent; experience with Hadoop, Hive, Spark, Presto, Kafka, ClickHouse, Flink; ETL, data ingestion, schema design and SQL; big data system architecture experience.
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
13+ YOEBachelor's in CS or related, 13+ years data engineering with 6+ years building AWS cloud-native data platforms; expertise with AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
Boston ScientificNYSE: BSX: Developer and manufacturer of innovative medical devices and therapies.
13+ YOEBachelor's degree required; 13+ years data engineering experience including 6+ years designing cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise with AWS data services, Snowflake, Python, Terraform, Bash, Spark/Flink, and governance automation.
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
8+ YOESenior data engineer with 8+ years experience, distributed data and cloud technologies (Hadoop, Spark, Databricks, S3, EMR), streaming (Kafka/Kinesis), strong SQL and Python/PySpark/Scala skills, CI/CD and orchestration experience, and strong communication.
AVEVA: Industrial software for engineering and operational performance management.
3+ YOEBachelor's in a STEM field,minimum 3 years data engineering experience,proficiency with data pipelines,ETL/ELT,SQL,and cloud data platforms (Azure preferred).
Microsoft Azure, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Python, Spark, SQL
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
8+ YOE8+ years experience building data platforms and pipelines, strong SQL and Python, data modeling, data quality, cloud data platforms and analytics for engineering data.
AWS Principal Data Engineer (Valencia, CA, US, 91355)
Valencia or Santa Clara or Arden Hills
$107k-$203k/yrHybridFull Time, Contract
Boston ScientificNYSE: BSX: Developing and manufacturing innovative medical devices for less-invasive treatments.
13+ YOEBachelor's degree required; 13+ years data engineering experience with 6+ years building cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise in AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
Hewlett Packard EnterpriseNYSE: HPE: Providing global edge-to-cloud infrastructure and IT solutions for businesses.
4+ YOEDegree in Computer Science or Information Systems; Master’s with 2 years data engineering experience; at least 4 years in relevant technologies; Python and Java programming; big data (Spark/Kafka); AI/Generative AI experience; containerization (Kubernetes, Airflow); cloud development.
Lam ResearchNASDAQ: LRCX: Manufacturing equipment used to fabricate advanced semiconductor microchips.
8+ YOEBachelor’s degree in CS/CE/IS; 8+ years in data engineering; Azure cloud experience; Python, SQL, Spark; Lakehouse/Medallion patterns; cross-functional collaboration.
Azure, Microsoft Fabric, Azure Databricks, Azure Data Factory, Azure Synapse, Python, SQL, Spark, Neo4j, Vector Search, Retrieval-Augmented Generation
Peterson Holding: Sells Caterpillar equipment and construction technology solutions.
3+ YOEBachelor's in a related field or equivalent, 3+ years data engineering or analytics experience, strong SQL, cloud data platform experience (Snowflake, Microsoft Fabric), Python, Microsoft Power BI, SSIS/Azure Data Factory, and experience building ETL/ELT pipelines and analytics-ready datasets.
Snowflake, Microsoft Fabric, SQL Server Integration Services (SSIS), Microsoft Azure Data Factory, SQL, Python, Microsoft Power BI, Microsoft Dynamics, Spark, PySpark, Microsoft 365
Principal Machine Learning Engineer, Accelerated Apache Spark
Santa Clara, California, United States
$272k-$431k/yrOnsiteFull Time
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
12+ YOEBS/MS/PhD or equivalent; 12+ years ML/DL experience; 5+ years as technical lead; 2+ years with Apache Spark; strong Python and data-science libraries experience; expertise in LLM/GenAI, RL, XGBoost; leadership and deployment experience.
BILLNYSE: BILL: Automated financial operations software for small and midsize businesses.
8+ YOELead architecture and delivery of data platform capabilities (ingest, lake, streaming, feature store, query, graph, search). Requires distributed systems, streaming and batch experience, SQL and Python, and technical leadership.
Hark: An AI focused on next-generation multimodal intelligence and hardware-enabled interfaces.
5+ YOELead data engineering for scalable multi-modal pipelines; 5+ years in data engineering; strong infra experience with Spark/Beam/Flink; collaborate with researchers and engineers.