HiringCafe
Join our community

54 spark engineer jobs at 31 companies in Durham, NC

3w
Save
Mark Applied
Hide
Technical Solutions Engineer - Pre
Dallas or Mountain View or Raleigh or San Bruno
$104k-$156k/yr HybridFull Time
Verily
Verily: Developing data-driven technologies for clinical research and precision health.
6+ YOEBA/BS or equivalent,6+ years in healthcare technology/data engineering/solutions engineering,cloud and coding proficiency,healthcare data standards experience,customer-facing implementation skills.
Google Cloud Platform (GCP), Amazon Web Services (AWS), Microsoft Azure, Python, Golang, Terraform, YAML, SQL, Epic, Cerner, Allscripts, FHIR, HL7, CCD/C-CDA, ICD, SNOMED, LOINC, BigQuery, Snowflake, Databricks, Spark
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Raleigh or United States
$216k/yr RemoteFull Time
Teamworks
Teamworks: Software platform streamlining operations and performance for sports organizations.
10+ YOE10+ years data engineering experience, strong Python, lakehouse and processing engine expertise (Delta Lake/Iceberg/Hudi, Spark/Databricks/Trino/Snowflake), expert AWS (S3, IAM, Glue, EMR, Lambda), Terraform, data modeling, governance, and leadership/mentoring skills.
Python, Delta Lake, Iceberg, Hudi, Spark, Databricks, Trino, Snowflake, AWS, S3, IAM, Glue, EMR, Lambda, Terraform, Claude, Cursor
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Principal Data Engineer
Research Triangle Park or Durham or Raleigh
OnsiteFull Time
Peter Millar
Peter MillarSIX Swiss Exchange: CFR: Designs and sells luxury lifestyle apparel and performance sportswear.
8+ YOE2+ Mgmt8+ years data engineering/architecture experience with 2+ years in a lead/principal capacity; expert SQL and Python, strong Spark/PySpark, Fabric/OneLake platform experience, CI/CD and governance skills.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflows Gen2, Spark, PySpark, SQL, Python, Git, Azure AI, Microsoft Foundry (Azure AI Foundry), Synapse, Azure Data Lake Storage, Azure SQL, Service Bus, Microsoft Purview
Job PostingView all
3w
Save
Mark Applied
Hide
U.S. Data Engineer
Research Triangle Park, North Carolina, United States
OnsiteFull Time
Grifols
GrifolsMadrid Stock Exchange: GRF: Develops plasma-derived medicines and clinical diagnostic solutions.
5+ YOEDesign and build ETL/ELT pipelines using SQL, Python and Spark; 5+ years related experience; project/technical leadership; Bachelor’s degree or equivalent; strong debugging and data quality skills.
SQL, Python, Spark, ADF, Databricks, dbt, Airflow, Azure
Job PostingView all
3w
Save
Mark Applied
Hide
Databricks Developer
Raleigh, North Carolina, United States
$100k-$140k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
4+ YOEBachelor in computer science,4+ years experience; expertise with Databricks,Spark/PySpark,Delta Lake,AI/ML,cloud platforms,SQL and Python; strong communication and problem-solving.
Databricks, Spark, PySpark, Delta Lake, Agent Bricks, Unity Catalog, AWS, Azure, GCP, Microsoft Power BI, Tableau, SQL, Python
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Software Engineer/Developer
Durham, North Carolina, United States
OnsiteFull Time
Fidelity Investments
Fidelity Investments: Provides investment management, retirement planning, and brokerage services.
3+ YOEExperience developing PL/SQL and cloud-based data solutions using AWS, Python, Scala, Spark, and Snowflake; bachelor’s degree plus 3 years (or master’s plus 1 year) in related field required; strong data engineering and ETL skills.
PL/SQL, AWS, DMS, SNS, SQS, Lambda, AWS Glue, Python, Scala, Snowflake, Apache Spark, Tableau, Splunk, DataDog, DynamoDB, S3, Oracle RDS, PostgreSQL, REST, Kanban, SCRUM, CI/CD
Job PostingView all
12h
Save
Mark Applied
Hide
Full Stack Software Engineer (Cloud Based)
Cary, North Carolina, United States
$80k-$110k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
3+ YOEBachelor's degree or related work experience; 3+ years in software development, application support, or data engineering; cloud data platform experience with Azure Databricks, Spark, or Python; strong analytical and communication skills.
Azure Databricks, Spark, Python, PowerShell, Power BI, Azure DevOps, Git, CI/CD, Azure Data Factory
Job PostingView all
1d
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
K&L Gates
K&L Gates: Global law firm providing comprehensive legal and regulatory counsel.
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
Job PostingView all
2mo
Save
Mark Applied
Hide
Machine Learning Engineer
Raleigh, North Carolina, United States
OnsiteFull Time
Vadum
Vadum: Develops advanced electronic warfare and defense research solutions.
5+ YOEBachelor’s in CS/CE or related field; 5+ years; government security clearance or ability to obtain; Python, C/C++, MATLAB; PyTorch/TF/Scikit-Learn; Windows/Linux; Docker/Jenkins/Git/Gerrit/Hibernate/Kubernetes; Kafka/Spark/Hadoop; strong communication and problem-solving.
Python, C/C++, MATLAB, PyTorch, TensorFlow, Scikit-Learn, Docker, Jenkins, Git, Gerrit, Hibernate, Kubernetes, Kafka, Spark, Hadoop, Windows, Linux
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
Research Triangle Park, North Carolina, United States
HybridFull Time
Headwater Science
Headwater Science: Provides data science, analytical software, and research for healthcare.
3+ YOEBachelor's degree or equivalent experience,3+ years software development/data engineering experience,healthcare or clinical data background,cloud (AWS/GCP/Azure) experience,proficiency with R,Python,SQL,and Git/GitLab.
R, Python, SQL, Git, GitLab, GitHub Actions, CI/CD, AWS, GCP, Azure, Langchain, LangGraph, Spark, Dask, UNIX, Linux
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Raleigh or North Carolina or Arizona or Texas or Florida
RemoteFull Time
First Citizens Bank
First Citizens BankNasdaq: FCNCA: Provides full-service consumer, commercial, and wealth management banking.
4+ YOEBachelor's+4 years or HS+8 years in data engineering or related; advanced experience with cloud data platforms, Snowflake, ETL/ELT, dbt, Python, SQL; strong analytical and communication skills.
AWS, Azure, GCP, Snowflake, Spark, Python, SQL, dbt, Apache Airflow, Astronomer, DataStage, SAP BODS, SSIS, Informatica, Kafka, Amazon Kinesis, Apache Flink, Qlik Replicate, Snow pipe Streaming, Tableau, Power BI
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Software Engineer
United States or Raleigh
RemoteFull Time
DomainTools
DomainTools: Provides DNS-based threat intelligence and domain investigation solutions.
5+ YOE5+ years professional development experience (Python, GoLang, Rust), 3+ years cloud (AWS, Docker, Kubernetes) and web-scale data engineering, Kafka, Linux/Unix, strong communication and cross-team coordination.
Python, GoLang, Rust, AWS, Docker, Kubernetes, OpenSearch, Postgres, CockroachDB, Spark, Kafka, Linux/Unix, ElasticSearch, NATS, Apache Airflow, Bash, Scala, C, Hive
Job PostingView all
2w
Save
Mark Applied
Hide
Forward Deployed Engineer
Lafayette or Bloomfield or Raleigh
$72k-$141k/yr HybridFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
7+ YOE7+ years software engineering experience; cloud (AWS/Azure/GCP), computer vision & deep learning, Python, ML model training/deployment, PoC→MVP scaling, MLOps, and enterprise architecture collaboration.
AWS, Azure, GCP, Amazon Web Services Cloud, Google Cloud Platform, PyTorch, TensorFlow, OpenCV, Python, CUDA, Docker, Kubernetes, Spark, Databricks, MLflow, Kubeflow, SageMaker, SageMaker Pipelines, Azure ML, Vertex AI
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
Research Triangle Park, North Carolina, United States
HybridFull Time
Pedestal Health
Pedestal Health: Provides real-world evidence and analytics for life sciences.
3+ YOE3+ years software development experience, strong Python and SQL proficiency, cloud platform experience (AWS/GCP/Azure), familiarity with GitLab/GitHub Actions, strong problem-solving and communication skills.
Python, SQL, AWS, GCP, Azure, GitLab, GitHub Actions, Langchain, LangGraph, Spark, Dask
Job PostingView all
6d
Save
Mark Applied
Hide
Lead Data Engineer
Raleigh, North Carolina, United States
HybridFull Time
Envestnet
Envestnet: Provides an integrated wealth management technology platform for advisors.
8+ YOE8+ years experience designing and delivering data pipelines and analytics on cloud platforms; expert SQL, Python, PySpark; AWS and big data tech experience; strong communication and leadership skills.
SQL, Python, PySpark, Scala, Bash, Hadoop, Spark, Kafka, RAG, Embedding, Agents, LLMs, AWS, Data Science Studio, Alteryx, Jupyter, Tableau, PowerBI, Gitlab, EMR, Glue, Athena, Batch, Lambda, Cloudwatch, DynamoDB, EC2, Cloudformation, IAM, EDS, Hive, Teradata, Linux, Jira
Job PostingView all
1w
Save
Mark Applied
Hide
Java Fullstack Developer
Charlotte or Houston or Raleigh or Richardson or Tempe
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Strong Java (Java 8), Spring/Spring Boot, Hibernate, AngularJS/React, microservices and cloud experience; bachelor's degree or equivalent; analytical, problem-solving, and collaboration skills.
Java, Java 8, Spring, Hibernate, Spring Boot, AngularJS, Angular 1.x, Reactjs, JavaScript, HTML5, CSS3, Microservices, Azure, AWS, GCP, Python, Hadoop, Spark, Hive, Kafka, MongoDB, PostGre, DynamoDB, Oracle, SQL Server, Pivotal Cloud Foundry, OpenShift, Linux, Solaris, Mac OSX
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Open-Source Software Engineer - Apache Cassandra (Morrisville, NC, US)
Morrisville or San Jose or Raleigh or Boston or Seattle
$220k-$265k/yr HybridFull Time
NetApp
NetAppNASDAQ: NTAP: Sells enterprise data storage and cloud management software.
12+ YOEApache Cassandra committer with 12+ years software engineering experience, expert Java in distributed systems, upstream contribution and release management, strong written communication and mentoring skills.
Apache Cassandra, Java, GitHub, Apache Jira, GoCQL, Spark
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Open-Source Software Engineer - Apache Cassandra
Raleigh or San Jose or Seattle or Waltham
$220k-$265k/yr HybridFull Time
NetApp
NetAppNasdaq: NTAP: Provides intelligent data infrastructure for hybrid cloud environments.
12+ YOE12+ years software engineering experience, Apache Cassandra committer status, expert Java skills, deep mastery of Cassandra internals in at least one domain, CEP/Jira/GitHub open-source leadership, strong written communication.
Java, Apache Cassandra, GitHub, Jira, GoCQL, Cassandra Sidecar, Spark, ZSTD, CQL
Job PostingView all
3w
Save
Mark Applied
Hide
AI/ML Engineer, Data Scientist
New York City or Raleigh-Durham or Atlanta or Philadelphia or United States
$150k-$300k/yr HybridFull Time
Sciemo
Sciemo: AI-powered business planning platform for consumer brands.
Proven track record launching ML products to production; expertise in ML systems, GenAI, agents, and graph models; production-grade Python and orchestration experience; strong communication and problem-solving.
Python, PyTorch, TensorFlow, Keras, scikit-learn, SQL, Spark, Airflow, Kedro, ZenML, Flyte, dbt
Job PostingView all
1w
Save
Mark Applied
Hide
Principal Software Engineer, Splunk Analytics and Search
Seattle or Austin or Research Triangle Park or Arlington or Boston or Atlanta or Bellevue
$223k-$295k/yr HybridFull Time
Cisco
CiscoNASDAQ: CSCO: Develops and sells networking hardware and cybersecurity software.
10+ YOEBachelor/Master/PhD-level experience (or equivalent) with 10+ years in designing large-scale distributed systems, production software, search/query processing, cloud platforms, and experience with C++ and SQL.
C++, SQL, AWS, Spark, Presto, Athena, Splunk
Job PostingView all

Explore Jobs

Expand Your Job Search