25 spark data engineer jobs at 16 companies in Elon, NC

1mo
Save
Mark Applied
Hide
Principal Data Engineer
Durham, North Carolina, United States
OnsiteFull Time
Fidelity Investments
Fidelity Investments: Provides investment management, retirement planning, and brokerage services.
3+ YOEBachelor's in CS/Engineering/IT/IS + 5 years, or Master’s + 3 years; expertise in data warehouse/BI, cloud (AWS, Snowflake), ETL, CI/CD, Python/Spark, Oracle/PLSQL, Informatica, control-m and observability tools.
Jenkins, Stash, Concourse, Artifactory, Oracle SQL, PL/SQL, Snowflake, Amazon Web Services (AWS), Python, Spark, Informatica, Informatica Data Quality IDQ, Address doctor, Docker Container, Hive, Impala, Kafka, Scala, Spark SQL, Alation, Collibra, JUnit, JMeter, Datadog, Control-M, Jenkinscore, Terracore, Bitbucket, GitHub
3mo
Save
Mark Applied
Hide
Data Engineer
Cary, North Carolina, United States
$90k-$150k/yr HybridFull Time
GEI Consultants
GEI Consultants: Provides multi-disciplinary engineering and environmental consulting services.
4+ YOE4+ years data engineering; Python/SQL; Azure data services; data governance; CI/CD; Databricks a plus.
Python, SQL, PySpark, Spark, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure SQL, Azure AI Search, Cosmos DB, Databricks, Delta Lake, Unity Catalog, Terraform, Azure DevOps, Power BI
3w
Save
Mark Applied
Hide
Lead Principal Data Engineer
Research Triangle Park or Durham or Raleigh
OnsiteFull Time
Peter Millar
Peter MillarSIX Swiss Exchange: CFR: Designs and sells luxury lifestyle apparel and performance sportswear.
8+ YOE2+ Mgmt8+ years data engineering/architecture experience with 2+ years in a lead/principal capacity; expert SQL and Python, strong Spark/PySpark, Fabric/OneLake platform experience, CI/CD and governance skills.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflows Gen2, Spark, PySpark, SQL, Python, Git, Azure AI, Microsoft Foundry (Azure AI Foundry), Synapse, Azure Data Lake Storage, Azure SQL, Service Bus, Microsoft Purview
2w
Save
Mark Applied
Hide
U.S. Data Engineer
Research Triangle Park, North Carolina, United States
OnsiteFull Time
Grifols
GrifolsMadrid Stock Exchange: GRF: Develops plasma-derived medicines and clinical diagnostic solutions.
5+ YOEDesign and build ETL/ELT pipelines using SQL, Python and Spark; 5+ years related experience; project/technical leadership; Bachelor’s degree or equivalent; strong debugging and data quality skills.
SQL, Python, Spark, ADF, Databricks, dbt, Airflow, Azure
2w
Save
Mark Applied
Hide
Senior Data Engineer
Cary, North Carolina, United States
$115k-$135k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
5+ YOEBachelor's in Computer Science or related, 5+ years data engineering, Azure Data Factory, Azure Functions, Databricks, Cosmos DB, Synapse, SQL and Scala experience, Agile Scrum knowledge.
Hadoop, Azure Data Factory, Azure Functions, Databricks, Azure Cosmos DB, Azure Synapse, SQL, Scala, HDFS, YARN, Spark, Hive, HBase, Kafka, Shell, Python, Solr, JANUS, NiFi, Event Hub, CI/CD
1mo
Save
Mark Applied
Hide
Data Engineer - Bilingual Mandarin required
Cary or United States
$90k-$130k/yr HybridFull Time
CWILL
CWILL: Unified AI-driven commerce platform for Shopify DTC brands.
1+ YOE1+ years data engineering experience with strong SQL, Python or Java, data ingestion/pipeline and data warehouse skills; ability to work with modern pipeline and warehouse tools; US work authorization required.
SQL, Python, Java, Git, SeaTunnel, Kafka, Flink, Spark, Doris, ClickHouse, Snowflake, BigQuery, Redshift, Databricks, PostgreSQL, DolphinScheduler, StreamPark, Airflow, Dagster, Prefect, dbt, DataHub, Superset, AWS, GCP, Azure, Docker, CI/CD, Terraform, Kubernetes, LLMs
1d
Save
Mark Applied
Hide
Data Engineer
Research Triangle Park, North Carolina, United States
HybridFull Time
Pedestal Health
Pedestal Health: Provides real-world evidence and analytics for life sciences.
3+ YOE3+ years software development experience, strong Python and SQL proficiency, cloud platform experience (AWS/GCP/Azure), familiarity with GitLab/GitHub Actions, strong problem-solving and communication skills.
Python, SQL, AWS, GCP, Azure, GitLab, GitHub Actions, Langchain, LangGraph, Spark, Dask
2d
Save
Mark Applied
Hide
Data Engineer
Research Triangle Park, North Carolina, United States
HybridFull Time
Headwater Science
Headwater Science: Provides data science, analytical software, and research for healthcare.
3+ YOEBachelor's degree or equivalent experience,3+ years software development/data engineering experience,healthcare or clinical data background,cloud (AWS/GCP/Azure) experience,proficiency with R,Python,SQL,and Git/GitLab.
R, Python, SQL, Git, GitLab, GitHub Actions, CI/CD, AWS, GCP, Azure, Langchain, LangGraph, Spark, Dask, UNIX, Linux
1mo
Save
Mark Applied
Hide
Sr. Data Platform Architect
San Jose or Durham or Mexico City or Bengaluru or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$179k-$299k/yr HybridFull Time
Nutanix
NutanixNASDAQ: NTNX: Sells cloud software and hyperconverged infrastructure for enterprises.
12+ YOE12+ years in data architecture/engineering with 5+ years on large-scale data platforms; expertise in SQL, Apache Spark, Kubernetes, Trino, Dremio, Informatica, CI/CD, security controls, and cloud platforms; Bachelor's required, advanced degree preferred.
SQL, Apache Spark, ETL/ELT, Kubernetes, Trino, Dremio, Informatica, CI/CD
2d
Save
Mark Applied
Hide
Manager, Platform Data Architecture
Morrisville or United States
$110k-$150k/yr RemoteFull Time
Thermo Fisher Scientific
Thermo Fisher ScientificNYSE: TMO: Sells equipment and chemicals for scientific research and healthcare.
8+ YOE2+ Mgmt8+ years data architecture/engineering experience, 2+ years managing technical teams, Bachelor’s in CS/IS/Engineering, expertise in modern data stack, data governance, and regulated industries experience preferred.
DBT, Python, Talend, Snowflake, Databricks, SQL, Spark, Hadoop, Kafka, AWS, Azure, GCP
3w
Save
Mark Applied
Hide
AI Automation Developer & Data Scientist
Morrisville, North Carolina, United States
$100k-$135k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
5+ YOEU.S. citizen with 5+ years experience in data science/automation, proficiency with LLM/ML frameworks, cloud compute (AWS/GCP/Azure), data streaming/warehousing, CI/CD and SOC detection workflows; FedRAMP experience preferred.
LangChain, LangGraph, TensorFlow, PyTorch, scikit-learn, AWS, GCP, Azure, Spark, Hadoop, Kafka, Synapse, Data Lake, Google BigQuery, Dataflow, Cloud Storage, MongoDB, Cassandra, Apache Airflow, Prefect, Dagster, Splunk SOAR, Kinesis, CI/CD
3mo
Save
Mark Applied
Hide
Machine Learning Engineer, Discovery Recommendations
Cary, North Carolina, United States
OnsiteFull Time
Epic Games
Epic Games: Develops video games and licenses the Unreal game engine.
3-5+ years in production recommendation or ranking systems; Python, PyTorch, Spark; cloud experience; NLP/vision familiarity; strong problem solving.
Python, PyTorch, Spark, AWS, Databricks, Ray, Transformers, TorchRec
4w
Save
Mark Applied
Hide
Practice Manager - AI & Data
Greensboro or Broomfield or Troy
$160k-$190k/yr OnsiteFull Time
ALTEN
ALTENEuronext Paris: ATE: Provides engineering and technology consulting services to industrial clients.
12+ YOE5+ Mgmt12–15 years in consulting/engineering/technology with 5+ years leading AI/Data teams; experience with generative AI, ML frameworks, data engineering, cloud AI services, MLOps; bachelor's in CS/Data/AI or related required.
LLMs, RAG, Python, TensorFlow, PyTorch, Scikit-learn, Spark, Databricks, Azure AI, AWS SageMaker, AWS Bedrock, Google Vertex AI, MLflow, Kubeflow, containerization, orchestration
1mo
Save
Mark Applied
Hide
Senior Full-stack Software Engineer – Verification Data and Visualization Platform
Santa Clara or Westford or Durham
$152k-$288k/yr HybridFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
3+ YOEExperience building full-stack web apps with JavaScript/TypeScript, modern frontend frameworks, Java microservices, distributed systems, Kafka/Flink/Spark streaming, Redis, and scalable data pipelines. BS+5 yrs or MS+3 yrs required (or equivalent experience).
Kafka Streams, Apache Flink, Spark Streaming, Apache Kafka, JavaScript, TypeScript, Redis, Elasticsearch, Kibana, Logstash, Elastic Stack, LangChain, OpenTelemetry, Docker, Kubernetes, Grafana, Java
4w
Save
Mark Applied
Hide
Distinguished Technologist, Distributed Systems & Agentic Query Optimization
San Jose or Houston or Durham or Andover
$170k-$413k/yr HybridFull Time
Hewlett Packard Enterprise
Hewlett Packard EnterpriseNYSE: HPE: Provides edge-to-cloud IT infrastructure and platform services.
15+ YOE15+ years engineering and architectural leadership experience building and operating large distributed systems and cloud platform services; strong data engineering, distributed query, cloud-native, and AI-first prototyping skills.
Spark, Kafka, Parquet, Go, Java, BigQuery, AWS, GCP, Azure
4w
Save
Mark Applied
Hide
Distinguished Technologist, Distributed Systems & Agentic Query Optimization
San Jose or Houston or Durham or Andover
$170k-$413k/yr HybridFull Time
Hewlett Packard Enterprise
Hewlett Packard EnterpriseNYSE: HPE: Provides global edge-to-cloud technology solutions and IT infrastructure services.
15+ YOE15+ years designing and operating large distributed systems and cloud platform services; expertise in distributed query engines, federated data, cloud-native architecture; strong communication and technical leadership skills.
Spark, Kafka, Parquet, Go, Java, BigQuery, AWS, GCP, Azure
4w
Save
Mark Applied
Hide
Senior AI Technologist
Raleigh or Albuquerque
HybridFull Time
Applied Research Associates
Applied Research Associates: Provides scientific research and engineering solutions for complex problems.
8+ YOEBachelor's in STEM and 8+ years engineering experience with 3+ years supporting AI/NLP/RAG; experience with data preparation, vector DBs, Kubernetes, cloud AI (Azure Foundry, AWS Bedrock), Python/Golang/Typescript; strong communication.
MCP, Kubernetes, Azure Foundry, AWS Bedrock, Python, Golang, Typescript, Pandas, Spark, Airflow, dbt, git, CI/CD, GitOps