36 spark data engineer jobs at 20 companies in Wilson, NC

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Raleigh or United States
$216k/yr RemoteFull Time
Teamworks
Teamworks: Software platform streamlining operations and performance for sports organizations.
10+ YOE10+ years data engineering experience, strong Python, lakehouse and processing engine expertise (Delta Lake/Iceberg/Hudi, Spark/Databricks/Trino/Snowflake), expert AWS (S3, IAM, Glue, EMR, Lambda), Terraform, data modeling, governance, and leadership/mentoring skills.
Python, Delta Lake, Iceberg, Hudi, Spark, Databricks, Trino, Snowflake, AWS, S3, IAM, Glue, EMR, Lambda, Terraform, Claude, Cursor
1w
Save
Mark Applied
Hide
Principal Data Engineer - Semantic Layer
Cary or Tampa or New York City or Bridgewater
$130k-$189k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
10+ YOE10+ years in data engineering/architecture with 3+ years in semantic layer/ontology engineering; expertise with OWL/RDF/SPARQL, cloud data platforms, SQL/NoSQL, Python, and Spark; Bachelor's degree required.
OWL, RDF, SPARQL, Stardog, Timbr.ai, AtScale, dbt Semantic Layer, Databricks, Microsoft Fabric, Azure Databricks, Azure Synapse Analytics, Delta Lake, Power BI, Cognos Analytics, JDBC, ODBC, MDX, DAX, REST, GraphQL, Collibra, SQL, NoSQL, Python, Spark, Cypher, HermiT, Pellet, RDFox, Apache Jena, GraphDB, Amazon Neptune
3mo
Save
Mark Applied
Hide
Data Engineer
Cary, North Carolina, United States
$90k-$150k/yr HybridFull Time
GEI Consultants
GEI Consultants: Provides multi-disciplinary engineering and environmental consulting services.
4+ YOE4+ years data engineering; Python/SQL; Azure data services; data governance; CI/CD; Databricks a plus.
Python, SQL, PySpark, Spark, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure SQL, Azure AI Search, Cosmos DB, Databricks, Delta Lake, Unity Catalog, Terraform, Azure DevOps, Power BI
1w
Save
Mark Applied
Hide
Lead Principal Data Engineer
Research Triangle Park or Durham or Raleigh
OnsiteFull Time
Peter Millar
Peter MillarSIX Swiss Exchange: CFR: Designs and sells luxury lifestyle apparel and performance sportswear.
8+ YOE2+ Mgmt8+ years data engineering/architecture experience with 2+ years in a lead/principal capacity; expert SQL and Python, strong Spark/PySpark, Fabric/OneLake platform experience, CI/CD and governance skills.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflows Gen2, Spark, PySpark, SQL, Python, Git, Azure AI, Microsoft Foundry (Azure AI Foundry), Synapse, Azure Data Lake Storage, Azure SQL, Service Bus, Microsoft Purview
2w
Save
Mark Applied
Hide
Principal Data Engineer - Remote
Raleigh or Minneapolis or Washington or United States
$113k-$193k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
8+ YOE8+ years in analytics/data engineering, 6+ years Databricks (Spark, SQL, Python) experience, 5+ years cloud (Azure/GCP/AWS), 4+ years Power BI (DAX/Power Query), and experience delivering enterprise analytics and AI solutions.
Databricks, Spark, SQL, Python, Microsoft Power BI, DAX, Power Query, Azure, GCP, AWS, AI
1mo
Save
Mark Applied
Hide
Data Engineer - Bilingual Mandarin required
Cary or United States
$90k-$130k/yr HybridFull Time
CWILL
CWILL: Unified AI-driven commerce platform for Shopify DTC brands.
1+ YOE1+ years data engineering experience with strong SQL, Python or Java, data ingestion/pipeline and data warehouse skills; ability to work with modern pipeline and warehouse tools; US work authorization required.
SQL, Python, Java, Git, SeaTunnel, Kafka, Flink, Spark, Doris, ClickHouse, Snowflake, BigQuery, Redshift, Databricks, PostgreSQL, DolphinScheduler, StreamPark, Airflow, Dagster, Prefect, dbt, DataHub, Superset, AWS, GCP, Azure, Docker, CI/CD, Terraform, Kubernetes, LLMs
2mo
Save
Mark Applied
Hide
Manager, Data Science
Raleigh, North Carolina, United States
HybridFull Time
McGough
McGough: General contractor providing construction management and facility development services.
6+ YOEBachelor’s in Data Science/Statistics/Mathematics/Engineering; 6–10+ years in data science; proven modeling experience; strong Python; leadership; Git; strong business communication.
Python, Git, SQL, Pandas, Scikit-learn, TensorFlow, Spark
2mo
Save
Mark Applied
Hide
Databricks Engineer
Atlanta or Austin or Boston or Charlotte or Chicago or Dallas or Denver or Detroit or Hartford or Houston or Los Angeles or Miami or Nashville or New Brunswick or New York or Raleigh or Seattle or Tampa or Washington
$90k-$147k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
5+ YOE5+ years data engineering experience, 2+ years building Databricks pipelines and platform features; proficiency with Spark, SQL, Python/Java, EMR/Redshift/Snowflake/BigQuery, orchestration (Airflow/dbt), and data quality tools.
Databricks, Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), Unity Catalog, Auto Loader, Airflow, dbt, Great Expectations, Collibra, Apache Spark, Presto, Amazon EMR, Amazon Redshift, Snowflake, Google BigQuery, SQL, Stored Procedures, Java, Python, PySpark, Databricks Asset Bundles, Terraform, NoSQL Databases, Container Management Systems, GitHub Copilot, Codex, Claude, Cursor, Windsurf
1w
Save
Mark Applied
Hide
Databricks Lead
Raleigh, North Carolina, United States
$100k-$140k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE8+ years data engineering experience, 3–5 years with Databricks/Spark, strong SQL, ETL, data modeling, performance tuning, Python/Scala proficiency, and strong communication skills.
Databricks, Apache Spark, PySpark, SQL, Python, Scala, Azure, Power BI, Delta Lake, MLflow, Model Serving, LLM, RAG
3w
Save
Mark Applied
Hide
Kite Data & Integration Lead - Sales & Digital
Raleigh or Foster City
$146k-$219k/yr HybridFull Time
Gilead Sciences
Gilead SciencesNASDAQ: GILD: Develops and sells medicines for life-threatening infectious diseases.
6+ YOEBachelor's +8 years or Master's +6 years experience; product ownership for AI/data products; experience with data engineering, model lifecycle, production monitoring, and commercial analytics integrations.
Python, SQL, TypeScript, JavaScript, Go, Rust, GitHub Actions, Docker, Databricks, Spark, Airflow, Tableau, Genie Spaces, Claude Code, GitHub Copilot, Cursor, Cortex AI, Model Context Protocol (MCP), IQVIA, Veeva CRM, MMIT, Model N, Salesforce, Microsoft 365, ServiceNow
23h
Save
Mark Applied
Hide
Technical Solutions Engineer - Pre
Dallas or Mountain View or Raleigh or San Bruno
$104k-$156k/yr HybridFull Time
Verily
Verily: Developing data-driven technologies for clinical research and precision health.
6+ YOEBA/BS or equivalent,6+ years in healthcare technology/data engineering/solutions engineering,cloud and coding proficiency,healthcare data standards experience,customer-facing implementation skills.
Google Cloud Platform (GCP), Amazon Web Services (AWS), Microsoft Azure, Python, Golang, Terraform, YAML, SQL, Epic, Cerner, Allscripts, FHIR, HL7, CCD/C-CDA, ICD, SNOMED, LOINC, BigQuery, Snowflake, Databricks, Spark
2mo
Save
Mark Applied
Hide
Machine Learning Engineer, Discovery Recommendations
Cary, North Carolina, United States
OnsiteFull Time
Epic Games
Epic Games: Develops video games and licenses the Unreal game engine.
3-5+ years in production recommendation or ranking systems; Python, PyTorch, Spark; cloud experience; NLP/vision familiarity; strong problem solving.
Python, PyTorch, Spark, AWS, Databricks, Ray, Transformers, TorchRec
2w
Save
Mark Applied
Hide
Senior Delivery Consultant - Data , Professional Services, AWSI HCLS
Boston or Jersey City or Arlington or New York or Denver or Chicago or Mountain View or Raleigh
$154k-$239k/yr HybridFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
5+ YOE5+ years cloud architecture and data engineering experience; bachelor's degree or 7+ years experience; hands-on production data pipeline and platform implementation; experience with modern data platform patterns and ontologies; familiarity with HCLS compliance.
Amazon SageMaker Lakehouse, SageMaker Unified Studio, Amazon S3 Tables, Amazon Redshift, AWS Context, Amazon Bedrock Knowledge Bases, Apache Iceberg, Spark, Databricks, Snowflake, Kafka, AWS Glue Data Catalog, Collibra, Alation
1w
Save
Mark Applied
Hide
Technology Consultant 2
Bentonville or Hartford or Indianapolis or Phoenix or Raleigh or Richardson
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Hands-on GCP, BigQuery, GCS, Apache Spark, Scala/Python, Airflow, and advanced SQL skills; experience implementing CI/CD; bachelor’s degree or equivalent experience; U.S. work authorization required.
GCP, BigQuery, Google Cloud Storage (GCS), Scala, Python, Apache Spark, Apache Airflow, SQL, CI/CD, Power BI
1d
Save
Mark Applied
Hide
AI/ML Engineer, Data Scientist
New York City or Raleigh-Durham or Atlanta or Philadelphia or United States
$150k-$300k/yr HybridFull Time
Sciemo
Sciemo: AI-powered business planning platform for consumer brands.
Proven track record launching ML products to production; expertise in ML systems, GenAI, agents, and graph models; production-grade Python and orchestration experience; strong communication and problem-solving.
Python, PyTorch, TensorFlow, Keras, scikit-learn, SQL, Spark, Airflow, Kedro, ZenML, Flyte, dbt
1d
Save
Mark Applied
Hide
Senior Software Engineer
United States or Raleigh
RemoteFull Time
DomainTools
DomainTools: Provides DNS-based threat intelligence and domain investigation solutions.
5+ YOE5+ years professional development experience (Python, GoLang, Rust), 3+ years cloud (AWS, Docker, Kubernetes) and web-scale data engineering, Kafka, Linux/Unix, strong communication and cross-team coordination.
Python, GoLang, Rust, AWS, Docker, Kubernetes, OpenSearch, Postgres, CockroachDB, Spark, Kafka, Linux/Unix, ElasticSearch, NATS, Apache Airflow, Bash, Scala, C, Hive
1mo
Save
Mark Applied
Hide
Sr. Software Developer
Raleigh, North Carolina, United States
HybridFull Time
Advance Auto Parts
Advance Auto PartsNYSE: AAP: Sells automotive aftermarket parts and accessories to consumers and professionals.
10+ YOEBachelor's in Computer Science or related, 10+ years in cloud/distributed systems, strong Java (8/11/17+), Spring Boot, data pipeline (batch & streaming) experience, hands-on Azure or GCP.
Java, Spring Boot, Spring Cloud, Spring Batch, Kafka, Kafka Streams, Spark, Airflow, Kubernetes, OpenStack, Azure, GCP, CI/CD, Infrastructure as Code, API gateways
1mo
Save
Mark Applied
Hide
Software Engineering Senior Advisor- Hybrid
Raleigh, North Carolina, United States
HybridFull Time
The Cigna Group
The Cigna GroupNYSE: CI: Provides health insurance and pharmacy benefit management services.
5+ YOEBachelor's in CS/EE or related +5 years (or Master's +3 years). Hands-on experience with Python, Java, PL/SQL, APIs, Spark/Databricks, Airflow, Kafka, AWS services, Tableau, Informatica PowerCenter, SQL, CI/CD, data governance, security and mentoring.
Python, Java, PL/SQL, APIs, Airflow, Kafka, Databricks, Tableau, PySpark, Spark, Delta Lake, Notebooks, Informatica PowerCenter, Oracle(SQL), CI/CD, API Gateway, Lambda, EC2, S3, IAM, CloudWatch, Glue, Athena
1mo
Save
Mark Applied
Hide
Associate Director, AI & ML Ops Lead -- Kite Commercial
Raleigh, North Carolina, United States
$169k-$219k/yr HybridFull Time
Gilead Sciences
Gilead SciencesNASDAQ: GILD: Develops and sells medicines for life-threatening infectious diseases.
2+ YOERequires advanced degree and significant experience (examples: PhD+2 yrs, Master+8 yrs, Bachelor+10 yrs). Experience in MLOps, data engineering, model lifecycle, cloud (AWS/Databricks), Python/SQL, CI/CD, containerization, and regulated healthcare compliance.
AWS, Databricks, Spark, MLflow, Airflow, Python, SQL, TypeScript, JavaScript, Go, Rust, GitHub Actions, Docker, SageMaker, Claude Code, GitHub Copilot, Cursor, Cortex AI, IQVIA, Veeva CRM, MMIT, Model N, Salesforce, Microsoft 365, ServiceNow
3mo
Save
Mark Applied
Hide
Director of AI Engineering
Dunwoody or Chicago or Sugar Land or New York or Austin or Cleveland or Los Angeles or Raleigh or San Francisco or Tempe or Tustin
$144k-$205k/yr HybridFull Time
ABM Industries
ABM IndustriesNYSE: ABM: Provides integrated facility, engineering, and infrastructure management solutions.
12+ YOE5+ MgmtML/AI leadership with deep learning, NLP, MLOps, cloud data platforms (Azure, AWS, GCP), Python/TensorFlow/PyTorch, OpenAI/GPT models, big data tech, AI governance and compliance; 12+ years in AI/data/ML with 5+ years leading teams; experience deploying AI at scale.
Python, TensorFlow, PyTorch, Hugging Face, Scikit-learn, SQL, Azure, Synapse, ADF, Databricks, Spark, Kubernetes, Kafka, OpenAI GPT, Gemini, LLaMA, Alteryx, GDPR, CCPA