38 spark data engineer jobs at 22 companies in Lucama, NC

2mo
Save
Mark Applied
Hide
Staff Data Engineer
Raleigh or United States
$216k/yr RemoteFull Time
Teamworks
Teamworks: Software platform streamlining operations and performance for sports organizations.
10+ YOE10+ years data engineering experience, strong Python, lakehouse and processing engine expertise (Delta Lake/Iceberg/Hudi, Spark/Databricks/Trino/Snowflake), expert AWS (S3, IAM, Glue, EMR, Lambda), Terraform, data modeling, governance, and leadership/mentoring skills.
Python, Delta Lake, Iceberg, Hudi, Spark, Databricks, Trino, Snowflake, AWS, S3, IAM, Glue, EMR, Lambda, Terraform, Claude, Cursor
2d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
Marsh McLennan
Marsh McLennanNYSE: MRSH: Global professional services firm providing risk, strategy, and people solutions.
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1mo
Save
Mark Applied
Hide
Lead Principal Data Engineer
Research Triangle Park or Durham or Raleigh
OnsiteFull Time
Peter Millar
Peter MillarSIX Swiss Exchange: CFR: Designs and sells luxury lifestyle apparel and performance sportswear.
8+ YOE2+ Mgmt8+ years data engineering/architecture experience with 2+ years in a lead/principal capacity; expert SQL and Python, strong Spark/PySpark, Fabric/OneLake platform experience, CI/CD and governance skills.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflows Gen2, Spark, PySpark, SQL, Python, Git, Azure AI, Microsoft Foundry (Azure AI Foundry), Synapse, Azure Data Lake Storage, Azure SQL, Service Bus, Microsoft Purview
1w
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
K&L Gates
K&L Gates: Global law firm providing comprehensive legal and regulatory counsel.
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
1d
Save
Mark Applied
Hide
Data Engineer II
Cary, North Carolina, United States
$90k-$110k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
3+ YOEBachelor's or master's degree or equivalent experience; 3–5 years in data engineering or related work; Python, PySpark, Spark SQL, SQL, Azure Data Factory, Databricks, and Delta Lake experience.
Azure Data Factory, Databricks, PySpark, Spark SQL, SQL, Python, Delta Lake, Lakehouse, pytest, Git, Azure DevOps, CI/CD, Attacama, GenAI
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Raleigh, North Carolina, United States
$92k-$164k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
6+ YOEBachelor's degree or equivalent; 6+ years analytics engineering or data engineering; 5+ years cloud experience; 5+ years programming (Python/Java); 4+ years Databricks/ETL; 4+ years data modeling and advanced SQL; 1+ year AI-driven analytics.
Databricks, Spark, SQL, Python, Power BI, Tableau, Airflow, Azure Data Factory, ETL, Notebooks
2w
Save
Mark Applied
Hide
Senior Data Engineer
Raleigh or North Carolina or Arizona or Texas or Florida
RemoteFull Time
First Citizens Bank
First Citizens BankNasdaq: FCNCA: Provides full-service consumer, commercial, and wealth management banking.
4+ YOEBachelor's+4 years or HS+8 years in data engineering or related; advanced experience with cloud data platforms, Snowflake, ETL/ELT, dbt, Python, SQL; strong analytical and communication skills.
AWS, Azure, GCP, Snowflake, Spark, Python, SQL, dbt, Apache Airflow, Astronomer, DataStage, SAP BODS, SSIS, Informatica, Kafka, Amazon Kinesis, Apache Flink, Qlik Replicate, Snow pipe Streaming, Tableau, Power BI
1w
Save
Mark Applied
Hide
Lead Data Engineer
Raleigh, North Carolina, United States
HybridFull Time
Envestnet
Envestnet: Provides an integrated wealth management technology platform for advisors.
8+ YOE8+ years experience designing and delivering data pipelines and analytics on cloud platforms; expert SQL, Python, PySpark; AWS and big data tech experience; strong communication and leadership skills.
SQL, Python, PySpark, Scala, Bash, Hadoop, Spark, Kafka, RAG, Embedding, Agents, LLMs, AWS, Data Science Studio, Alteryx, Jupyter, Tableau, PowerBI, Gitlab, EMR, Glue, Athena, Batch, Lambda, Cloudwatch, DynamoDB, EC2, Cloudformation, IAM, EDS, Hive, Teradata, Linux, Jira
3w
Save
Mark Applied
Hide
Data Warehouse Contractor
Raleigh or Cupertino or Austin
$60-$70/hr OnsiteContract
Deloitte
Deloitte: Provides professional audit, consulting, advisory, and tax services.
6+ YOE6+ years data engineering experience with hands-on SQL, Spark, and Scala; building and maintaining production data pipelines; experience with lakehouse technologies (Iceberg, Trino, Superset); US work authorization required.
SQL, Spark, Scala, Iceberg, Trino, Superset
2w
Save
Mark Applied
Hide
Manager, Platform Data Architecture
Morrisville or United States
$110k-$150k/yr RemoteFull Time
Thermo Fisher Scientific
Thermo Fisher ScientificNYSE: TMO: Sells equipment and chemicals for scientific research and healthcare.
8+ YOE2+ Mgmt8+ years data architecture/engineering experience, 2+ years managing technical teams, Bachelor’s in CS/IS/Engineering, expertise in modern data stack, data governance, and regulated industries experience preferred.
DBT, Python, Talend, Snowflake, Databricks, SQL, Spark, Hadoop, Kafka, AWS, Azure, GCP
1mo
Save
Mark Applied
Hide
Kite Data & Integration Lead - Sales & Digital
Raleigh or Foster City
$146k-$219k/yr HybridFull Time
Gilead Sciences
Gilead SciencesNASDAQ: GILD: Develops and sells medicines for life-threatening infectious diseases.
6+ YOEBachelor's +8 years or Master's +6 years experience; product ownership for AI/data products; experience with data engineering, model lifecycle, production monitoring, and commercial analytics integrations.
Python, SQL, TypeScript, JavaScript, Go, Rust, GitHub Actions, Docker, Databricks, Spark, Airflow, Tableau, Genie Spaces, Claude Code, GitHub Copilot, Cursor, Cortex AI, Model Context Protocol (MCP), IQVIA, Veeva CRM, MMIT, Model N, Salesforce, Microsoft 365, ServiceNow
1mo
Save
Mark Applied
Hide
Databricks Developer
Raleigh, North Carolina, United States
$100k-$140k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
4+ YOEBachelor in computer science,4+ years experience; expertise with Databricks,Spark/PySpark,Delta Lake,AI/ML,cloud platforms,SQL and Python; strong communication and problem-solving.
Databricks, Spark, PySpark, Delta Lake, Agent Bricks, Unity Catalog, AWS, Azure, GCP, Microsoft Power BI, Tableau, SQL, Python
3w
Save
Mark Applied
Hide
Technical Solutions Engineer - Pre
Dallas or Mountain View or Raleigh or San Bruno
$104k-$156k/yr HybridFull Time
Verily
Verily: Developing data-driven technologies for clinical research and precision health.
6+ YOEBA/BS or equivalent,6+ years in healthcare technology/data engineering/solutions engineering,cloud and coding proficiency,healthcare data standards experience,customer-facing implementation skills.
Google Cloud Platform (GCP), Amazon Web Services (AWS), Microsoft Azure, Python, Golang, Terraform, YAML, SQL, Epic, Cerner, Allscripts, FHIR, HL7, CCD/C-CDA, ICD, SNOMED, LOINC, BigQuery, Snowflake, Databricks, Spark
1mo
Save
Mark Applied
Hide
Senior Delivery Consultant - Data , Professional Services, AWSI HCLS
Boston or Jersey City or Arlington or New York or Denver or Chicago or Mountain View or Raleigh
$154k-$239k/yr HybridFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
5+ YOE5+ years cloud architecture and data engineering experience; bachelor's degree or 7+ years experience; hands-on production data pipeline and platform implementation; experience with modern data platform patterns and ontologies; familiarity with HCLS compliance.
Amazon SageMaker Lakehouse, SageMaker Unified Studio, Amazon S3 Tables, Amazon Redshift, AWS Context, Amazon Bedrock Knowledge Bases, Apache Iceberg, Spark, Databricks, Snowflake, Kafka, AWS Glue Data Catalog, Collibra, Alation
4w
Save
Mark Applied
Hide
AI/ML Engineer, Data Scientist
New York City or Raleigh-Durham or Atlanta or Philadelphia or United States
$150k-$300k/yr HybridFull Time
Sciemo
Sciemo: AI-powered business planning platform for consumer brands.
Proven track record launching ML products to production; expertise in ML systems, GenAI, agents, and graph models; production-grade Python and orchestration experience; strong communication and problem-solving.
Python, PyTorch, TensorFlow, Keras, scikit-learn, SQL, Spark, Airflow, Kedro, ZenML, Flyte, dbt
3w
Save
Mark Applied
Hide
Senior Software Engineer
United States or Raleigh
RemoteFull Time
DomainTools
DomainTools: Provides DNS-based threat intelligence and domain investigation solutions.
5+ YOE5+ years professional development experience (Python, GoLang, Rust), 3+ years cloud (AWS, Docker, Kubernetes) and web-scale data engineering, Kafka, Linux/Unix, strong communication and cross-team coordination.
Python, GoLang, Rust, AWS, Docker, Kubernetes, OpenSearch, Postgres, CockroachDB, Spark, Kafka, Linux/Unix, ElasticSearch, NATS, Apache Airflow, Bash, Scala, C, Hive
3w
Save
Mark Applied
Hide
Software Engineer
Raleigh, North Carolina, United States
OnsiteFull Time
Vadum
Vadum: Develops advanced electronic warfare and defense research solutions.
5+ YOEBachelor's in CS/CE or related, 5+ years experience, ability to obtain security clearance, experience with Java/C/C++/Python, ML frameworks and streaming/data frameworks.
JAVA, C/C++, Python/TensorFlow/Scikit-Learn, MATLAB, Kafka, Spark, Hadoop, C#, Java, C++
1w
Save
Mark Applied
Hide
Lead AI / ML Engineer
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$294k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
6+ YOEBachelor's degree or equivalent experience, 6+ years developing and deploying AI/ML solutions, programming proficiency, experience with ML frameworks, big data, databases, and cloud platforms.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Microsoft Azure, Google Cloud, D3.js, ggplot
2mo
Save
Mark Applied
Hide
Software Engineering Senior Advisor- Hybrid
Raleigh, North Carolina, United States
HybridFull Time
The Cigna Group
The Cigna GroupNYSE: CI: Provides health insurance and pharmacy benefit management services.
5+ YOEBachelor's in CS/EE or related +5 years (or Master's +3 years). Hands-on experience with Python, Java, PL/SQL, APIs, Spark/Databricks, Airflow, Kafka, AWS services, Tableau, Informatica PowerCenter, SQL, CI/CD, data governance, security and mentoring.
Python, Java, PL/SQL, APIs, Airflow, Kafka, Databricks, Tableau, PySpark, Spark, Delta Lake, Notebooks, Informatica PowerCenter, Oracle(SQL), CI/CD, API Gateway, Lambda, EC2, S3, IAM, CloudWatch, Glue, Athena
2mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer III ***Raleigh, NC***
Raleigh, North Carolina, United States
$118k-$220k/yr HybridFull Time
LexisNexis
LexisNexisNYSE: RELX: Global provider of legal, regulatory, and business information analytics.
Design and productionize scalable ML/LLM systems, build RAG and agentic applications, implement hybrid search and data pipelines, and provide technical leadership in system architecture and reliability.
LangChain, LangGraph, AutoGen, Google ADK, Solr, OpenSearch, AWS, S3, DynamoDB, Kafka, SQS, Redis, Python, Rust, Go, Scala, REST, GraphQL, Docker, Kubernetes, ChatGPT/OpenAI, Claude, Gemini, Terraform, CloudFormation, Jenkins, Spark, Hadoop, Dgraph, Neo4j, Neptune