228 llm engineer jobs at 122 companies in North Carolina
2mo
Save
Mark Applied
Hide
Principal Engineer - Context Engineering & LLM Optimization
Charlotte, North Carolina, United States
OnsiteFull Time
10+ YOE10+ years engineering experience, 5+ years designing enterprise systems, 2+ years with LLM/RAG/vector search; strong prompt, context, retrieval, and evaluation expertise; bachelor’s in CS/Engineering/Info Systems/Applied Math.
OpenAI, Azure OpenAI, Anthropic, Google Gemini, Meta Llama, Retrieval-Augmented Generation (RAG)
2mo
Save
Mark Applied
Hide
Principal Engineer - Context Engineering & LLM Optimization
Charlotte, North Carolina, United States
OnsiteFull Time
10+ YOE10+ years software/data/platform/AI engineering experience, 5+ years designing large-scale enterprise systems, 2+ years with LLM/RAG/vector search, experience with OpenAI/Azure OpenAI/Anthropic/Google Gemini/Meta Llama, bachelor’s degree in a technical field, strong communication.
OpenAI, Azure OpenAI, Anthropic, Google Gemini, Meta Llama, LLM, RAG, DevEx
1mo
Save
Mark Applied
Hide
Software Engineer 4 - LLM Inference
San Jose or Durham or Mexico or Canada or India or Netherlands or Serbia or Spain or Singapore or Australia or Japan
$148k-$222k/yr HybridFull Time
6+ YOE6+ years building distributed, high-performance cloud-native systems; strong Go/Python, Docker, Kubernetes, CI/CD, systems and networking knowledge; bachelor’s or master’s in CS or equivalent.
Docker, Kubernetes, Go, Python, CI/CD, TensorFlow, PyTorch
3mo
Save
Mark Applied
Hide
Principal Machine Learning Engineer I
Raleigh, North Carolina, United States
$136k-$253k/yr OnsiteFull Time
10+ YOE10+ years ML/software engineering experience, advanced degree preferred, strong systems architecture, LLM/RAG/agent experience, ML production deployment, CI/CD and responsible AI compliance.
LLM, Retrieval-Augmented Generation (RAG), CI/CD
1mo
Save
Mark Applied
Hide
Senior Software Engineer
United States or Durham
$90k-$135k/yr HybridFull Time
Hands-on engineer building production-grade LLM-powered agents and orchestration, strong Python and backend skills, experience with routing/workflow logic, prompt engineering, APIs, distributed systems, and cloud-native reliability.
Python, AWS, MCP, CI/CD, TDD
3mo
Save
Mark Applied
Hide
Lead AI Engineer — Productivity Systems
Durham or Miami or Palo Alto or Washington
$12k-$18k/mo HybridFull Time
Proven experience shipping LLM-powered systems in production; strong prompt/context engineering, evaluation and guardrail development, and software engineering skills (Python/TypeScript/Clojure).
Python, TypeScript, Clojure, n8n, Zapier, AWS, Claude Code, Cursor, Copilot, Slack, Google Workspace, Jira, Terraform, RAG, MCP
3mo
Save
Mark Applied
Hide
Principal Engineer, AI Platform
Cary, North Carolina, United States
OnsiteFull Time
12+ YOE12+ years software engineering; distributed systems; authentication/authorization infra; Go preferred; security focus; LLM-integrated systems; Kubernetes experience.
Go, Rust, C++
3w
Save
Mark Applied
Hide
Forward Deployed Engineer
Morrisville or Chicago or Raleigh or California or Colorado or Connecticut or District of Columbia or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or Nevada or New Jersey or New York or Oregon or Rhode Island or Washington
$180k-$220k/yr HybridFull Time
5+ YOERequires 5+ years in software engineering, solutions engineering, applied AI, or related technical work; experience deploying AI solutions, LLMs, retrieval architectures, agents, enterprise APIs, and workflow platforms.
Microsoft Copilot Studio, Azure OpenAI, Microsoft 365, Microsoft Power Platform, ServiceNow, Python, JavaScript
1mo
Save
Mark Applied
Hide
Principal Engineer, Resilience
Berlin or Boston or Durham or Munich or London or Valencia
HybridFull Time
5+ YOE5+ years shipping production software, 2+ years building with LLMs; full-stack ownership; experience with agents, prompt engineering, retrieval/embeddings, SQL, Python, TypeScript/Node and React.
A2UI, AG-UI, MCP, Python, TypeScript, Node, React, SQL
1mo
Save
Mark Applied
Hide
Senior DevSecOps Engineer
United States or New York City or Charlotte
$130k-$205k/yr HybridFull Time
5+ YOE5+ years security/platform engineering with cloud security, Terraform, CI/CD security, vulnerability management, SOC 2 experience, scripting for automation, and experience applying AI/LLM to security operations.
Terraform, SAST, SCA, secret scanning, SBOM, CSPM, ASPM, SIEM, Wiz, Prisma Cloud, Snyk, Drata, Vanta, CI/CD, AI/LLM
1w
Save
Mark Applied
Hide
Applied AI Engineer
Canada or San Francisco or Raleigh or Boston
HybridFull Time
Applied GenAI experience with prompt engineering, structured outputs, RAG, evaluation datasets, production LLM features, multimodal inputs, and model quality, cost, and latency optimization.
LLMX, Attachments, OCR, RAG
2w
Save
Mark Applied
Hide
Forward Deployed Engineer
Raleigh, North Carolina, United States
$130k-$180k/yr HybridFull Time
2+ YOERequires 2+ years of engineering experience, production systems experience, SQL, Python, data modeling, AWS, LLM development, prompt and context engineering, and full-stack skills across React, TypeScript, Python, Node, or .NET.
Artemis, Microsoft Teams, SQL Server, SQL, Python, AWS, Microsoft Azure, React, TypeScript, Node, Microsoft .NET, Claude Code, Codex, Cursor, Microsoft Fabric, Power BI, Microsoft Graph, Microsoft Bot Framework, Anthropic, OpenAI, AWS Bedrock
1mo
Save
Mark Applied
Hide
Senior Applied AI Engineer
Santa Clara or Austin or Hillsboro or Durham or Seattle
$152k-$288k/yr OnsiteFull Time
5+ YOEMS or equivalent in computer science, engineering, AI, or related field; 5+ years software engineering experience; production AI/LLM applications, Python, agentic workflows, and distributed systems experience.
Python, Claude Code, OpenAI Codex, Cursor, GitHub Copilot, MCP, CI/CD
2mo
Save
Mark Applied
Hide
AI Solutions Engineer
Raleigh, North Carolina, United States
OnsiteFull Time
7+ YOEAbility to obtain security clearance, Bachelor's in CS/Data/AI or related, 7+ years in software/ML/solutions engineering, hands-on LLM and computer vision experience, strong Python and ML library knowledge, cloud deployment experience, customer-facing pilot delivery.
Python, PyTorch, TensorFlow, LangChain, LlamaIndex, AWS, GCP, Azure, Docker, Kubernetes, CI/CD, MLOps
1w
Save
Mark Applied
Hide
Sr. AI Engineer
Durham or Raleigh
OnsiteFull Time
5+ YOE5+ years in ML/AI engineering with production generative-AI delivery; strong Python, Azure AI, Microsoft Foundry, MCP, RAG, LLM, prompt engineering, MLOps, and software-engineering skills; bachelor's or master's preferred.
Microsoft Foundry, Azure AI Foundry, Azure AI, Microsoft Fabric, One Lake, Lakehouse, Direct Lake, Python, Model Context Protocol (MCP), RAG, LLM, Foundry Agent Service, Azure OpenAI, CI/CD
5d
Save
Mark Applied
Hide
Principal Engineer AI - Capital Markets
Charlotte, North Carolina, United States
HybridFull Time
12+ YOE12+ years of software engineering experience with Fixed Income and Capital Markets systems; expertise in AI/ML or LLM solutions, Python, AI frameworks, enterprise architecture, data pipelines, and technical leadership.
Python, LangChain, Vertex AI, Solace, MQ
3w
Save
Mark Applied
Hide
AI Engineer - NC
North Carolina, United States
OnsiteFull Time
5+ YOE5+ years of AI/ML engineering experience evaluating, fine-tuning, and deploying LLMs in production; cloud infrastructure, RAG, embeddings, vector databases, agentic workflows, EvalOps, and production software engineering required.
LLM, AWS, GCP, RAG, EvalOps, Evals-as-a-Service, vector databases
1mo
Save
Mark Applied
Hide
Staff Engineer, Revenue Cycle
Denver or Dallas or Salt Lake City or Atlanta or Miami or Seattle or Boston or Portland or Austin or Durham or Tampa or Scottsdale
$165k-$180k/yr RemoteFull Time
8+ YOE8+ years building web services or full-stack applications; strong hands-on experience with Ruby/Rails, TypeScript/Node, Python, APIs, PostgreSQL, and MongoDB; mentoring and technical leadership experience; familiarity with LLM/AI toolchains preferred.
Ruby/Rails, TypeScript/Node, Python, MongoDB, PostgreSQL, RESTful, gRPC, Gemini, ChatGPT, Claude, GitHub Copilot, Langchain, Langgraph, LLMs
1mo
Save
Mark Applied
Hide
STAFF SOFTWARE QA ENGINEER
Durham, North Carolina, United States
HybridFull Time
10+ YOE3+ MgmtBachelor's in engineering,10+ years SQA for embedded systems,LabVIEW automation experience,3+ years people management,proficient in C/C++/C#/Python,CI/CD and Jira experience,cybersecurity testing and LLM/AI tooling exposure.
LabVIEW, C, C++, C#, Python, Jira, CI/CD, SCADA
4d
Save
Mark Applied
Hide
AI Engineer, Enablement
New York City or Atlanta or Philadelphia or Tampa or Nashville or Boston or Washington or Charlotte
$150k-$195k/yr OnsiteFull Time
3+ YOERequires 3+ years building LLM or agent applications, strong Python, and 2+ years in technical customer-facing work with live workshop delivery. Travel up to 20%; cloud, containers, Kubernetes, and TypeScript are valued.
Python, LangChain, LangGraph, Deep Agents, LangSmith, AWS, GCP, Azure, Kubernetes, TypeScript, JavaScript
Explore Jobs
Expand Your Job Search
Top Cities in North Carolina for Llm Engineer
- Llm Engineer jobs in Charlotte, NC
- Llm Engineer jobs in Raleigh, NC
- Llm Engineer jobs in Greensboro, NC
- Llm Engineer jobs in Durham, NC
- Llm Engineer jobs in Winston-Salem, NC
- Llm Engineer jobs in Fayetteville, NC
- Llm Engineer jobs in Cary, NC
- Llm Engineer jobs in Wilmington, NC
- Llm Engineer jobs in High Point, NC
- Llm Engineer jobs in Greenville, NC
- Llm Engineer jobs in Asheville, NC
- Llm Engineer jobs in Concord, NC
- Llm Engineer jobs in Gastonia, NC
- Llm Engineer jobs in Jacksonville, NC
- Llm Engineer jobs in Chapel Hill, NC
- Llm Engineer jobs in Rocky Mount, NC
- Llm Engineer jobs in Huntersville, NC
- Llm Engineer jobs in Burlington, NC
- Llm Engineer jobs in Wilson, NC
- Llm Engineer jobs in Kannapolis, NC