17 llmops engineer jobs at 11 companies in North Carolina
1mo
Save
Mark Applied
Hide
Staff AI Engineer
Raleigh, North Carolina, United States
$161k-$250k/yr OnsiteFull Time
7+ YOE7+ years software/ML experience,5+ years building LLM/AI systems,Python proficiency,experience with LLMOps/MLOps,platform engineering,LLM fine-tuning and evaluation;Bachelor's required,Master's preferred.
Python, AWS, Databricks, PEFT, LLM APIs, RAG pipelines, MLOps, LLMOps
3w
Save
Mark Applied
Hide
Senior Software Engineer II – Enterprise AI Consulting & Embedded Experts
Des Moines or Charlotte or Raleigh
$127k-$152k/yr HybridFull Time
8+ YOE8+ years engineering experience, 5+ years cloud (AWS) and modern data/AI architectures, experience building distributed systems, strong communication, and ability to translate strategy into production AI solutions.
AWS, MLOps, LLMOps
2w
Save
Mark Applied
Hide
Gen AI Engineer
Charlotte or Dallas or Houston or Raleigh or Richardson
OnsiteFull Time
Hands-on experience building GenAI applications with Python, LangChain/Lang Graph/Llama Index, LLM platforms, FastAPI/Docker/Kubernetes, software engineering and LLMOps practices; Bachelor\u0002s degree or equivalent required.
Python, LangChain, Lang Graph, Llama Index, RAG, vector databases, FastAPI, Docker, Kubernetes, Azure OpenAI, AWS Bedrock, OpenAI, Anthropic, GitHub Copilot, Claude Code, Cursor, Git, React, TypeScript, GitHub Actions, Terraform, Helm, LoRA, QLoRA, PEFT, Model Context Protocol (MCP), RAGAS, DeepEval, Lang Smith, Llama, Mistral, Gemma
2w
Save
Mark Applied
Hide
Principal AI Engineer
Hartford or Columbus or Charlotte or Chicago
$168k-$253k/yr HybridFull Time
10+ YOE10+ years building cloud-native, data-intensive AI/ML platforms; strong Python and Typescript; cloud experience (AWS/GCP/Azure); experience with distributed systems, embeddings, vector search, and MLOps/LLMOps.
AWS, GCP, Google Cloud, Azure, Python, Typescript, CI/CD, NoSQL, HPCs, LangGraph, crewai, RAG, vector stores, ANN, KNN
3d
Save
Mark Applied
Hide
AI Engineering & Platform Leadership Senior Manager - Utilities
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$113k-$338k/yr HybridFull Time
10+ YOE5+ MgmtRequires 10+ years in software or AI/ML engineering, 6+ years architecting enterprise AI platforms, leadership experience, multi-cloud and LLMOps expertise, utilities experience, and a bachelor's degree or equivalent.
OpenAI, Anthropic, AWS, Azure, Google, LLMOps, MLOps, FinOps
2w
Save
Mark Applied
Hide
Lead AI Security Engineer
Charlotte, North Carolina, United States
OnsiteFull Time
10+ YOE10+ years security engineering experience, bachelor\u0002s or equivalent, 3+ years lead experience, deep expertise in threat modeling, detection engineering, CI/CD/MLOps security, and AI/LLM security risks.
Microsoft Azure, Microsoft Copilot, Microsoft Copilot Studio, Microsoft Azure AI, CI/CD, MLOps, LLMOps, OWASP LLM risks, OWASP agentic application risks, NIST AI RMF, MITRE ATLAS
2w
Save
Mark Applied
Hide
Staff AI-Ops Engineer
Charlotte, North Carolina, United States
HybridFull Time
5+ YOEBachelor's degree,5+ years deploying and operating GenAI/ML models in production with strong MLOps/LLMOps experience; Python and GenAI tooling expertise; MLflow, Databricks, and Azure experience; CI/CD, observability, and governance skills.
Databricks, Microsoft Azure, MLflow, Databricks Asset Bundles, Python, Databricks Vector Search, Microsoft Azure AI Search, Microsoft Azure AI document intelligence, LangGraph, haystack, Llama Index, PyTorch, TensorFlow, Hugging Face Transformers
5d
Save
Mark Applied
Hide
Snowflake Advanced AI Engineer,
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$54k-$206k/yr HybridFull Time
3+ YOERequires a bachelor's degree or equivalent experience, 3+ years in machine learning, 2+ years with Snowflake Cortex AI, cloud AI/ML deployment, distributed systems, and Python-based frameworks.
Snowflake Cortex AI, Cortex Agents, Cortex Analyst, Cortex Search, DevOps, MLOps, LLMOps, Python, TensorFlow, PyTorch, Large Language Models (LLMs), C++, Java, R, SQL
2mo
Save
Mark Applied
Hide
Senior Software Engineer II – Enterprise AI Consulting & Embedded Experts
Des Moines or Charlotte
$127k-$152k/yr HybridFull Time
8+ YOE8+ years of engineering experience; building distributed systems; strong stakeholder collaboration; ability to operate in ambiguity; effective communicator.
AWS, MLOps, LLMOps, AI frameworks, RAG patterns
5d
Save
Mark Applied
Hide
Snowflake Advanced AI Engineer,
San Francisco or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$70k-$206k/yr HybridFull Time
3+ YOERequires 2+ years with Snowflake Cortex AI, 3+ years deploying machine learning models, 3+ years in computer science and programming, cloud AI/ML deployment, and a bachelor's degree or equivalent experience.
Snowflake Cortex AI, Cortex Agents, Cortex Analyst, Cortex Search, Deep Learning, Generative AI, Large Language Models, DevOps, MLOps, LLMOps, Python, TensorFlow, PyTorch, C++, Java, R, SQL
2mo
Save
Mark Applied
Hide
Gen AI / Agentic AI Developer (Brooklyn, NY, US)
Brooklyn or New York City or Charlotte or Chicago or Atlanta
$80k-$106k/yr HybridFull Time
Hands-on Python development and GenAI experience; familiarity with LLMs, RAG, agentic frameworks (e.g., LangChain, LangGraph, AutoGen), vector DBs, cloud deployment, Docker/Kubernetes, CI/CD, and LLMOps/tooling.
Python, LangChain, LangGraph, AutoGen, CrewAI, Semantic Kernel, LlamaIndex, OpenAI, Azure OpenAI, AWS Bedrock, Anthropic Claude, Gemini, Llama, Mistral, OpenSearch, Pinecone, FAISS, Chroma, Weaviate, Milvus, Azure AI Search, pgvector, FastAPI, Flask, REST APIs, microservices, Docker, Kubernetes, CI/CD, LangSmith, MLflow, Phoenix, Ragas, TruLens, Arize, OpenTelemetry, AWS SageMaker, GCP Vertex AI
2w
Save
Mark Applied
Hide
AI-Ops Engineering Lead - Director
Charlotte, North Carolina, United States
HybridFull Time
8+ YOE3+ MgmtBachelor's degree,8+ years deploying and operating GenAI/ML models in production,3+ years technical leadership,expertise in MLOps/LLMOps,Python,Databricks,Azure,MLflow and observability for AI systems.
Python, Databricks Vector Search, Azure AI Search, LangGraph, haystack, Llama Index, MLflow, Databricks Asset Bundles, Databricks, Azure, PyTorch, TensorFlow, Hugging Face Transformers
3w
Save
Mark Applied
Hide
Senior Director, AI Platform Architecture
North Carolina or New York or Colorado or California or Maryland or Ohio or Virginia or New Jersey or Pennsylvania or Illinois or Georgia or Texas or Massachusetts or Florida or Connecticut
$168k-$278k/yr RemoteFull Time
12+ YOEBachelor's required (advanced degree preferred),12+ years in software/data/AI platform leadership, experience building/scaling AI/ML platforms, MLOps/LLMOps, cloud and modern data architectures, regulated environments preferred, US work authorization required, background check.
Snowflake, Databricks, Open AI
1mo
Save
Mark Applied
Hide
Java FSD- GenAI
Addison or Charlotte or Jersey City
$98k-$142k/yr OnsiteFull Time
7+ YOERequires 7+ years of experience with Python, SQL, LLMs, AI agents, RAG, vector databases, CI/CD, data pipelines, distributed processing, and AWS, Azure, or GCP; bachelor's or master's degree preferred.
GenAI, LLMOps, Large Language Models (LLMs), OpenAI, Azure OpenAI, Anthropic, LangChain, LlamaIndex, Semantic Kernel, AutoGen, CrewAI, FAISS, Pinecone, Weaviate, Azure AI Search, Chroma, Python, SQL, Docker, Kubernetes, AWS, Azure, GCP
2d
Save
Mark Applied
Hide
Principal AI Architect
Fort Mill or Charlotte or New York City or Austin
$156k-$260k/yr OnsiteFull Time
10+ YOERequires 10+ years in architecture, software engineering, platform architecture, or distributed systems; 3+ years in AI platforms; 5+ years in cloud-native architectures; degree in a related field preferred.
AWS, Kubernetes, EKS, API Gateway, Bedrock, DynamoDB, Python, Java, MCP, RAG, A2A, MLOps, LLMOps, Infrastructure-as-Code, DevSecOps, RBAC
2d
Save
Mark Applied
Hide
Principal AI Architect
Fort Mill or Charlotte or New York City or Austin
$156k-$260k/yr OnsiteFull Time
10+ YOERequires 10+ years in enterprise architecture, software engineering, platform architecture, or distributed systems; 3+ years in AI platforms; 5+ years in cloud-native architecture; technical leadership and a relevant bachelor's or master's degree.
AWS, Kubernetes, EKS, API Gateway, Bedrock, DynamoDB, Python, Java, MCP, A2A, RAG, MLOps, LLMOps, Infrastructure-as-Code, DevSecOps, RBAC
5d
Save
Mark Applied
Hide
Snowflake Advanced AI Solution Lead
San Francisco or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$294k/yr HybridFull Time
5+ YOERequires 5+ years in machine learning engineering or science, 5+ years in computer science foundations, 3+ years in distributed systems, 2+ years with Snowflake Cortex AI and cloud AI/ML deployment, plus a bachelor's degree or equivalent experience.
Snowflake Cortex AI, Cortex Agents, Cortex Analyst, Cortex Search, Deep Learning, Generative AI, Large Language Models, DevOps, MLOps, LLMOps, HPC, Python, TensorFlow, PyTorch, LLM, C++, Java, R, SQL
Explore Jobs
Expand Your Job Search
Top Cities in North Carolina for Llmops Engineer
- Llmops Engineer jobs in Charlotte, NC
- Llmops Engineer jobs in Raleigh, NC
- Llmops Engineer jobs in Greensboro, NC
- Llmops Engineer jobs in Durham, NC
- Llmops Engineer jobs in Winston-Salem, NC
- Llmops Engineer jobs in Fayetteville, NC
- Llmops Engineer jobs in Cary, NC
- Llmops Engineer jobs in Wilmington, NC
- Llmops Engineer jobs in High Point, NC
- Llmops Engineer jobs in Greenville, NC
- Llmops Engineer jobs in Asheville, NC
- Llmops Engineer jobs in Concord, NC
- Llmops Engineer jobs in Gastonia, NC
- Llmops Engineer jobs in Jacksonville, NC
- Llmops Engineer jobs in Chapel Hill, NC
- Llmops Engineer jobs in Rocky Mount, NC
- Llmops Engineer jobs in Huntersville, NC
- Llmops Engineer jobs in Burlington, NC
- Llmops Engineer jobs in Wilson, NC
- Llmops Engineer jobs in Kannapolis, NC