12 llmops engineer jobs at 9 companies in Concord, NC

1mo
Save
Mark Applied
Hide
Principal Engineer - Agentic AI Platform Engineering & Performance
Charlotte, North Carolina, United States
OnsiteFull Time
Bank of America
Bank of AmericaNYSE: BAC: Provides global banking, investing, and financial risk management services.
15+ YOE15+ years engineering experience leading enterprise platforms and developer tooling; deep expertise in agent orchestration, LLMOps, AI performance engineering, CI/CD, SDLC governance, and stakeholder influence. Bachelor’s required.
LLMOps, CI/CD, SDLC, RAG
1d
Save
Mark Applied
Hide
Gen AI Engineer
Charlotte or Dallas or Houston or Raleigh or Richardson
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Hands-on experience building GenAI applications with Python, LangChain/Lang Graph/Llama Index, LLM platforms, FastAPI/Docker/Kubernetes, software engineering and LLMOps practices; Bachelor\u0002s degree or equivalent required.
Python, LangChain, Lang Graph, Llama Index, RAG, vector databases, FastAPI, Docker, Kubernetes, Azure OpenAI, AWS Bedrock, OpenAI, Anthropic, GitHub Copilot, Claude Code, Cursor, Git, React, TypeScript, GitHub Actions, Terraform, Helm, LoRA, QLoRA, PEFT, Model Context Protocol (MCP), RAGAS, DeepEval, Lang Smith, Llama, Mistral, Gemma
4d
Save
Mark Applied
Hide
Principal AI Engineer
Hartford or Columbus or Charlotte or Chicago
$168k-$253k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
10+ YOE10+ years building cloud-native, data-intensive AI/ML platforms; strong Python and Typescript; cloud experience (AWS/GCP/Azure); experience with distributed systems, embeddings, vector search, and MLOps/LLMOps.
AWS, GCP, Google Cloud, Azure, Python, Typescript, CI/CD, NoSQL, HPCs, LangGraph, crewai, RAG, vector stores, ANN, KNN
4d
Save
Mark Applied
Hide
Lead AI Security Engineer
Charlotte, North Carolina, United States
OnsiteFull Time
Truist
TruistNYSE: TFC: Offers personal banking, business lending, and investment management services.
10+ YOE10+ years security engineering experience, bachelor\u0002s or equivalent, 3+ years lead experience, deep expertise in threat modeling, detection engineering, CI/CD/MLOps security, and AI/LLM security risks.
Microsoft Azure, Microsoft Copilot, Microsoft Copilot Studio, Microsoft Azure AI, CI/CD, MLOps, LLMOps, OWASP LLM risks, OWASP agentic application risks, NIST AI RMF, MITRE ATLAS
1mo
Save
Mark Applied
Hide
Staff Software Engineer - AI
Hartford or Charlotte
$128k-$191k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
Deep AI/ML and software engineering expertise with experience building agentic and generative AI systems; proficiency in Python/Java/C++; cloud and MLOps experience; test automation and Git skills; strong problem-solving and collaboration.
Python, Java, C++, Playwright, MLflow, Kubeflow, Docker, Git, LangGraph, Crew AI, Semantic Kernel, AWS, Azure, GCP, LLMOps, MLOps, Gemini, Claude
2d
Save
Mark Applied
Hide
Staff AI-Ops Engineer
Charlotte, North Carolina, United States
HybridFull Time
SMBC Group
SMBC GroupNew York Stock Exchange: SMFG: Provides global banking, investment, securities, and consumer finance services.
5+ YOEBachelor's degree,5+ years deploying and operating GenAI/ML models in production with strong MLOps/LLMOps experience; Python and GenAI tooling expertise; MLflow, Databricks, and Azure experience; CI/CD, observability, and governance skills.
Databricks, Microsoft Azure, MLflow, Databricks Asset Bundles, Python, Databricks Vector Search, Microsoft Azure AI Search, Microsoft Azure AI document intelligence, LangGraph, haystack, Llama Index, PyTorch, TensorFlow, Hugging Face Transformers
2mo
Save
Mark Applied
Hide
AI/GenAI Staff Engineer - Vice President (Charlotte, NC, US, 28202)
Charlotte, North Carolina, United States
HybridFull Time
SMBC Group
SMBC GroupNew York Stock Exchange: SMFG: Provides global banking, investment, securities, and consumer finance services.
5+ YOE5+ years GenAI/advanced ML in production; 3+ years Python and GenAI tools; experience with MLOps/LLMOps, data platforms, cloud, REST/services, and ML libraries.
Databricks, Azure, LangGraph, haystack, Llama Index, PyTorch, TensorFlow, Hugging Face Transformers, MLflow, REST, Docker, Kubernetes, CI/CD
2mo
Save
Mark Applied
Hide
Senior Software Engineer II – Enterprise AI Consulting & Embedded Experts
Des Moines or Charlotte
$127k-$152k/yr HybridFull Time
Principal Financial Group
Principal Financial GroupNASDAQ: PFG: A global financial investment management and insurance.
8+ YOE8+ years of engineering experience; building distributed systems; strong stakeholder collaboration; ability to operate in ambiguity; effective communicator.
AWS, MLOps, LLMOps, AI frameworks, RAG patterns
1mo
Save
Mark Applied
Hide
Gen AI / Agentic AI Developer (Brooklyn, NY, US)
Brooklyn or New York City or Charlotte or Chicago or Atlanta
$80k-$106k/yr HybridFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
Hands-on Python development and GenAI experience; familiarity with LLMs, RAG, agentic frameworks (e.g., LangChain, LangGraph, AutoGen), vector DBs, cloud deployment, Docker/Kubernetes, CI/CD, and LLMOps/tooling.
Python, LangChain, LangGraph, AutoGen, CrewAI, Semantic Kernel, LlamaIndex, OpenAI, Azure OpenAI, AWS Bedrock, Anthropic Claude, Gemini, Llama, Mistral, OpenSearch, Pinecone, FAISS, Chroma, Weaviate, Milvus, Azure AI Search, pgvector, FastAPI, Flask, REST APIs, microservices, Docker, Kubernetes, CI/CD, LangSmith, MLflow, Phoenix, Ragas, TruLens, Arize, OpenTelemetry, AWS SageMaker, GCP Vertex AI
2d
Save
Mark Applied
Hide
AI-Ops Engineering Lead - Director
Charlotte, North Carolina, United States
HybridFull Time
SMBC Group
SMBC GroupNew York Stock Exchange: SMFG: Provides global banking, investment, securities, and consumer finance services.
8+ YOE3+ MgmtBachelor's degree,8+ years deploying and operating GenAI/ML models in production,3+ years technical leadership,expertise in MLOps/LLMOps,Python,Databricks,Azure,MLflow and observability for AI systems.
Python, Databricks Vector Search, Azure AI Search, LangGraph, haystack, Llama Index, MLflow, Databricks Asset Bundles, Databricks, Azure, PyTorch, TensorFlow, Hugging Face Transformers
2d
Save
Mark Applied
Hide
Managing Director, Head of AI Operational Architecture & Integration
Iselin or Charlotte or Dallas or New York City
$232k-$290k/yr HybridFull Time
TIAA
TIAA: Provides retirement and financial services for academic and non-profit sectors.
10+ YOE10+ Mgmt10+ years technology leadership experience in distributed systems, platform engineering/SRE, and AI/ML systems; university degree preferred; strong product mindset and ability to influence federated teams.
AWS, Azure, GCP, MLOps, LLMOps, LLMs, API
5d
Save
Mark Applied
Hide
Principal Architect - GenAI and Agentic AI
Charlotte or Irving or Phoenix or Concord or Minneapolis
$159k-$305k/yr HybridFull Time
Wells Fargo
Wells FargoNYSE: WFC: Global provider of banking, investment, and mortgage financial services.
7+ YOE7+ years architecture experience including solution architecture; 2+ years Generative/Agentic AI and AI platform experience; AI product evaluation and governance experience; enterprise architecture and multi-stakeholder collaboration.
LLMOps, MLOps, Retrieval-Augmented Generation (RAG), Devin, Claude, Cowork, Cursor, Copilot