80 llm engineer jobs at 45 companies in Jaars, NC
1mo
Save
Mark Applied
Hide
Principal Engineer - Context Engineering & LLM Optimization
Charlotte, North Carolina, United States
OnsiteFull Time
10+ YOE10+ years engineering experience, 5+ years designing enterprise systems, 2+ years with LLM/RAG/vector search; strong prompt, context, retrieval, and evaluation expertise; bachelor’s in CS/Engineering/Info Systems/Applied Math.
OpenAI, Azure OpenAI, Anthropic, Google Gemini, Meta Llama, Retrieval-Augmented Generation (RAG)
1mo
Save
Mark Applied
Hide
Principal Engineer - Context Engineering & LLM Optimization
Charlotte, North Carolina, United States
OnsiteFull Time
10+ YOE10+ years software/data/platform/AI engineering experience, 5+ years designing large-scale enterprise systems, 2+ years with LLM/RAG/vector search, experience with OpenAI/Azure OpenAI/Anthropic/Google Gemini/Meta Llama, bachelor’s degree in a technical field, strong communication.
OpenAI, Azure OpenAI, Anthropic, Google Gemini, Meta Llama, LLM, RAG, DevEx
3w
Save
Mark Applied
Hide
Senior DevSecOps Engineer
United States or New York City or Charlotte
$130k-$205k/yr HybridFull Time
5+ YOE5+ years security/platform engineering with cloud security, Terraform, CI/CD security, vulnerability management, SOC 2 experience, scripting for automation, and experience applying AI/LLM to security operations.
Terraform, SAST, SCA, secret scanning, SBOM, CSPM, ASPM, SIEM, Wiz, Prisma Cloud, Snyk, Drata, Vanta, CI/CD, AI/LLM
2mo
Save
Mark Applied
Hide
Senior Software Engineer
South Windsor or Charlotte
HybridFull Time
7+ YOE7+ years software development experience with 3+ years in a senior/lead capacity. Strong experience with Microsoft .NET 10, C#, React, TypeScript, Azure, PostgreSQL, cloud-native architectures, CI/CD, and AI/LLM integrations. Bachelor's required.
Microsoft .NET 10, C#, React, TypeScript, Entity Framework Core, PostgreSQL, CosmosDB, Microsoft Azure OpenAI Services, Microsoft Azure Functions, Microsoft Azure App Services, Microsoft Azure Service Bus, Microsoft Azure Key Vault, Microsoft Azure AI Search, Microsoft Azure DevOps, GitHub Actions, LangChain, Semantic Kernel, Docker, Kubernetes, Tailwind CSS, Redux, Zustand
6d
Save
Mark Applied
Hide
AI Infrastructure Engineer
Charlotte, North Carolina, United States
$140k-$170k/yr OnsiteFull Time
8+ YOE8+ years in LLM/MLOps and MLOps platforms; experience with Terraform, Docker, cloud (AWS), Kubernetes, CI/CD, Python/PySpark/Bash; production AI/platform deployment and security best practices.
Docker, Terraform, AWS, GitHub Actions, GitLab CI, Kubernetes, Python, PySpark, Bash
1mo
Save
Mark Applied
Hide
Vice President, AI Ecosystem & Developer Platform
Fort Mill or Charlotte or San Diego
$164k-$273k/yr OnsiteFull Time
10+ YOE5+ Mgmt10+ years in platform or software engineering with 5+ years managing platform/DX/API/AI teams and 3+ years building AI/LLM-enabled platforms; experience with Kong/Apigee/MuleSoft/AWS API Gateway/Azure API Management.
Kong, Apigee, MuleSoft, AWS API Gateway, Azure API Management, Kong AI Gateway, MCP Server
1mo
Save
Mark Applied
Hide
Senior Cloud Security Engineer
Malvern or Charlotte or Dallas or Fort Worth
HybridFull Time
5+ YOE5+ years related experience required (cloud security preferred), undergraduate degree or equivalent, production-grade proficiency in Python/Go/TypeScript, experience with AWS/GCP/Azure at org scale, strong distributed systems background.
Python, Go, TypeScript, AWS, GCP, Azure, CI/CD, CMDB, ITSM, LLM
1mo
Save
Mark Applied
Hide
Senior AI Engineer | Sage Home Loans
Charlotte or Fort Mill
$150k-$220k/yr HybridFull Time
5+ YOE5+ years building production software (≥1 year with LLM systems); experience shipping LLM-powered products, eval frameworks, foundation model selection, RAG and post-training techniques (SFT, DPO, LoRA); Databricks/Snowflake familiarity; BS/MS in CS/ML preferred.
LLM, Anthropic, OpenAI, Databricks, Snowflake, TypeScript, React, Node, SFT, DPO, LoRA, RAG
4w
Save
Mark Applied
Hide
AI Security Engineer
Charlotte, North Carolina, United States
OnsiteFull Time
5+ YOEBachelor's degree and 5+ years systems engineering or equivalent; 3+ years security engineering; experience implementing security controls for AI/LLM systems; strong documentation and communication skills.
Microsoft, Azure, Copilot / Copilot Studio, APIs, Mainframe
2mo
Save
Mark Applied
Hide
Senior AI Engineer
Dublin or Charlotte
HybridFull Time
Senior experience in solution architecture and hands-on software engineering; strong AI-first experience; Kubernetes; front-end and back-end; LLM integration; SaaS.
React, TypeScript, Python, PostgreSQL, MongoDB, ETL, CI/CD, Kubernetes, LLMs
1mo
Save
Mark Applied
Hide
Staff Software Engineer - Credit Karma
Charlotte, North Carolina, United States
OnsiteFull Time
7+ YOE7+ years backend experience delivering enterprise applications; proficiency in TypeScript, Java or Scala; microservices, Kubernetes/Docker, Terraform; database and low-latency data design; AI/LLM integration; CI/CD and test automation.
TypeScript, Java, Scala, Kubernetes, Docker, Terraform, GraphQL, Node.js, LLM
2mo
Save
Mark Applied
Hide
Senior AI Engineer
Chicago or Miami or New York City or Oakbrook Terrace or Nashville or South Bend or Tampa or Atlanta or Boston or Dallas or Houston or Grand Rapids or Austin or Charlotte or Indianapolis
$74k-$148k/yr OnsiteFull Time
4+ YOE4–6 years AI/ML engineering; strong Python, cloud, distributed systems; deep learning frameworks; VMs and containerization; experience with LLMs and vector databases; travel up to 80%
Python, ML frameworks, AWS, Azure, Google Cloud, Docker, Kubernetes, Terraform, SageMaker, Vertex AI, Azure ML, GPU/accelerator workflows, PyTorch, TensorFlow, Hugging Face, LangChain, LlamaIndex, Pinecone, Weaviate, FAISS, OpenAI API, Azure OpenAI, Gemini, PEFT, LoRA, QLoRA, Power Platform, APIs, SDKs
1w
Save
Mark Applied
Hide
Software Engineer, AI Experience
Charlotte, North Carolina, United States
RemoteFull Time
4+ YOE4+ years software engineering, .NET/C# and SQL Server experience, hands-on AI tooling (Claude, Copilot, Cursor), LLM app and agent workflow experience, strong developer-experience and collaboration skills.
Claude, Copilot, Cursor, SQL Server, C#, .NET, MCP
1mo
Save
Mark Applied
Hide
Sr. AI Engineer
Charlotte, North Carolina, United States
HybridFull Time
5+ YOEBachelor's or Master's (or equivalent experience), ~5+ years software engineering experience with AI/ML exposure, hands-on with LLMs and Python, cloud experience (AWS/Azure/GCP), strong communication and mentoring skills, willing to work in office 3 days/week.
Python, AWS, Azure, GCP, LLMs, LinkedIn
2w
Save
Mark Applied
Hide
AI Platform Engineer
Belmont or Houston or Jacksonville
OnsiteFull Time
2+ YOE2–4 years AI/ML or data engineering experience, hands-on Databricks and LLM work, strong Python, Azure knowledge, EMR not required; must work across technical and non-technical stakeholders.
Databricks, MLflow, Unity Catalog, Python, SQL, Azure OpenAI, Azure Data Lake Storage, Azure Key Vault, Claude API, Databricks AI Agent Framework, LangChain, AutoGen, Azure DevOps (ADO), CI/CD, Power BI, Databricks Genie
1w
Save
Mark Applied
Hide
Gen AI Engineer
Charlotte or Dallas or Houston or Raleigh or Richardson
OnsiteFull Time
Hands-on experience building GenAI applications with Python, LangChain/Lang Graph/Llama Index, LLM platforms, FastAPI/Docker/Kubernetes, software engineering and LLMOps practices; Bachelor\u0002s degree or equivalent required.
Python, LangChain, Lang Graph, Llama Index, RAG, vector databases, FastAPI, Docker, Kubernetes, Azure OpenAI, AWS Bedrock, OpenAI, Anthropic, GitHub Copilot, Claude Code, Cursor, Git, React, TypeScript, GitHub Actions, Terraform, Helm, LoRA, QLoRA, PEFT, Model Context Protocol (MCP), RAGAS, DeepEval, Lang Smith, Llama, Mistral, Gemma
3d
Save
Mark Applied
Hide
Sr Advanced AI Engineer
Phoenix or Charlotte
HybridFull Time
7+ YOERequires 7+ years of software engineering, 3+ years building production AI/ML applications, LangGraph and LangChain experience, Python or Node.js/TypeScript, RAG, vector databases, LLM APIs, and secure AI practices.
LangGraph, LangChain, Python, FastAPI, Node.js, TypeScript, Databricks Vector Search, OpenSearch, Pinecone, Milvus, MLflow, AWS
1mo
Save
Mark Applied
Hide
Staff Software Engineer - Hybrid
Charlotte or Columbus or Hartford
$116k-$174k/yr HybridFull Time
6+ YOE6+ years software engineering experience, Bachelor's degree or equivalent, US work authorization, hands-on Generative/Agentic AI and LLM experience, proficiency in Python and/or Java, AWS and Terraform experience, Angular and CI/CD familiarity.
LangChain, LangGraph, CrewAI, AutoGen, Python, Java, Amazon Web Services (AWS), Lambda, DynamoDB, S3, SQS, SNS, API Gateway, ALB, Step Functions, IAM, Angular, Terraform, Jenkins, GitHub Actions, Guidewire ClaimCenter, FastAPI, Flask, Spring Boot, Docker, ECS, EKS, CloudWatch, Datadog, Splunk, pytest, JUnit, Karate, vector databases, RAG
3w
Save
Mark Applied
Hide
Sr AI Platform Engineer – Retrieval & Knowledge Systems
Fort Mill or Charlotte
$115k-$192k/yr OnsiteFull Time
8+ YOE8+ years backend/platform engineering experience building distributed systems, search/retrieval, APIs and cloud-native services; strong in Java, Python or Go; experience with indexing, vector retrieval, RAG, embeddings, LLM integration, and real-time data systems.
Java, Python, Go, Kubernetes, Elasticsearch, OpenSearch, Kafka, LLM
1mo
Save
Mark Applied
Hide
Principal - Software Engineer
Detroit or Charlotte
$110k-$180k/yr HybridFull Time
7+ YOE7+ years experience, Bachelor’s in Computer Science/Engineering or equivalent, expertise in automation, workflow orchestration, RPA, APIs, Python and Java, cloud (AWS/Azure), CI/CD, observability, and mentoring/technical leadership.
Python, Java, Robocorp, UiPath, Automation Anywhere, GitHub Copilot, Claude, AWS, Azure, RPA, CI/CD, LLM, RAG
Explore Jobs