109 rag engineer jobs at 57 companies in North Carolina
1mo
Save
Mark Applied
Hide
Principal Engineer - RAG Database & Embeddings Architect
Charlotte, North Carolina, United States
OnsiteFull Time
10+ YOE10+ years software/data/platform engineering with 5+ years designing large-scale systems and 2+ years working with LLM/RAG/vector search. Experience with vector DBs, embeddings, retrieval optimization, and enterprise/regulatory environments.
Azure AI Search, Cosmos DB vector search, Pinecone, Weaviate, Milvus, OpenSearch, Elasticsearch, PostgreSQL/pgvector, OpenAI, Azure OpenAI, Cohere, Hugging Face
1mo
Save
Mark Applied
Hide
Principal Engineer - RAG Database & Embeddings Architect
Charlotte, North Carolina, United States
OnsiteFull Time
10+ YOE10+ years engineering experience, 5+ years designing enterprise systems, 2+ years with LLM/RAG/vector search; strong vector DB, embeddings, retrieval, distributed systems, and API design skills; Bachelor’s in a technical field required.
Azure AI Search, Cosmos DB vector search, Pinecone, Weaviate, Milvus, OpenSearch, Elasticsearch, PostgreSQL/pgvector, OpenAI, Azure OpenAI, Cohere, Hugging Face
3mo
Save
Mark Applied
Hide
Principal Machine Learning Engineer I
Raleigh, North Carolina, United States
$136k-$253k/yr OnsiteFull Time
10+ YOE10+ years ML/software engineering experience, advanced degree preferred, strong systems architecture, LLM/RAG/agent experience, ML production deployment, CI/CD and responsible AI compliance.
LLM, Retrieval-Augmented Generation (RAG), CI/CD
1w
Save
Mark Applied
Hide
AI Engineer - NC
North Carolina, United States
OnsiteFull Time
5+ YOE5+ years of AI/ML engineering experience evaluating, fine-tuning, and deploying LLMs in production; cloud infrastructure, RAG, embeddings, vector databases, agentic workflows, EvalOps, and production software engineering required.
LLM, AWS, GCP, RAG, EvalOps, Evals-as-a-Service, vector databases
3mo
Save
Mark Applied
Hide
Lead AI Engineer — Productivity Systems
Durham or Miami or Palo Alto or Washington
$12k-$18k/mo HybridFull Time
Proven experience shipping LLM-powered systems in production; strong prompt/context engineering, evaluation and guardrail development, and software engineering skills (Python/TypeScript/Clojure).
Python, TypeScript, Clojure, n8n, Zapier, AWS, Claude Code, Cursor, Copilot, Slack, Google Workspace, Jira, Terraform, RAG, MCP
2w
Save
Mark Applied
Hide
Principal AI Engineer
Charlotte or Chicago or Columbus or Hartford
$168k-$253k/yr HybridFull Time
10+ YOEBachelor's degree in a technical field; 10+ years with cloud and software/platform infrastructure; Python and TypeScript; distributed systems, AI platforms, MLOps, RAG, vector search, and enterprise engineering.
Amazon Web Services (AWS), Google Cloud, Microsoft Azure, Python, TypeScript, CI/CD, Agile, LangGraph, crewai, NoSQL, ETL, RAG, ANN, KNN
2w
Save
Mark Applied
Hide
Forward Deployed Engineer (FDE) – Marketing & Sales AI Transformation
Morrisville, North Carolina, United States
HybridFull Time
5+ years in software/applied AI delivering AI/automation solutions, strong LLM, prompt engineering, RAG and enterprise integration experience; consulting or transformation background and strong communication skills.
Copilot Studio, Azure OpenAI, M365, Power Platform, CRM, CPQ, ERP, APIs, LLMs, Retrieval-Augmented Generation (RAG)
1w
Save
Mark Applied
Hide
Platform Engineer IV
Charlotte, North Carolina, United States
$137k-$219k/yr OnsiteFull Time
7+ YOEBachelor's or equivalent experience,7+ years building distributed/cloud-native platforms,3+ years on AI/ML platforms; experience with Amazon Bedrock,AWS AgentCore,MCP,RAG,vector DBs,Kong AI Gateway,Python,AWS,Kubernetes,CI/CD and platform governance.
Amazon Bedrock, AWS AgentCore, Model Context Protocol (MCP), Kong AI Gateway, Python, AWS, Kubernetes, CI/CD, Anthropic Claude, Amazon Nova, OpenAI, Google Gemini
1mo
Save
Mark Applied
Hide
Senior AI Platform Engineer
San Francisco or Alabama or Arkansas or California or Colorado or Florida or Georgia or Illinois or Kentucky or Massachusetts or Michigan or Montana or Missouri or Nevada or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Texas or Washington or Utah or Virginia or Wisconsin
$156k-$231k/yr HybridFull Time
3+ YOE3+ years building production software or ML/data systems; strong Python and systems/API design; experience with LLM retrieval/RAG, agents, evaluation, Databricks/MLflow and modern data stacks.
Python, PySpark, dbt, Databricks, Delta Lake, Unity Catalog, MLflow, Astronomer, Airflow, Claude, GitHub, Shortcut, Notion, pgvector, Pinecone, Weaviate, LangGraph, MCP
1mo
Save
Mark Applied
Hide
Staff Software Engineer, MWS Team
Durham or Denver or Rancho Cordova
$149k-$219k/yr RemoteFull Time
8+ YOEBachelor's or equivalent, 8+ years software engineering experience, 5+ years distributed systems, proficiency in Go/Python/Java, REST, cloud and Kubernetes experience, CI/CD and observability, experience with LLM/RAG pipelines preferred.
Go, Python, Java, CI/CD, Kubernetes, AWS, GCP, Azure, LLMs, RAG, MCP, REST
1mo
Save
Mark Applied
Hide
Principal AI Engineer
St. Petersburg or Alabama or Arizona or Florida or Georgia or Hawaii or Idaho or Louisiana or Maine or Maryland or Missouri or Montana or New Hampshire or New Jersey or New Mexico or New York or North Carolina or Oklahoma or Oregon or Texas or Utah or Virginia or West Virginia or Wisconsin
$180k-$200k/yr HybridFull Time
10+ YOE10+ years building production software and production AI applications; strong Python and AWS experience; ability to work across frontend, backend, cloud, and AI systems; debugging and architecture skills.
React, Next.js, TypeScript, Tailwind CSS, Python, Django, FastAPI, PostgreSQL, Redis, OpenAI, Anthropic, Gemini, RAG, vector databases, embeddings, AWS, ECS/Fargate, S3, Lambda, Terraform, Docker, Cloudflare, CI/CD
1mo
Save
Mark Applied
Hide
Senior ASIC Design Engineer - Agentic AI
Santa Clara or Durham or Austin
$168k-$311k/yr OnsiteFull Time
8+ YOEMaster's/PhD or equivalent, 8+ years experience, expertise in micro-architecture and RTL (Verilog), ASIC design flow, Python proficiency, and experience with LLM fine-tuning, RAG pipelines and vector databases.
Verilog, Python, large language models, RAG pipelines, vector databases
1mo
Save
Mark Applied
Hide
Senior ASIC Design Engineer - Agentic AI
Santa Clara or Austin or Durham
$168k-$311k/yr OnsiteFull Time
8+ YOEMaster's/PhD or equivalent experience, 8+ years experience, micro-architecture and RTL (Verilog) expertise, ASIC design flow knowledge, Python prototyping, experience with LLM fine-tuning, RAG pipelines, and vector databases.
Verilog, Python, RAG pipelines, vector databases, large language models
5d
Save
Mark Applied
Hide
Principal Software Engineer
Florida or North Carolina
$165k-$291k/yr RemoteFull Time
10+ YOE10+ years of software development, 2+ years with AI solutions, agentic AI expertise including RAG and MCP, Go, JavaScript, TypeScript, Kubernetes, AWS, microservices, REST APIs, and a bachelor's degree or equivalent.
AWS, Go, JavaScript, TypeScript, Kubernetes, Genesys Cloud, RAG, RAG pipelines, MCP, Amazon EKS, AWS Fargate, Amazon DynamoDB, Amazon EC2, Amazon ECS, AWS Lambda, Amazon S3, CloudFormation, AWS Step Functions, Docker, CI/CD, Terraform, RESTful API
2w
Save
Mark Applied
Hide
DevSecOps Platform Engineer
Fayetteville, North Carolina, United States
$78k-$176k/yr OnsiteFull Time
8+ YOE8+ years IT experience, 5+ years DevOps/DevSecOps, Kubernetes administration, IaC with Ansible/Terraform, Linux/Python/Bash, cloud services experience, TS/SCI clearance required.
Kubernetes, Ansible, Terraform, Linux, RHEL, Ubuntu, Python, Bash, AWS, Azure, Google Cloud, Prometheus, Grafana, ELK, OpenSearch, Istio, ArgoCD, Flux, Harbor, Nautobot, NetBox, Cisco, ServiceNow, SolarWinds, Platform One, Big Bang, Iron Bank, Kessel Run, LLM API, RAG
3d
Save
Mark Applied
Hide
Forward‑Deployed AI Engineer
Irving or Raleigh or Richardson or Tampa or Florida or North Carolina or Texas or United States
OnsiteFull Time
Bachelor’s degree or foreign equivalent, or progressive experience in lieu of education. Requires Python, Java, TypeScript, LLM APIs, agent development, MCP, LangChain, LlamaIndex, and RAG pipelines.
Python, TypeScript, Java, LLM APIs, MCP, LangChain, LlamaIndex, RAG, Vector Databases, RAGAS, Claude Code, GitHub Copilot, Visual Studio Code, IntelliJ IDEA, Microsoft Excel
1w
Save
Mark Applied
Hide
Senior Specialty Software Engineer
Iselin or Charlotte
$119k-$224k/yr OnsiteFull Time
4+ YOE4+ years specialty software engineering and software development experience; experience with cloud, containers, CI/CD, microservices, AI (RAG/agentic), and enterprise-grade engineering practices.
Java, C#, JavaScript, Golang, Temporal.io, GitHub Actions, Harness, GitLab, Jenkins, Azure DevOps, Red Hat OpenShift (OCP), Azure Kubernetes Service (AKS), Google Kubernetes Engine (GKE), Amazon EKS, Kubernetes, Amazon Web Services, Microsoft Azure, Google Cloud Platform, Amazon CDK
5d
Save
Mark Applied
Hide
Google Agentic AI Delivery Senior Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$266k/yr HybridFull Time
5+ YOEBachelor's degree or equivalent experience; 5+ years client-facing technology experience; 5+ years cloud architecture, including 4 years GCP; agentic AI, Agile, consulting, and communication expertise.
Google Cloud Platform, Vertex AI, Google Gemini, BigQuery, Google Cloud, Terraform, AWS, Microsoft Azure, Microsoft Azure Foundry, Microsoft Copilot, AWS Bedrock, GKE, Apigee, CI/CD, RAG
1mo
Save
Mark Applied
Hide
Senior AI Agentic Engineer
Charlotte or United States
OnsiteFull Time
7+ YOEBachelor's in CS or related, 7+ years software development experience, strong Python and TypeScript/JavaScript skills, production experience building agentic AI systems, RAG/vector store experience, CI/CD, observability, and enterprise integrations.
Python, TypeScript, JavaScript, RAG, vector stores, CI/CD, Forge, Microsoft Azure, Microsoft Copilot, Microsoft Copilot Studio, Microsoft Power Platform
2mo
Save
Mark Applied
Hide
Software Engineer
Charlotte, North Carolina, United States
$92k-$115k/yr HybridFull Time
Strong programming in Python/JavaScript/TypeScript/PHP/Go; experience building backend systems, APIs, and data pipelines; familiarity with cloud platforms (AWS/GCP/Azure), SQL/NoSQL, and AI APIs (OpenAI/Anthropic); basics of prompt engineering, embeddings, and RAG.
Python, JavaScript, TypeScript, PHP, Go, Amazon Web Services, Google Cloud Platform, Microsoft Azure, SQL, NoSQL, OpenAI, Anthropic, Pinecone, Weaviate, LangChain, LlamaIndex, Docker, Kubernetes, React, Next.js
Explore Jobs
Expand Your Job Search
Top Cities in North Carolina for Rag Engineer
- Rag Engineer jobs in Charlotte, NC
- Rag Engineer jobs in Raleigh, NC
- Rag Engineer jobs in Greensboro, NC
- Rag Engineer jobs in Durham, NC
- Rag Engineer jobs in Winston-Salem, NC
- Rag Engineer jobs in Fayetteville, NC
- Rag Engineer jobs in Cary, NC
- Rag Engineer jobs in Wilmington, NC
- Rag Engineer jobs in High Point, NC
- Rag Engineer jobs in Greenville, NC
- Rag Engineer jobs in Asheville, NC
- Rag Engineer jobs in Concord, NC
- Rag Engineer jobs in Gastonia, NC
- Rag Engineer jobs in Jacksonville, NC
- Rag Engineer jobs in Chapel Hill, NC
- Rag Engineer jobs in Rocky Mount, NC
- Rag Engineer jobs in Huntersville, NC
- Rag Engineer jobs in Burlington, NC
- Rag Engineer jobs in Wilson, NC
- Rag Engineer jobs in Kannapolis, NC