66 rag engineer jobs at 27 companies in Harrisburg, NC

1mo
Save
Mark Applied
Hide
Principal Engineer - RAG Database & Embeddings Architect
Charlotte, North Carolina, United States
OnsiteFull Time
Bank of America
Bank of AmericaNYSE: BAC: Provides banking, investment, and financial risk management services.
10+ YOE10+ years software/data/platform engineering with 5+ years designing large-scale systems and 2+ years working with LLM/RAG/vector search. Experience with vector DBs, embeddings, retrieval optimization, and enterprise/regulatory environments.
Azure AI Search, Cosmos DB vector search, Pinecone, Weaviate, Milvus, OpenSearch, Elasticsearch, PostgreSQL/pgvector, OpenAI, Azure OpenAI, Cohere, Hugging Face
1mo
Save
Mark Applied
Hide
Principal Engineer - RAG Database & Embeddings Architect
Charlotte, North Carolina, United States
OnsiteFull Time
Bank of America
Bank of AmericaNYSE: BAC: Provides global banking, investing, and financial risk management services.
10+ YOE10+ years engineering experience, 5+ years designing enterprise systems, 2+ years with LLM/RAG/vector search; strong vector DB, embeddings, retrieval, distributed systems, and API design skills; Bachelor’s in a technical field required.
Azure AI Search, Cosmos DB vector search, Pinecone, Weaviate, Milvus, OpenSearch, Elasticsearch, PostgreSQL/pgvector, OpenAI, Azure OpenAI, Cohere, Hugging Face
3w
Save
Mark Applied
Hide
Principal AI Engineer
Charlotte or Chicago or Columbus or Hartford
$168k-$253k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides property and casualty insurance and financial products.
10+ YOEBachelor's degree in a technical field; 10+ years with cloud and software/platform infrastructure; Python and TypeScript; distributed systems, AI platforms, MLOps, RAG, vector search, and enterprise engineering.
Amazon Web Services (AWS), Google Cloud, Microsoft Azure, Python, TypeScript, CI/CD, Agile, LangGraph, crewai, NoSQL, ETL, RAG, ANN, KNN
2w
Save
Mark Applied
Hide
Platform Engineer IV
Charlotte, North Carolina, United States
$137k-$219k/yr OnsiteFull Time
Capital Group
Capital Group: Providing active investment management and research-driven financial strategies
7+ YOEBachelor's or equivalent experience,7+ years building distributed/cloud-native platforms,3+ years on AI/ML platforms; experience with Amazon Bedrock,AWS AgentCore,MCP,RAG,vector DBs,Kong AI Gateway,Python,AWS,Kubernetes,CI/CD and platform governance.
Amazon Bedrock, AWS AgentCore, Model Context Protocol (MCP), Kong AI Gateway, Python, AWS, Kubernetes, CI/CD, Anthropic Claude, Amazon Nova, OpenAI, Google Gemini
1w
Save
Mark Applied
Hide
Google Agentic AI Delivery Senior Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$266k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
5+ YOEBachelor's degree or equivalent experience; 5+ years client-facing technology experience; 5+ years cloud architecture, including 4 years GCP; agentic AI, Agile, consulting, and communication expertise.
Google Cloud Platform, Vertex AI, Google Gemini, BigQuery, Google Cloud, Terraform, AWS, Microsoft Azure, Microsoft Azure Foundry, Microsoft Copilot, AWS Bedrock, GKE, Apigee, CI/CD, RAG
3d
Save
Mark Applied
Hide
Gen AI Engineer
Charlotte or Plano
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Bachelor's degree or equivalent, or progressive specialty experience; generative AI, LLMs, agentic frameworks, RAG, prompt engineering, conversational AI, and strong Python programming experience required.
SAS, R, Python, RDBMS, LangChain
1mo
Save
Mark Applied
Hide
Senior AI Agentic Engineer
Charlotte or United States
OnsiteFull Time
Truist
TruistNYSE: TFC: Offers personal banking, business lending, and investment management services.
7+ YOEBachelor's in CS or related, 7+ years software development experience, strong Python and TypeScript/JavaScript skills, production experience building agentic AI systems, RAG/vector store experience, CI/CD, observability, and enterprise integrations.
Python, TypeScript, JavaScript, RAG, vector stores, CI/CD, Forge, Microsoft Azure, Microsoft Copilot, Microsoft Copilot Studio, Microsoft Power Platform
1w
Save
Mark Applied
Hide
Observability & Evaluation Engineer
Charlotte, North Carolina, United States
HybridFull Time
NTT DATA
NTT DATATokyo Stock Exchange: 9613: Provides global digital technology consulting and IT services.
7+ YOERequires 7+ years of engineering experience, 5+ years of Python, observability, LLM evaluation, Agile, and production support experience; knowledge of RAG, AI quality, telemetry, and monitoring.
Python, Kubernetes, CI/CD
18h
Save
Mark Applied
Hide
Associate AI Engineer, Finance Transformation
San Francisco or New York City or Salt Lake City or Jacksonville or Charlotte or Seattle or Cottonwood Heights or Frisco
$83k-$156k/yr OnsiteFull Time
SoFi
SoFiNasdaq: SOFI: Mobile-first platform for banking, lending, and investment services.
1+ YOEBachelor's or master's degree or equivalent experience; 1–3 years building with LLMs or exceptional new-grad projects; hands-on LLM APIs, prompt engineering, RAG, or agent frameworks; Python and basic SQL.
LLM APIs, Python, SQL, Snowflake, Cortex
1mo
Save
Mark Applied
Hide
Generative AI Engineer _ Copilot Studio
Charlotte, North Carolina, United States
$110k-$125k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
10+ YOE10+ years experience; hands-on Microsoft Copilot Studio; Generative AI/LLMs (Azure OpenAI preferred); prompt engineering, RAG, conversational AI; Power Platform and Microsoft 365 integrations.
Microsoft Copilot Studio, Azure OpenAI, Power Platform, Power Automate, Power Apps, Microsoft 365, Teams, SharePoint, Outlook, CI/CD, Agile
3w
Save
Mark Applied
Hide
AIDLC Engineer/FDE IRC296103
Atlanta or Austin or Charlotte or Chicago or Denver or New York City or Philadelphia or San Diego or San Francisco or Seattle or United States
$180k-$250k/yr RemoteFull Time
GlobalLogic
GlobalLogic: Digital product engineering and software development services provider.
15+ YOESenior architect/engineer with customer-facing experience, strong AI governance knowledge, and experience with modern AI development tools and agentic workflows.
Claude Code, Google Cloud Code, OpenAI Codex, GitHub Copilot, Cursor, Windsurf, LangChain, AutoGen, LlamaIndex, Semantic Kernel, MCP, RAG, Vector Databases
1mo
Save
Mark Applied
Hide
Forward Deployed Engineer
Mountain View or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Pittsburgh or Hartford or St. Louis or Miami or Sacramento or Beaverton or Raleigh or Minneapolis or Scottsdale or Morristown or San Francisco or Denver or Boston or Philadelphia or Des Moines or Overland Park or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Detroit or Nashville or Los Angeles or San Diego
$28-$99/hr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years designing and building AI systems, experience with RAG, prompt engineering, model fine-tuning, cloud application services, programming in Python/JavaScript/Java/GoLang, CI/CD, and 1+ year team leadership; bachelor\u0002s degree or equivalent.
Python, JavaScript, Java, Spring, GoLang, Autogen, LangGraph, Semantic Kernel, Evals, Continuous Integration, Continuous Delivery, AWS, GCP, Azure, Anthropic
3w
Save
Mark Applied
Hide
Senior Software Engineer, AI Platform
Charlotte, North Carolina, United States
OnsiteFull Time
isolved
isolved: Cloud-based human capital management software for workforce operations.
5+ YOE5+ years software engineering experience with Python primary; 2+ years building production LLM systems (RAG, agentic patterns); proficiency with C#/.NET, Azure OpenAI/AI Foundry, agentic frameworks, observability and SDK/platform development.
Python, C#, .NET, Semantic Kernel, LangGraph, LangChain, Azure AI Foundry, Azure OpenAI, TypeScript, Terraform, Azure Container Apps
2mo
Save
Mark Applied
Hide
Senior AI Platform Engineer
Chicago or Hopkins or Minneapolis or Cincinnati or Charlotte
$124k-$146k/yr HybridFull Time
U.S. Bank
U.S. BankNYSE: USB: Provider of personal, business, and institutional financial services.
5+ YOEBachelor’s degree or equivalent experience, 5+ years software/platform engineering, 2+ years hands-on GenAI (LLMs, RAG, vector DBs), proficiency with Python, cloud (Azure/AWS), Docker, Kubernetes, and IaC (Terraform/ARM/Bicep).
LangChain, LangGraph, Microsoft Foundry Agent Service, Retrieval-Augmented Generation (RAG), LLMs, vector databases, Azure, AWS, Docker, Kubernetes, Terraform, ARM, Bicep, Python, CI/CD
2w
Save
Mark Applied
Hide
Applied AI Field Engineer
Charlotte, North Carolina, United States
$155k-$190k/yr OnsiteFull Time
Trilon Group
Trilon Group: Providing engineering and design services for community infrastructure.
4+ YOERequires 4+ years in software engineering, applied AI, or machine learning; Python and/or JavaScript; LLM APIs; prompt architectures; RAG pipelines; vector databases; agent frameworks; and strong collaboration and communication skills.
Python, JavaScript, Anthropic Claude, OpenAI
2mo
Save
Mark Applied
Hide
Senior Staff AI Data Engineer - Hybrid
Hartford or Charlotte or Columbus or Chicago
$135k-$203k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
8+ YOEBachelor's in CS/AI or related, 8+ years data engineering experience, expertise in SQL, data modeling, ETL/ELT, Python, cloud ecosystems (AWS/GCP/Azure/Snowflake), GenAI/RAG, vector/graph DBs, and ability to design scalable, governed AI data platforms.
Retrieval-Augmented Generation (RAG), Snowpipe, Snowflake, Python, SQL, AWS, GCP, Azure, Scaled Agile
1w
Save
Mark Applied
Hide
Analytics Engineer
Chicago or Atlanta or Tampa or Houston or Raleigh or Charlotte or Charleston or Southlake
$92k-$130k/yr OnsiteFull Time
Greystar
Greystar: Provides global property management and real estate investment services.
3+ YOERequires 3+ years in analytics or data, advanced SQL, Python, data modeling, Databricks, BI tools, experiment design, and AI coding-tool experience; quantitative education or equivalent experience preferred.
SQL, Python, Databricks, AI coding assistants, Claude Code, Cursor, Codex, dbt, Apache Spark, Delta Lake, Unity Catalog, Microsoft Power BI, Tableau, Qlik, Streamlit, Power Platform, Azure, Azure Data Lake Storage (ADLS), Azure Machine Learning (Azure ML), Azure Synapse, PostgreSQL, Git, CI/CD, Great Expectations, Monte Carlo, MCP, RAG, LLMs, GPS, Podium
2mo
Save
Mark Applied
Hide
Product Developer- CH- AXS
Charlotte, North Carolina, United States
$75k-$100k/yr HybridFull Time
AEG Worldwide
AEG Worldwide: Operates live entertainment venues and professional sports franchises worldwide.
Full‑stack development experience with AI integration (LLMs, vector search, RAG); frontend (React/Next.js/Astro), backend (Node.js/PHP/Python), REST/GraphQL, cloud (AWS/GCP); production shipping experience and product mindset.
React, Next.js, Astro, Node.js, PHP, Python, REST, GraphQL, OpenAI, Anthropic, Pinecone, Weaviate, Upstash Vector, AWS, GCP
1mo
Save
Mark Applied
Hide
MarTech Principal, Autonomous Marketing and Engagement Engine
Concord or Charlotte
$159k-$305k/yr HybridFull Time
Wells Fargo
Wells FargoNYSE: WFC: Global provider of banking, investment, and mortgage financial services.
7+ YOE7+ years engineering experience with Pega PRPC and Pega Customer Decision Hub, AI/LLM/RAG experience, Python/Java coding, AI orchestration and enterprise integration, strong security and compliance aptitude.
Pega PRPC, Pega Customer Decision Hub, Generative AI, Agentic AI, Large Language Models, RAG, LangGraph, LangChain, Python, Java, REST, Kubernetes, OpenShift, Docker, Helm, CI/CD, vector databases
1mo
Save
Mark Applied
Hide
Sr AI Platform Engineer – Retrieval & Knowledge Systems
Fort Mill or Charlotte
$115k-$192k/yr OnsiteFull Time
LPL Financial
LPL FinancialNASDAQ: LPLA: Provides independent financial advisory and wealth management services.
8+ YOE8+ years backend/platform engineering experience building distributed systems, search/retrieval, APIs and cloud-native services; strong in Java, Python or Go; experience with indexing, vector retrieval, RAG, embeddings, LLM integration, and real-time data systems.
Java, Python, Go, Kubernetes, Elasticsearch, OpenSearch, Kafka, LLM