75 ai infrastructure engineer jobs at 40 companies in North Carolina
5d
Save
Mark Applied
Hide
AI Infrastructure Engineer
Charlotte, North Carolina, United States
OnsiteFull Time
5+ YOEBachelor’s degree in computer science, engineering, information systems, or related field; 5+ years of infrastructure engineering experience; strong enterprise infrastructure technology knowledge.
3w
Save
Mark Applied
Hide
AI Infrastructure Engineer
Charlotte, North Carolina, United States
$140k-$170k/yr OnsiteFull Time
8+ YOE8+ years in LLM/MLOps and MLOps platforms; experience with Terraform, Docker, cloud (AWS), Kubernetes, CI/CD, Python/PySpark/Bash; production AI/platform deployment and security best practices.
Docker, Terraform, AWS, GitHub Actions, GitLab CI, Kubernetes, Python, PySpark, Bash
2w
Save
Mark Applied
Hide
AI & HPC Infrastructure Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irvine or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$266k/yr HybridFull Time
5+ YOERequires 5+ years designing AI infrastructure, accelerated computing, clusters, orchestration, and automation; bachelor's degree or equivalent experience. Strong Kubernetes, Python, Terraform, and cloud expertise required.
Slurm, Run:ai, Kubernetes, NVIDIA Base Command Manager (BCM), NVIDIA NGC, NCCL, NVLink, CUDA, TensorRT-LLM, vLLM, SGLang, Triton Inference Server, NVIDIA Dynamo, llm-d, MLPerf, NCCL tests, fio, iperf, InfiniBand, Ethernet, SONiC, NVMe, NVMe-oF, VAST, Weka, DDN, AWS, Azure, GCP, VMware, Nutanix, Python, Terraform, Ansible, REST, OpenAPI, JSON, YAML, TensorFlow, PyTorch, JAX, Jupyter notebooks, Google Colab, MCP
2mo
Save
Mark Applied
Hide
Executive Director, AI Infrastructure & Platform Engineering
New York or Mississippi or Montana or North Carolina or Louisiana or Maryland or Maine or Minnesota or Nebraska or Missouri or North Dakota or New Jersey or New Mexico or Nevada or Ohio or South Carolina or Texas or Rhode Island or South Dakota or Vermont or Tennessee or Virginia or Washington or Utah or Wisconsin or West Virginia or Oregon or Wyoming or Oklahoma or Pennsylvania or Colorado or Alabama or Arizona or California or Connecticut or District of Columbia or Florida or Hawaii or Iowa or Alaska or Arkansas or Idaho or Illinois or Kansas or Delaware or Georgia or Indiana or Kentucky or Michigan or Massachusetts or New Hampshire
$175k-$335k/yr RemoteFull Time
10+ YOE5+ Mgmt10+ years engineering leadership with data center-scale infrastructure experience; hands-on bare-metal Kubernetes/OpenShift; experience with high-speed fabrics and GPU clusters; Bachelor's required.
Kubernetes, OpenShift, EKS, GKE, AKS, RoCE v2, InfiniBand, EVPN-VXLAN, Cisco UCS, NVIDIA HGX, NVIDIA DGX, NVIDIA Blackwell, VAST, NVMe, NVIDIA AI Enterprise, NVIDIA Run:AI, NVIDIA Base Command Manager, HIPAA, NIST AI RMF
3w
Save
Mark Applied
Hide
AI Engineer - NC
North Carolina, United States
OnsiteFull Time
5+ YOE5+ years of AI/ML engineering experience evaluating, fine-tuning, and deploying LLMs in production; cloud infrastructure, RAG, embeddings, vector databases, agentic workflows, EvalOps, and production software engineering required.
LLM, AWS, GCP, RAG, EvalOps, Evals-as-a-Service, vector databases
1mo
Save
Mark Applied
Hide
Principal AI Engineer
Charlotte or Chicago or Columbus or Hartford
$168k-$253k/yr HybridFull Time
10+ YOEBachelor's degree in a technical field; 10+ years with cloud and software/platform infrastructure; Python and TypeScript; distributed systems, AI platforms, MLOps, RAG, vector search, and enterprise engineering.
Amazon Web Services (AWS), Google Cloud, Microsoft Azure, Python, TypeScript, CI/CD, Agile, LangGraph, crewai, NoSQL, ETL, RAG, ANN, KNN
1mo
Save
Mark Applied
Hide
Senior ASIC Front End Infrastructure Engineer
Santa Clara or Durham or Austin or Westford
$184k-$357k/yr OnsiteFull Time
8+ YOEMaster's degree or equivalent in engineering or computer science, 8+ years of relevant experience, programming proficiency, AI automation, distributed build systems, CI pipelines, and ASIC or CPU verification knowledge.
Python, Perl, Make, Jenkins, ML, DL, AI, Continuous Integration
2mo
Save
Mark Applied
Hide
Senior Kubernetes Platform Engineer - AI Infrastructure
Research Triangle Park or Dallas or Allen
$137k-$201k/yr HybridFull Time
8+ YOE8+ years software engineering experience, 4+ years Kubernetes production/control-plane experience, expertise with etcd and Go/Golang, experience with on-prem Kubernetes (OpenShift/Anthos), GPU/AI/ML workloads, incident response and on-call.
Kubernetes, OpenShift, Anthos, etcd, Golang, CRDs, Kubeflow, MLflow
5d
Save
Mark Applied
Hide
Principal Engineer - AI Engineering
Concord or Charlotte or San Francisco
$159k-$305k/yr OnsiteFull Time
7+ YOERequires 7+ years engineering experience, 5+ years programming, infrastructure as code, cloud, and automation experience, plus 2+ years designing AI, generative AI, or agentic automation solutions.
GCP Vertex AI, Azure Machine Learning, Kubernetes, OpenShift Container Platform (OCP), Google Kubernetes Engine (GKE), Python, Java, Shell scripting, Terraform, Crossplane, Ansible, Harness CD, GitHub Actions, Playwright, Model Development Lifecycle (MDLC), MLOps, Generative AI, Retrieval-Augmented Generation (RAG), Large Language Models, vector databases, prompt engineering, Model Context Protocol (MCP), LangGraph, CrewAI, Microsoft AutoGen, LangChain, Chainlit, SQL, TensorFlow, PyTorch
3w
Save
Mark Applied
Hide
Senior Developer Relations Engineer, GKE and AI Infrastructure
Sunnyvale or Cambridge or Kirkland or New York City or Raleigh or Durham or Seattle
$163k-$236k/yr OnsiteFull Time
5+ YOEBachelor's in CS or equivalent,5+ years technical experience,2+ years running AI/ML workloads on GPUs/TPUs with Kubernetes/GKE,2+ years producing developer content,proficiency in Python and strong programming skills.
Kubernetes, GKE, GPU, TPU, Python, C++, Java, Vertex AI, Google Cloud
3mo
Save
Mark Applied
Hide
Senior ASIC Front End Infrastructure Engineer
Santa Clara or Westford or Austin or Durham
$184k-$357k/yr OnsiteFull Time
8+ YOE8+ years experience; Masters in Electrical Engineering, Computer Engineering, Computer Science or related; Python/Perl; AI tooling; Make; CI (Jenkins); strong problem solving; ASIC/CPU verification knowledge.
Python, Perl, Make, Jenkins
2w
Save
Mark Applied
Hide
Staff Engineer, Data and AI
United States or Canada or Mexico or Alaska or Arizona or California or Colorado or Connecticut or District of Columbia or Florida or Georgia or Illinois or Iowa or Kansas or Maryland or Massachusetts or Michigan or Minnesota or Missouri or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Rhode Island or Texas or Vermont or Virginia or Washington or Wisconsin or Alberta or British Columbia or Ontario
RemoteFull Time
7+ YOE7+ years of software engineering experience; expertise in distributed data systems, Python, SQL, cloud-native infrastructure, AI platforms, production operations, observability, and technical leadership.
Python, SQL, Airflow, Kafka, Redshift, Glue, Vector DBs, Spark, AWS, GCP
3mo
Save
Mark Applied
Hide
Senior ASIC Front End Infrastructure Engineer
Santa Clara or Durham or Austin or Westford
$184k-$357k/yr OnsiteFull Time
8+ YOEMaster's degree (or equivalent) in EE/CE/CS, 8+ years relevant experience, Python/Perl programming, CI/build system experience (Make, Jenkins), AI tooling experience, verification domain knowledge, strong debugging and problem-solving skills.
Python, Perl, Make, Jenkins, containers
2mo
Save
Mark Applied
Hide
Principal AI Platform Engineer
Florida or Texas or Illinois or New York or New Jersey or Alabama or Arizona or Arkansas or Colorado or Connecticut or Delaware or Georgia or Indiana or Kansas or Massachusetts or Missouri or North Carolina or Tennessee or Utah or Wisconsin
$155k-$175k/yr RemoteFull Time
7+ YOEBachelor's or equivalent, 7+ years software engineering experience building platform/infrastructure; hands-on with Python/TypeScript, REST/GraphQL, cloud (AWS), Docker/Kubernetes, IAM, LLM/agent integrations, CI/CD and observability.
Python, TypeScript, Go, C#, Node, REST API, GraphQL, Model Context Protocol (MCP), AWS, EKS, Docker, Kubernetes, OAuth2, OIDC, Keycloak, Entra ID, Auth0, Bash, PowerShell, GitLab CI, Helm
6d
Save
Mark Applied
Hide
Senior Automation Engineer, OT Infrastructure & Integration
Wilson, North Carolina, United States
OnsiteFull Time
6+ YOEBachelor's degree in a technical field and 6+ years of manufacturing OT infrastructure or automation experience in GMP-regulated environments, with expertise in networking, virtualization, integration, cybersecurity, and lifecycle support.
OSI PI, Cisco, Emerson DeltaV, Werum PAS-X, DCS/PAS, PLC, SCADA/HMI, MES, BAS, Microsoft Active Directory, VLANs, Artificial Intelligence (AI), Machine Learning (ML)
1w
Save
Mark Applied
Hide
Senior Data Engineer - AI Infrastructure Integration, High Performance Compute
Jersey City or New York City or Charlotte
$141k-$205k/yr OnsiteFull Time
15+ YOERequires 15+ years in data science, software, analytics, automation, cloud, or infrastructure solutions; 7+ years applying AI/ML; strong Python, model lifecycle, enterprise data, governance, and communication expertise.
Python, pandas, NumPy, scikit-learn, TensorFlow, PyTorch, spaCy, Hugging Face Transformers, Gensim, SQL, Jira, Kanban, Confluence, CI/CD, Red Hat OpenShift AI, NVIDIA AI, Tableau, Streamlit, Shiny, Jupyter
2mo
Save
Mark Applied
Hide
Principal Product Manager Hardware, Cloud Infrastructure and AI Networking
North Carolina or California or United States
$172k-$349k/yr RemoteFull Time
5+ YOEBS/MS in CS/Engineering or related; 5+ years product management in IP networking; expertise in network hardware, systems, or ASICs; strong strategic, technical, and communication skills; experience with hyperscalers/cloud customers preferred.
1mo
Save
Mark Applied
Hide
Staff Software Development Engineer - Enterprise AI Infrastructure - #4898
Menlo Park or Sunnyvale or Durham
$147k-$224k/yr HybridFull Time
8+ YOEBachelor's degree (advanced degree preferred),8+ years cloud and software engineering experience, deep AWS/EKS and Kubernetes expertise, agentic AI and LLM orchestration experience, proficiency in Python/TypeScript/Go and IaC (Terraform,AWS CDK).
Amazon EKS, AWS, Bedrock, OpenSearch Serverless, KMS, VPC, Model Context Protocol (MCP), Google Workspace, Slack, Okta, Auth0, JWT, Cedar policy engine, Kubernetes, AWS CloudTrail, OpenTelemetry, LangChain, LangGraph, AutoGen, Claude Agent SDK, Python, TypeScript, Go, Terraform, AWS CDK, OpenSearch, FAISS, pgvector, Helm, CI/CD
2mo
Save
Mark Applied
Hide
Let's begin! VP Mgr-Applied AI Engineering (12365)
Charlotte, North Carolina, United States
$169k-$245k/yr OnsiteFull Time
Leadership in enterprise AI engineering, deep expertise with LLMs, AI architecture, CI/CD and infrastructure, experience managing technical teams, and a bachelor’s degree in CS/engineering (advanced degree preferred).
LLMs, CI/CD, DevOps, UI/UX, Infrastructure as Code
2mo
Save
Mark Applied
Hide
VP Mgr-Applied AI Engineering
Charlotte, North Carolina, United States
$169k-$245k/yr OnsiteFull Time
Deep LLM and AI architecture expertise; leadership of technical teams; AI evaluation, routing, fine-tuning, DevOps, infrastructure, governance, and responsible AI experience; bachelor's or master's degree in a technical field.
LLMs, UI/UX, DevOps, CI/CD, infrastructure as code
Explore Jobs
Expand Your Job Search
Top Cities in North Carolina for AI Infrastructure Engineer
- AI Infrastructure Engineer jobs in Charlotte, NC
- AI Infrastructure Engineer jobs in Raleigh, NC
- AI Infrastructure Engineer jobs in Greensboro, NC
- AI Infrastructure Engineer jobs in Durham, NC
- AI Infrastructure Engineer jobs in Winston-Salem, NC
- AI Infrastructure Engineer jobs in Fayetteville, NC
- AI Infrastructure Engineer jobs in Cary, NC
- AI Infrastructure Engineer jobs in Wilmington, NC
- AI Infrastructure Engineer jobs in High Point, NC
- AI Infrastructure Engineer jobs in Greenville, NC
- AI Infrastructure Engineer jobs in Asheville, NC
- AI Infrastructure Engineer jobs in Concord, NC
- AI Infrastructure Engineer jobs in Gastonia, NC
- AI Infrastructure Engineer jobs in Jacksonville, NC
- AI Infrastructure Engineer jobs in Chapel Hill, NC
- AI Infrastructure Engineer jobs in Rocky Mount, NC
- AI Infrastructure Engineer jobs in Huntersville, NC
- AI Infrastructure Engineer jobs in Burlington, NC
- AI Infrastructure Engineer jobs in Wilson, NC
- AI Infrastructure Engineer jobs in Kannapolis, NC