14 ml infrastructure engineer jobs at 9 companies in North Carolina
1mo
Save
Mark Applied
Hide
Cluster Infrastructure Engineer
Morrisville, North Carolina, United States
OnsiteFull Time
2+ YOEBS/MS in CS/CE/EE,2+ years datacenter hardware/software experience,programming in C/C++,Python,Go,shell,knowledge of ML principles and frameworks,communication and leadership skills.
C/C++, Python, Go, shell scripting, PyTorch, LangChain, LangGraph, Autogen
3mo
Save
Mark Applied
Hide
Senior Kubernetes Platform Engineer - AI/ML Infrastructure
Research Triangle Park or Dallas or Allen
$137k-$201k/yr HybridFull Time
8+ YOE8+ years software engineering; 4+ years Kubernetes production experience; on-prem/self-managed Kubernetes; Go; etcd; Kubernetes internals; AI/ML or GPU workloads on Kubernetes; production incident management.
Kubernetes, OpenShift, Anthos, etcd, Go, Controllers, Operators, CRDs, Webhooks
1mo
Save
Mark Applied
Hide
Senior Kubernetes Platform Engineer - AI Infrastructure
Research Triangle Park or Dallas or Allen
$137k-$201k/yr HybridFull Time
8+ YOE8+ years software engineering experience, 4+ years Kubernetes production/control-plane experience, expertise with etcd and Go/Golang, experience with on-prem Kubernetes (OpenShift/Anthos), GPU/AI/ML workloads, incident response and on-call.
Kubernetes, OpenShift, Anthos, etcd, Golang, CRDs, Kubeflow, MLflow
1w
Save
Mark Applied
Hide
Senior Developer Relations Engineer, GKE and AI Infrastructure
Sunnyvale or Cambridge or Kirkland or New York City or Raleigh or Durham or Seattle
$163k-$236k/yr OnsiteFull Time
5+ YOEBachelor's in CS or equivalent,5+ years technical experience,2+ years running AI/ML workloads on GPUs/TPUs with Kubernetes/GKE,2+ years producing developer content,proficiency in Python and strong programming skills.
Kubernetes, GKE, GPU, TPU, Python, C++, Java, Vertex AI, Google Cloud
3d
Save
Mark Applied
Hide
Senior Data Engineer - AI Infrastructure Integration, High Performance Compute
New York City or Jersey City or Charlotte
$128k-$182k/yr OnsiteFull Time
15+ YOERequires 15+ years delivering technology, data science, analytics, automation, or infrastructure solutions; 7+ years applying AI/ML or NLP; strong Python, model lifecycle, SQL, APIs, pipelines, governance, and Agile experience.
Python, pandas, NumPy, scikit-learn, TensorFlow, PyTorch, spaCy, Hugging Face Transformers, Gensim, SQL, Jira, Kanban, Confluence, Tableau, Streamlit, Shiny, Jupyter, Red Hat OpenShift AI, NVIDIA AI
1w
Save
Mark Applied
Hide
AI Engineer - NC
North Carolina, United States
OnsiteFull Time
5+ YOE5+ years of AI/ML engineering experience evaluating, fine-tuning, and deploying LLMs in production; cloud infrastructure, RAG, embeddings, vector databases, agentic workflows, EvalOps, and production software engineering required.
LLM, AWS, GCP, RAG, EvalOps, Evals-as-a-Service, vector databases
3d
Save
Mark Applied
Hide
Senior Data Engineer - AI Infrastructure Integration, High Performance Compute
New York City or Jersey City or Charlotte
$128k-$182k/yr OnsiteFull Time
15+ YOE15+ years delivering technology or analytics solutions and 7+ years applying AI/ML. Requires Python, model lifecycle, NLP, data pipelines, SQL, APIs, CI/CD, governance, and stakeholder communication.
Python, pandas, NumPy, scikit-learn, TensorFlow, PyTorch, spaCy, Hugging Face Transformers, Gensim, SQL, Jira, Kanban, Confluence, Tableau, Streamlit, Shiny, Jupyter, Red Hat OpenShift AI, NVIDIA AI
1w
Save
Mark Applied
Hide
Sr. Technical Marketing Engineer
Morrisville or San Jose
$196k-$293k/yr OnsiteFull Time
15+ YOE15+ years in enterprise infrastructure or related fields; expertise in storage, cloud, compute, networking, virtualization, Linux, AI/ML, Kubernetes, and containers; bachelor's degree in a technical discipline required.
FlexPod, Linux, Kubernetes, IBM Storage Scale, Lustre, Cisco, Supermicro, Dell
2w
Save
Mark Applied
Hide
Senior Software Engineer, Generative AI, Google Meet
Raleigh or Durham
$174k-$252k/yr OnsiteFull Time
5+ YOEBachelor's or equivalent,5+ years software development,3+ years ML infrastructure experience,experience with GenAI concepts,EMR not mentioned,excellent communication and technical skills.
Gmail, Docs, Drive, Calendar, Sheets, Meet, Google DeepMind
3w
Save
Mark Applied
Hide
CCaas Data Engineer
Charlotte, North Carolina, United States
$100k-$130k/yr OnsiteFull Time
4+ YOE4+ years commercial software development; design and implement CCaaS/IVA, cloud infrastructure (GKE, Cloud Run, Cloud Functions), Terraform, BigQuery; build data pipelines; integrate AI/ML (Xgboost,SARIMA,Prophet,TensorFlow); Kafka and NoSQL/relational experience; Agile/CI/CD.
GKE, Cloud Run, Cloud Functions, Pub/Sub, Apigee, BigQuery, Terraform, Xgboost, SARIMA, Prophet, TensorFlow, Kafka, SIP, WebRTC
6d
Save
Mark Applied
Hide
Smart NIC Senior Software Engineer, Embedded
Raleigh or Durham
$174k-$252k/yr OnsiteFull Time
5+ YOEBachelor's degree or equivalent practical experience; 5 years C/C++ development, 3 years AI/ML networking and host stacks, large-scale infrastructure, and embedded operating systems experience.
C, C++, Google Cloud, Google ML Library, Smart NICs
2mo
Save
Mark Applied
Hide
Lead, AI Engineering
Charlotte, North Carolina, United States
$180k-$220k/yr HybridFull Time
8+ YOE3+ Mgmt8+ years AI/ML engineering; 3+ years leadership; strong Python and AI/ML framework experience; enterprise data and AI infrastructure expertise.
Python, SQL, PyTorch, TensorFlow, Scikit-learn, LangChain, AWS SageMaker, Azure ML, Vertex AI, Databricks, Delta Lake, Kubernetes, Docker, Terraform
1mo
Save
Mark Applied
Hide
AI Solutions Architect - East Region
Hartford or Washington or Tampa or Atlanta or Boston or Charlotte or Trenton or New York or Philadelphia or Pittsburgh
$185k-$235k/yr OnsiteFull Time
10+ YOESenior technical pre-sales architect with 10+ years of experience designing AI/ML infrastructure and platforms, hands-on NVIDIA and cloud experience, strong presentation and whiteboarding skills, and a bachelor’s degree in computer science, engineering, or related field.
NVIDIA DGX, NVIDIA HGX, CUDA, NVIDIA AI Enterprise (NVAIE), NeMo, Omniverse, AWS, Microsoft Azure, GCP, Dell, HPE, Cisco, NetApp, Pure Storage, Vast Data, Advanced Technology Center (ATC), MLOps
1mo
Save
Mark Applied
Hide
AI Solutions Architect - Global Financial Services
Hartford or Washington D.C. or Tampa or Atlanta or Boston or Charlotte or Trenton or New York or Philadelphia or Pittsburgh
$185k-$235k/yr OnsiteFull Time
10+ YOE10+ years in technical pre-sales or solutions architecture; bachelor's in CS/engineering; hands-on AI/ML infrastructure experience; NVIDIA and cloud platform knowledge; strong presentation and whiteboarding skills.
NVIDIA DGX/HGX, CUDA, AI Enterprise, NeMo, Omniverse, AWS, Azure, GCP, Dell, HPE, Cisco, NetApp, Pure Storage, Vast Data, Advanced Technology Center (ATC), NVAIE