5,476 llm engineer jobs at 2,261 companies in United States

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
1mo
Save
Mark Applied
Hide
LLM Inference Engineer
Los Altos, California, United States
OnsiteFull Time
Majestic Labs
Majestic Labs: Developing memory-first AI server platforms for data centers.
3+ YOE3+ years building or operating production LLM inference systems; strong Python and C++; experience with vLLM/SGLang/TensorRT-LLM/Fireworks; distributed inference and performance profiling skills.
vLLM, SGLang, TensorRT-LLM, Fireworks, Python, C++, collective communication library (CCL)
1w
Save
Mark Applied
Hide
LLM Inference Engineer
San Francisco or United States
RemoteFull Time
NEAR AI
NEAR AI: Building private, verifiable infrastructure for autonomous AI agents.
Expert in LLM inference and serving systems, optimizing throughput/latency/cost for open-source LLMs, deep GPU architecture knowledge, and experience with PyTorch, Triton, CUDA and inference engines like vLLM/SGLang/TensorRT.
SGLang, vLLM, TensorRT, PyTorch, Triton, CuTe, CUDA
2w
Save
Mark Applied
Hide
Principal LLM Inference Engineer
Santa Clara, California, United States
$195k-$285k/yr HybridFull Time
d-Matrix: Develops high-performance semiconductor chips for generative AI inference.
10+ YOEBachelor's in CS/EE (or equivalent) with 10+ years experience (Master/PhD with 6+ years preferred); strong Python and C/C++; experience optimizing LLM inference, quantization, batching, GPU kernel programming and contributor-level work on inference frameworks.
Python, C, C++, vLLM, SGLang, TensorRT-LLM, ONNX Runtime, CUDA, Triton, JAX
1mo
Save
Mark Applied
Hide
Senior LLM Systems Engineer
United States
$100k-$200k/yr RemoteFull Time
Risk Labs
Risk Labs: Develops decentralized oracle and cross-chain interoperability protocols for Web3.
3+ YOE3+ years software engineering; production systems with LLMs; evaluations, testing, monitoring; strong debugging; prompt engineering; good communication.
Python, TypeScript, PostgreSQL, GCP, Cloud Run, GitHub Actions, Terraform, React, Node.js, Solidity, LLM APIs
4w
Save
Mark Applied
Hide
Staff ML/LLM Ops Engineer
Seattle, Washington, United States
$213k-$272k/yr OnsiteFull Time
LiveView Technologies
LiveView Technologies: Provides mobile, solar-powered security units with AI-driven surveillance software.
8+ YOE8+ years in ML-infrastructure/MLOps building and operating model deployment, serving, CI/CD, monitoring, and LLM/VLM ops; strong API design and technical leadership; BS/MS in CS/Engineering or equivalent experience.
Kubernetes, Argo, LangGraph, MCP, NVIDIA Jetson, vector databases
1w
Save
Mark Applied
Hide
AI/LLM Engineer
New York, New York, United States
$120k-$130k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOEStrong Python engineering, experience with agent frameworks (LangChain/LangGraph), EMR/data platform integration (Snowflake, Databricks), 8+ years experience, bachelor in computer science.
Python, LangChain, LangGraph, Snowflake, Databricks
3mo
Save
Mark Applied
Hide
LLM Serving Engineer (Cloud AI Engineering), Senior / Staff Engineer
San Diego or Markham
$158k-$238k/yr OnsiteFull Time
Qualcomm
QualcommNASDAQ: QCOM: Designs and manufactures semiconductors and wireless telecommunications products.
4+ YOEExperience building scalable LLM inference platforms, strong Python and PyTorch skills, CS fundamentals, distributed systems and ML accelerator knowledge; MS/PhD preferred. Bachelor's +4 years (or Master's +3 / PhD +2).
vLLM, SGLang, TGI, Triton Inference Server, Dynamo, LLM-d, Ollama, KServe, LMCache, MoonCake, PyTorch, Python, CUDA, torch.compile, torchDynamo
3w
Save
Mark Applied
Hide
AI/LLM Safety Engineer
Overland Park, Kansas, United States
RemoteFull Time
Propio Language Services
Propio Language Services: Provides tech-enabled language interpretation, translation, and localization services.
4+ YOE4+ years building production software with ML/LLM security experience; production-grade Python coding, threat modeling, safety evaluation/red-teaming, and understanding of LLM risks (prompt injection, jailbreaks, data exfiltration).
Python, garak, PyRIT, promptfoo, Giskard, NeMo Guardrails, MITRE ATLAS, STRIDE, PASTA, OWASP LLM Top 10, NIST AI RMF, ISO/IEC 42001, EU AI Act, CI/CD
2mo
Save
Mark Applied
Hide
Distributed LLM Inference Engineer
San Francisco or Palo Alto
$170k-$247k/yr HybridFull Time
Anyscale
Anyscale: Cloud platform for scaling distributed machine learning applications.
Familiarity with running ML inference at large scale with high throughput and low latency; experience with PyTorch; solid understanding of distributed systems.
PyTorch, Ray, vLLM, TensorRT-LLM
2mo
Save
Mark Applied
Hide
Sr. LLM Application Engineer (AI Agents)
Palo Alto, California, United States
$145k-$273k/yr OnsiteFull Time
Tencent
TencentHong Kong Stock Exchange: 0700: Developing digital services and entertainment for a global audience.
Bachelor's degree in CS/AI/Software Engineering; strong experience in LLM application development, AI Agents, RAG optimization; knowledge of MAS, tool-use protocols; production AI agent systems.
3w
Save
Mark Applied
Hide
AI LLM Engineer (Ridgefield, CT, United States, Connecticut)
Ridgefield, Connecticut, United States
$115k-$222k/yr OnsiteFull Time
Boehringer Ingelheim
Boehringer Ingelheim: Researches and develops pharmaceutical products for humans and animals.
3+ YOEExperienced in DevOps/ML environments with LLMs, RAG, vector DBs and knowledge graphs; prompt engineering, MLOps/CI/CD, model optimization (LoRA/QLoRA), observability, and cross-functional collaboration. Must be authorized to work in the U.S.; post-offer drug test possible.
LLM, RAG, LoRA, QLoRA, CI/CD, MLOps, API, vector database, knowledge graph, observability systems
1mo
Save
Mark Applied
Hide
LLM Researcher and Engineer
New York City, New York, United States
$450k-$1000k/yr HybridFull Time
D. E. Shaw Research
D. E. Shaw Research: Developing custom supercomputers for biomolecular simulation and drug discovery.
Expertise in large-scale ML systems, LLM architecture/training, multimodal learning, and strong Python programming; experience with distributed training, pre/post-training techniques, and model scaling.
Python
1w
Save
Mark Applied
Hide
Senior/Staff LLM Application Engineer - Data Application
San Jose, California, United States
$213k-$450k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
Experience with data products and LLM application development, strong coding skills in Python, knowledge of prompt engineering, retrieval and benchmarking, and ability to analyze user feedback.
Python
2mo
Save
Mark Applied
Hide
Principal High-Performance LLM Training Engineer
Santa Clara, California, United States
$272k-$431k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
12+ YOEMS/PhD or equivalent with 12+ years experience; principal-level impact in large-scale AI training, GPU and distributed systems performance; experience with transformer/LLM workloads, distributed training techniques, profiling and benchmarking; strong communication and leadership.
PyTorch, JAX, NeMo, NeMo RL, CUDA
6d
Save
Mark Applied
Hide
Senior Research Engineer / Scientist - Storage for LLM
Seattle, Washington, United States
OnsiteFull Time
ByteDance
ByteDance: Developing AI-driven content platforms and mobile applications.
PhD-level systems researcher/engineer with expertise in large-scale distributed storage, KV caching for LLMs, GPU-aware memory management, and systems programming in C++/Rust/Go/CUDA.
CUDA, Triton Inference Server, RPC, gRPC, TensorRT, C++, Rust, Go, vLLM, FasterTransformer, DeepSpeed, Hugging Face Text Generation Inference, NCCL, InfiniBand, HBM, NUMA, NVLink, RDMA
3w
Save
Mark Applied
Hide
Slalom Flex (Project Based)- LLM Engineering Consultant
United States
$85-$110/hr RemoteFull Time, Contract
Slalom
Slalom: Provides business and technology consulting and software engineering services.
Experienced LLM engineer with strong Python and FastAPI skills, hands-on with LLM model APIs (OpenAI, Anthropic), agentic coding tools, RAG systems, vector DBs, security best practices, and production-scale generative solutions.
Claude Code, Cursor, GitHub Copilot, Python, FastAPI, OpenAI, Anthropic, MCP, LangChain, LlamaIndex
2mo
Save
Mark Applied
Hide
LLM Solutions Architect
California or United States or Canada
$85k-$120k/yr HybridFull Time
Xsolla
Xsolla: Provides payment and monetization tools for game developers.
5+ YOE5+ years engineering; 2+ years deploying LLM systems; experience with major LLM APIs; Python; RAG pipelines; product ownership; strong communication.
Python, OpenAI, Anthropic, Google Gemini, LangChain, LlamaIndex, Vector databases, AutoGen, CrewAI
2w
Save
Mark Applied
Hide
Principal Engineer - Context Engineering & LLM Optimization
Charlotte, North Carolina, United States
OnsiteFull Time
Bank of America
Bank of AmericaNYSE: BAC: Provides global banking, investing, and financial risk management services.
10+ YOE10+ years software/data/platform/AI engineering experience, 5+ years designing large-scale enterprise systems, 2+ years with LLM/RAG/vector search, experience with OpenAI/Azure OpenAI/Anthropic/Google Gemini/Meta Llama, bachelor’s degree in a technical field, strong communication.
OpenAI, Azure OpenAI, Anthropic, Google Gemini, Meta Llama, LLM, RAG, DevEx
3mo
Save
Mark Applied
Hide
Senior High-Performance LLM Training Engineer
Santa Clara, California, United States
$184k-$357k/yr HybridFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
8+ YOEPhD in CS/EE/CE with 5+ years or MS with 8+ years; deep learning/training expertise; strong GPU architecture knowledge; performance analysis and tuning; C++, Python, CUDA programming.
C++, Python, CUDA, PyTorch, JAX
1mo
Save
Mark Applied
Hide
AI / LLM Systems Engineer – Egofold (Junior to Mid-Level)
Culver City or Beverly Hills or Los Angeles
$110k-$150k/yr HybridFull Time
Snail Games
Snail GamesNasdaq: SNAL: Develops and publishes interactive video game entertainment.
2+ YOE2+ years software engineering or AI/ML experience, hands-on with LLMs/RAG/agent frameworks, strong Python skills, ML concepts and model evaluation, production deployment experience, testing and version control best practices.
Python, LangChain, LangGraph, CrewAI, AutoGen, RAG, AWS, Microsoft Azure, Google Cloud, C++, C#, Unreal Engine, Unity