5,476 llm engineer jobs at 2,261 companies in United States
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Majestic Labs: Developing memory-first AI server platforms for data centers.
3+ YOE3+ years building or operating production LLM inference systems; strong Python and C++; experience with vLLM/SGLang/TensorRT-LLM/Fireworks; distributed inference and performance profiling skills.
vLLM, SGLang, TensorRT-LLM, Fireworks, Python, C++, collective communication library (CCL)
NEAR AI: Building private, verifiable infrastructure for autonomous AI agents.
Expert in LLM inference and serving systems, optimizing throughput/latency/cost for open-source LLMs, deep GPU architecture knowledge, and experience with PyTorch, Triton, CUDA and inference engines like vLLM/SGLang/TensorRT.
SGLang, vLLM, TensorRT, PyTorch, Triton, CuTe, CUDA
d-Matrix: Develops high-performance semiconductor chips for generative AI inference.
10+ YOEBachelor's in CS/EE (or equivalent) with 10+ years experience (Master/PhD with 6+ years preferred); strong Python and C/C++; experience optimizing LLM inference, quantization, batching, GPU kernel programming and contributor-level work on inference frameworks.
Risk Labs: Develops decentralized oracle and cross-chain interoperability protocols for Web3.
3+ YOE3+ years software engineering; production systems with LLMs; evaluations, testing, monitoring; strong debugging; prompt engineering; good communication.
LiveView Technologies: Provides mobile, solar-powered security units with AI-driven surveillance software.
8+ YOE8+ years in ML-infrastructure/MLOps building and operating model deployment, serving, CI/CD, monitoring, and LLM/VLM ops; strong API design and technical leadership; BS/MS in CS/Engineering or equivalent experience.
Propio Language Services: Provides tech-enabled language interpretation, translation, and localization services.
4+ YOE4+ years building production software with ML/LLM security experience; production-grade Python coding, threat modeling, safety evaluation/red-teaming, and understanding of LLM risks (prompt injection, jailbreaks, data exfiltration).
Python, garak, PyRIT, promptfoo, Giskard, NeMo Guardrails, MITRE ATLAS, STRIDE, PASTA, OWASP LLM Top 10, NIST AI RMF, ISO/IEC 42001, EU AI Act, CI/CD
Anyscale: Cloud platform for scaling distributed machine learning applications.
Familiarity with running ML inference at large scale with high throughput and low latency; experience with PyTorch; solid understanding of distributed systems.
TencentHong Kong Stock Exchange: 0700: Developing digital services and entertainment for a global audience.
Bachelor's degree in CS/AI/Software Engineering; strong experience in LLM application development, AI Agents, RAG optimization; knowledge of MAS, tool-use protocols; production AI agent systems.
AI LLM Engineer (Ridgefield, CT, United States, Connecticut)
Ridgefield, Connecticut, United States
$115k-$222k/yrOnsiteFull Time
Boehringer Ingelheim: Researches and develops pharmaceutical products for humans and animals.
3+ YOEExperienced in DevOps/ML environments with LLMs, RAG, vector DBs and knowledge graphs; prompt engineering, MLOps/CI/CD, model optimization (LoRA/QLoRA), observability, and cross-functional collaboration. Must be authorized to work in the U.S.; post-offer drug test possible.
D. E. Shaw Research: Developing custom supercomputers for biomolecular simulation and drug discovery.
Expertise in large-scale ML systems, LLM architecture/training, multimodal learning, and strong Python programming; experience with distributed training, pre/post-training techniques, and model scaling.
Senior/Staff LLM Application Engineer - Data Application
San Jose, California, United States
$213k-$450k/yrOnsiteFull Time
TikTok: Global short-form video hosting and social media platform.
Experience with data products and LLM application development, strong coding skills in Python, knowledge of prompt engineering, retrieval and benchmarking, and ability to analyze user feedback.
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
12+ YOEMS/PhD or equivalent with 12+ years experience; principal-level impact in large-scale AI training, GPU and distributed systems performance; experience with transformer/LLM workloads, distributed training techniques, profiling and benchmarking; strong communication and leadership.
Senior Research Engineer / Scientist - Storage for LLM
Seattle, Washington, United States
OnsiteFull Time
ByteDance: Developing AI-driven content platforms and mobile applications.
PhD-level systems researcher/engineer with expertise in large-scale distributed storage, KV caching for LLMs, GPU-aware memory management, and systems programming in C++/Rust/Go/CUDA.
Slalom: Provides business and technology consulting and software engineering services.
Experienced LLM engineer with strong Python and FastAPI skills, hands-on with LLM model APIs (OpenAI, Anthropic), agentic coding tools, RAG systems, vector DBs, security best practices, and production-scale generative solutions.
Principal Engineer - Context Engineering & LLM Optimization
Charlotte, North Carolina, United States
OnsiteFull Time
Bank of AmericaNYSE: BAC: Provides global banking, investing, and financial risk management services.
10+ YOE10+ years software/data/platform/AI engineering experience, 5+ years designing large-scale enterprise systems, 2+ years with LLM/RAG/vector search, experience with OpenAI/Azure OpenAI/Anthropic/Google Gemini/Meta Llama, bachelor’s degree in a technical field, strong communication.
OpenAI, Azure OpenAI, Anthropic, Google Gemini, Meta Llama, LLM, RAG, DevEx
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
8+ YOEPhD in CS/EE/CE with 5+ years or MS with 8+ years; deep learning/training expertise; strong GPU architecture knowledge; performance analysis and tuning; C++, Python, CUDA programming.
AI / LLM Systems Engineer – Egofold (Junior to Mid-Level)
Culver City or Beverly Hills or Los Angeles
$110k-$150k/yrHybridFull Time
Snail GamesNasdaq: SNAL: Develops and publishes interactive video game entertainment.
2+ YOE2+ years software engineering or AI/ML experience, hands-on with LLMs/RAG/agent frameworks, strong Python skills, ML concepts and model evaluation, production deployment experience, testing and version control best practices.
Python, LangChain, LangGraph, CrewAI, AutoGen, RAG, AWS, Microsoft Azure, Google Cloud, C++, C#, Unreal Engine, Unity