New York City • 50 milesRemote · Hybrid · Onsite · Field · All Environments
New York City • 50 milesRemote · Hybrid · Onsite · Field · All Environments
New York City • 50 milesRemote · Hybrid · Onsite · Field · All Environments
New York City • 50 milesRemote · Hybrid · Onsite · Field · All Environments
5 llm serving engineer jobs at 5 companies in New York City, NY
1mo
Save
Mark Applied
Hide
AI Engineer (Applied LLM Systems)
New York City, New York, United States
$165k-$200k/yr OnsiteFull Time
Experience building production LLM/ML features end-to-end, hands-on with agentic orchestration, self-hosted model serving, strong Python and evaluation design skills.
vLLM, TGI, Python
2w
Save
Mark Applied
Hide
Distinguished AI Engineer
Jersey City, New Jersey, United States
$140k-$210k/yr OnsiteFull Time
10+ YOE10+ years in AI/ML, distributed systems, enterprise architecture or platform engineering; deep LLM, RAG, embeddings, model-serving and AWS experience; Terraform/IaC and DevOps pipeline expertise; ability to influence senior stakeholders.
AWS, Terraform, IaC, DevOps, LLMs, RAG
1mo
Save
Mark Applied
Hide
Senior AI Engineer
Chicago or Hong Kong or London or New York City or Singapore
$200k-$300k/yr OnsiteFull Time
5+ YOE5+ years software engineering with strong Python; production fine-tuning/distillation of open-weight models; on-prem LLM serving, GPU infrastructure and Kubernetes experience; model evaluation and tooling.
Python, Llama, Qwen, Mistral, vLLM, TGI, Triton, Kubernetes, Hugging Face
3w
Save
Mark Applied
Hide
Senior Software Development Engineer, Sponsored Products
New York, New York, United States
$185k-$250k/yr OnsiteFull Time
5+ YOE5+ years professional software development with design/architecture and mentoring experience; experience with ML/LLM/MLOps and building scalable real-time prediction and serving systems.
LLM, MLOps
1w
Save
Mark Applied
Hide
Executive Director Machine Learning Engineer-MLOps
Palo Alto or New York
$223k-$325k/yr OnsiteFull Time
6+ YOEMS with 6+ years or BS with 10+ years experience; strong Python and AWS skills; experience with LLM serving, quantization, CUDA, distributed training, monitoring, and production ML systems.
Python, AWS, CUDA, Ray, vLLM, Kubernetes, ECS, Docker