9 large language model engineer jobs at 8 companies in Manhattan, NY
1w
Save
Mark Applied
Hide
Senior AI/ML Engineer
New York City, New York, United States
RemoteFull Time
Build inference infrastructure, own model evaluation pipelines, optimize latency, and integrate orchestration engines with frontier large language models.
4d
Save
Mark Applied
Hide
Oliver Wyman - Senior Lead AI Engineer
New York City or Boston or Toronto or Montreal
$195k-$250k/yr HybridFull Time
Expertise designing and deploying large-scale AI systems, agent platforms, LLMs, data engineering, evaluation, observability, mathematical modeling, and modern AI programming languages.
Azure Foundry, AWS Bedrock, Gemini Enterprise Agent Platform, LLM, Open-Source
1mo
Save
Mark Applied
Hide
Staff Software Engineer - Spend Platform
New York or San Francisco
$189k-$315k/yr OnsiteFull Time
8+ YOE8+ years backend software engineering experience, distributed systems and large-scale architecture, deep proficiency in a modern backend language, and experience with SQL/NoSQL and complex data modeling.
Python, Go, Java, SQL, NoSQL, Slack, Microsoft 365
1mo
Save
Mark Applied
Hide
Research Engineer, Algorithms
New York City or London or Palo Alto or Copenhagen or Seoul
$300k-$400k/yr OnsiteFull Time
Deep knowledge of large-model inference, stochastic systems, and numerical methods; experience implementing algorithms on real hardware; strong Python and systems-language programming skills.
Python
3mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Personalization, Magenta
New York, New York, United States
$184k-$263k/yr HybridFull Time
5+ YOE5+ years of production ML experience; strong background with large language models and conversational/agentic systems; ability to design metrics and evaluation pipelines; reliable, scalable ML systems; cross-functional collaboration.
1w
Save
Mark Applied
Hide
Research Engineer, Cyber Gemini, DeepMind
New York or Mountain View or San Francisco
$174k-$252k/yr OnsiteFull Time
5+ YOEBachelor's degree or equivalent practical experience; 5 years with large language models, including pre-training or fine-tuning. Cybersecurity, data pipelines, applied research, and ML expertise preferred.
large language models (LLM), Gemini, CodeMender, RL, SFT, ML
1mo
Save
Mark Applied
Hide
Campus AI Research Engineer – Research Automation (Intern)
Chicago or New York City
$300k/yr OnsiteInternship
Strong ML research background with publications, deep learning and language-modeling experience, proficiency in Python/C++ and ML frameworks, and ability to build and deploy large-scale ML systems.
C, C++, Python, CUDA, PyTorch, JAX, TensorFlow, ROCm, transformers, SSMs, HPC
1w
Save
Mark Applied
Hide
AI Infra Engineer Graduate (Recommendation & LLM) 2027 Start (PhD)
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$162k-$388k/yr OnsiteFull Time
PhD in computer science or related field; strong C++ or Python skills; knowledge of algorithms, computer systems, PyTorch or TensorFlow, Transformer architectures, and large language models.
C++, Python, PyTorch, TensorFlow, CUDA, Triton, FSDP, ZeRO, FlashAttention
3w
Save
Mark Applied
Hide
Machine Learning Engineering Manager, Personalization
New York City or Boston
$184k-$263k/yr RemoteFull Time
Experience leading ML engineering teams, building and operating production ML systems, end-to-end ML lifecycle, and working with large language models and generative AI.
large language models