1,930 llm jobs at 772 companies in New York

2mo
Save
Mark Applied
Hide
LLM Researcher and Engineer
New York City, New York, United States
$450k-$1000k/yr HybridFull Time
D. E. Shaw Research
D. E. Shaw Research: Developing custom supercomputers for biomolecular simulation and drug discovery.
Expertise in large-scale ML systems, LLM architecture/training, multimodal learning, and strong Python programming; experience with distributed training, pre/post-training techniques, and model scaling.
Python
1mo
Save
Mark Applied
Hide
AI/LLM Engineer
New York, New York, United States
$120k-$130k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOEStrong Python engineering, experience with agent frameworks (LangChain/LangGraph), EMR/data platform integration (Snowflake, Databricks), 8+ years experience, bachelor in computer science.
Python, LangChain, LangGraph, Snowflake, Databricks
1mo
Save
Mark Applied
Hide
AI/LLM Product Manager - Senior Associate
New York, New York, United States
$128k-$195k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
3+ YOE3+ years product or data product experience; shipped LLM/agentic systems; AI/ML lifecycle and model validation experience; strong architecture, API, data pipeline, and stakeholder management skills.
1d
Save
Mark Applied
Hide
LLM Post-Training Engineer Graduate (Research & Product) - 2027 Start
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$128k-$317k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
Completing or recently completed a master's in computer science, machine learning, or related field; strong Python, PyTorch or JAX skills; Transformer and LLM training knowledge.
Python, PyTorch, JAX, DeepSpeed, Megatron-LM
1mo
Save
Mark Applied
Hide
LLM -CFO Advisors
Alabama or Arizona or Colorado or Florida or Idaho or Iowa or Kentucky or Michigan or Minnesota or Mississippi or Missouri or Montana or New York or North Carolina or North Dakota or Oklahoma or Pennsylvania or South Carolina or South Dakota or Texas or Virginia or Wisconsin or Wyoming or Bangladesh or India or Brazil or Colombia or Indonesia or Pakistan or Turkey or Vietnam
$30-$200/hr RemoteContract, Temporary
Careerflow
Careerflow: A connecting finance and accounting professionals with remote advisory and freelance opportunities.
5+ YOE5+ years in accounting/finance, active user of QuickBooks Online (QBO) or Omni Chat, experience as CFO Advisor/Controller/Finance Manager, strong financial reporting and statement analysis, experience advising SMBs and handling complex accounting queries.
LLM, QuickBooks Online (QBO), Omni Chat
1mo
Save
Mark Applied
Hide
AI Engineer (Applied LLM Systems)
New York City, New York, United States
$165k-$200k/yr OnsiteFull Time
Discernis
Discernis: AI-native document intelligence software for legal investigations and discovery.
Experience building production LLM/ML features end-to-end, hands-on with agentic orchestration, self-hosted model serving, strong Python and evaluation design skills.
vLLM, TGI, Python
2mo
Save
Mark Applied
Hide
Principal Associate, Data Scientist - LLM Customization Team
New York or McLean
$177k-$201k/yr HybridFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
5+ YOEML/NLP focus with LLMs, Python, cloud; experience with PyTorch, HuggingFace, AWS; finetuning LLMs for business use.
PyTorch, HuggingFace, AWS, LangChain, VectorDBs, NLP, LLMs, OpenAI
3mo
Save
Mark Applied
Hide
Research Scientist Intern, Monetization Generative AI - LLM (PhD)
Bellevue or Menlo Park or Seattle or New York
$8k-$12k/mo HybridInternship
Meta
MetaNASDAQ: META: Develops social networking platforms and virtual reality technologies.
Ph.D. in CS/AI/NLP/Speech/CV or related field; work authorization; experience in Python/C/C++/Java; experience with PyTorch or TensorFlow; ML/NLP system building.
Python, C++, C, Java, PyTorch, TensorFlow
3mo
Save
Mark Applied
Hide
Engineering Manager - Forward Deployed Engineering (LLM)
San Francisco or New York
$260k-$380k/yr HybridFull Time
Baseten
Baseten: Scalable infrastructure platform for deploying and serving AI models.
4+ YOE1+ MgmtLead a team of Forward Deployed Engineers; strong Python, ML inference, LLM experience; 4+ years software engineering; leadership experience; excellent communication.
Python, vLLM, TensorRT, Triton, Hugging Face, Ray Serve
3d
Save
Mark Applied
Hide
Senior Research Engineer, LLM Training & Post-Training
New York City or San Francisco or Seattle or London
$165k-$310k/yr HybridFull Time
Lightning AI
Lightning AI: Unified platform to build, train, and deploy AI models.
Requires significant PyTorch LLM training experience, distributed multi-GPU systems expertise, Python software engineering, experiment design, and a master's degree, PhD, or equivalent experience in a related field.
PyTorch, Python, DeepSpeed, FSDP, Megatron-LM, Hugging Face Transformers, TRL, PEFT, Lightning Fabric, CUDA, Triton, vLLM, SGLang, TensorRT, DPO, PPO, GRPO, SFT, RLHF
2mo
Save
Mark Applied
Hide
Principal Associate, Data Scientist - LLM Customization Team
New York City or McLean
$162k-$201k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
5+ YOEQuantitative bachelor's degree plus 5 years, master's or quantitative MBA plus 3 years, or PhD; experience with data analytics, machine learning, LLMs, deep learning, and Python, Scala, or R.
PyTorch, Hugging Face, AWS Ultraclusters, LangChain, VectorDBs, Natural Language Processing (NLP), Large Language Models (LLMs), RLHF, AWS, Python, Scala, R
2mo
Save
Mark Applied
Hide
Principal Associate, Data Scientist - LLM Customization Team
New York City or McLean
$177k-$201k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
5+ YOEQuantitative bachelor's degree plus 5 years of data analytics, or master's/MBA plus 3 years, or PhD. Requires ML, NLP, LLM, deep learning, and Python, Scala, or R experience.
PyTorch, Hugging Face, AWS Ultraclusters, LangChain, VectorDBs, Natural Language Processing (NLP), Large Language Models (LLMs), AWS, Python, Scala, R
3w
Save
Mark Applied
Hide
Senior Data Scientist - LLM Evaluation & Business Intelligence
New York or Columbus or United States
$148k-$184k/yr RemoteFull Time
Paradigm Health
Paradigm Health: AI-powered clinical trial infrastructure for healthcare provider organizations.
4+ YOEBachelor's degree,4+ years in data science or analytics in life sciences/healthcare,experience evaluating LLM/NLP systems,proficiency in SQL,dbt,and Python,experience with Databricks and BI tools,strong communication.
dbt, Databricks, Hex, SQL, Python, PySpark
2mo
Save
Mark Applied
Hide
Research Scientist 4 - Machine Learning and Inference Research, LLM Post-Training
New York City or Los Angeles or Los Gatos
$300k-$537k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Global video streaming and media production service.
Ph.D. in Computer Science or related field with specialization in post-training LLMs and RL; top-tier publications; strong technical communication, collaboration, and self-motivation to drive research to impact.
1w
Save
Mark Applied
Hide
Senior ML Engineer - Search & LLM Ops
Marbella or Madrid or New York City
RemoteFull Time
RavenPack
RavenPack: Provider of AI and big data analytics for finance.
3+ YOEMaster’s or PhD in a quantitative field; 3+ years building production ML models focused on search, information retrieval, or recommender systems; Python, SQL, ML frameworks, vector databases, and English proficiency required.
Python, SQL, PyTorch, TensorFlow, Scikit-learn, Hugging Face
2mo
Save
Mark Applied
Hide
Senior AI Engineer I
Phoenix or New York
$123k-$215k/yr HybridFull Time
American Express
American ExpressNYSE: AXP: Global financial services and credit card payment network.
5+ YOE5+ years software engineering experience with production LLM/ML systems, strong backend/API/cloud fundamentals, hands-on LLM tooling and RAG pipelines, AI-assisted workflows, and US work authorization required.
Python, Go, TypeScript, AWS, GCP, Kubernetes, REST, gRPC, Kafka, LLM, RAG
1mo
Save
Mark Applied
Hide
Machine Learning Engineer III - AI Agent Engineer - Digital and Technology Partners - Onsite/Hybrid
New York, New York, United States
$132k-$198k/yr HybridFull Time
Mount Sinai Health System
Mount Sinai Health System: Integrated academic medical system providing patient care and research.
4+ YOEBachelor's in CS or Data Science, 4+ years ML/back-end experience, 1+ years deploying Generative AI/LLM/RAG solutions, experience with LLM frameworks, vector DBs, Spark, Unix, cloud, CI/CD, and leadership/mentorship.
Azure AI Foundry, Azure OpenAI, OpenAI, Anthropic, LangChain, LangGraph, Semantic Kernel, CrewAI, AutoGen, Pinecone, Azure AI Search, Elasticsearch, Weaviate, Chroma, Apache Spark, Unix, AWS, Azure, Google Cloud, Jenkins, Git, Azure DevOps, Terraform, LLM
1mo
Save
Mark Applied
Hide
Engineering Manager
Boulder or California or Florida or Texas or Utah or Colorado or New Jersey or New York or Massachusetts or Michigan or Canada
$175k-$225k/yr RemoteFull Time
Respondology
Respondology: A that provides an AI-powered social engagement platform to help brands moderate, listen to, and respond to comments at scale.
4+ YOE4+ Mgmt4+ years engineering management experience; experience with production AI/ML or LLM-integrated systems; strong prioritization, communication, and delivery skills.
LLM, AI/ML
3mo
Save
Mark Applied
Hide
Senior Software Engineer - AI/ML
New York, New York, United States
$150k-$200k/yr OnsiteFull Time
Artian
Artian: Develops autonomous multi-agent AI systems for financial enterprise automation.
Senior Python engineer with production ML/LLM experience; strong system design, evaluation pipelines, and ability to mentor; independent, product-focused.
Python, LLM, NLP, Retrieval, Embeddings, Ranking, System Design
3mo
Save
Mark Applied
Hide
Sr. AI Engineer
New York, New York, United States
$209k-$235k/yr HybridFull Time
Pendo
Pendo: Software platform providing product analytics and user guidance tools.
Experience building and shipping LLM-powered systems, MLOps, full-stack AI products, and strong system design; able to communicate tradeoffs clearly.
LLM, RAG pipelines, agent orchestration, diffusion models, transformers, MLOps, LangChain, LlamaIndex