1,274 llm engineer jobs at 562 companies in Secaucus, NJ
13h
Save
Mark Applied
Hide
LLM Engineer
New York City, New York, United States
OnsiteFull Time
3+ YOE3+ years shipping production LLM systems; experience with modern LLM APIs, agents, system design, evaluation pipelines, observability, model selection, and HuggingFace.
OpenAI, Anthropic, DeepSeek, Gemini, HuggingFace
2mo
Save
Mark Applied
Hide
LLM Researcher and Engineer
New York City, New York, United States
$450k-$1000k/yr HybridFull Time
Expertise in large-scale ML systems, LLM architecture/training, multimodal learning, and strong Python programming; experience with distributed training, pre/post-training techniques, and model scaling.
Python
2w
Save
Mark Applied
Hide
LLM Post-Training Engineer Graduate (Research & Product) - 2027 Start
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$128k-$317k/yr OnsiteFull Time
Completing or recently completed a master's in computer science, machine learning, or related field; strong Python, PyTorch or JAX skills; Transformer and LLM training knowledge.
Python, PyTorch, JAX, DeepSpeed, Megatron-LM
2w
Save
Mark Applied
Hide
Principal Software Engineer - LLM Optimization
Jersey City or London
$204k-$285k/yr OnsiteFull Time
7+ YOEFormal software engineering training or certification and 7+ years of experience, with hands-on LLM inference, GPU infrastructure, quantization, benchmarking, cloud systems, and agentic AI development expertise.
vLLM, TensorRT-LLM, SGLang, LLM-D, FP8, INT8, INT4, GPTQ, AWQ, AWS, EKS, GuideLLM, DCGM, NVML, XID
2mo
Save
Mark Applied
Hide
AI Engineer (Applied LLM Systems)
New York City, New York, United States
$165k-$200k/yr OnsiteFull Time
Experience building production LLM/ML features end-to-end, hands-on with agentic orchestration, self-hosted model serving, strong Python and evaluation design skills.
vLLM, TGI, Python
2w
Save
Mark Applied
Hide
Senior Research Engineer, LLM Training & Post-Training
New York City or San Francisco or Seattle or London
$165k-$310k/yr HybridFull Time
Requires significant PyTorch LLM training experience, distributed multi-GPU systems expertise, Python software engineering, experiment design, and a master's degree, PhD, or equivalent experience in a related field.
PyTorch, Python, DeepSpeed, FSDP, Megatron-LM, Hugging Face Transformers, TRL, PEFT, Lightning Fabric, CUDA, Triton, vLLM, SGLang, TensorRT, DPO, PPO, GRPO, SFT, RLHF
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (FM Hosting, LLM Inference)
New York City or McLean or San Jose or Cambridge
$230k-$286k/yr OnsiteFull Time
6+ YOEBachelor’s plus 6 years or master’s plus 4 years in AI/ML development; 6 years programming in Python, Go, Scala, or Java; cloud AI deployment and engineering leadership preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, AWS, Google Cloud, Azure, C++, C#, Golang
1mo
Save
Mark Applied
Hide
GTM Engineer
New York, New York, United States
OnsiteFull Time
2+ YOE2+ years in GTM engineering or equivalent, API integration experience, daily use of Claude Code or similar LLM tooling, experience automating GTM processes; SQL and data experience preferred.
Claude Code, SQL, APIs, LinkedIn, LLM
1mo
Save
Mark Applied
Hide
Research Engineer
New York, New York, United States
$200k-$400k/yr OnsiteFull Time
4+ YOE4+ years applied ML/research engineering experience, production ML and agent/LLM work, proficiency in Python and Typescript, evaluation pipeline experience, strong statistical and problem-solving skills.
Python, Typescript, LLM
2w
Save
Mark Applied
Hide
Sr AI Engineer I
Phoenix or New York City
$123k-$215k/yr HybridFull Time
6+ YOERequires 6+ years of software engineering experience, production LLM or applied ML experience, strong backend, API, data pipeline, cloud, agentic AI, and product engineering skills.
Python, Go, TypeScript, AWS, GCP, Kubernetes, REST, gRPC, Kafka, LLM, RAG
3mo
Save
Mark Applied
Hide
Engineering Manager - Forward Deployed Engineering (LLM)
San Francisco or New York
$260k-$380k/yr HybridFull Time
4+ YOE1+ MgmtLead a team of Forward Deployed Engineers; strong Python, ML inference, LLM experience; 4+ years software engineering; leadership experience; excellent communication.
Python, vLLM, TensorRT, Triton, Hugging Face, Ray Serve
1mo
Save
Mark Applied
Hide
GRC Engineer
New York City, New York, United States
$188k-$221k/yr OnsiteFull Time
5+ YOE5+ years across software/automation engineering and security compliance, production-grade scripting (Python), GRC domain fluency (SOC 2/ISO 27001), clear technical writing, and experience building LLM/agent workflows.
Python, OSCAL, Terraform, CI/CD, APIs, LLM
1mo
Save
Mark Applied
Hide
Solutions Engineer, AI
New York, New York, United States
HybridFull Time
3+ YOE3+ years in solutions/forward-deployed/consulting engineering; LLM/AI prompt design, memory/knowledge retrieval, evaluation and deployment; stakeholder management and product collaboration; strong communication and judgment.
LLM
2mo
Save
Mark Applied
Hide
Senior AI Engineer
San Francisco or New York City or Vancouver or Amsterdam or London or Paris or Singapore or Tokyo
$190k-$316k/yr HybridFull Time
3+ YOE3+ years software engineering experience with 2+ years building production LLM or applied AI systems; experience designing and scaling AI products, strong product sense, and collaboration skills.
LLM, agent frameworks, evals
4w
Save
Mark Applied
Hide
GTM AI Engineer
Austin or Chicago or New York City or Salt Lake City or San Francisco or United States
$115k-$175k/yr RemoteFull Time
Background in software/data engineering or applied AI, experience shipping AI/LLM tools to production, systems thinking, API and workflow integration experience, strong independent delivery and stakeholder partnership skills.
Gong, Salesforce, APIs, agent frameworks, workflow orchestration, LLM
2mo
Save
Mark Applied
Hide
Senior Security Engineer
New York City, New York, United States
$200k-$250k/yr HybridFull Time
Senior security engineer experienced in building automation pipelines, SOAR/SIEM integrations, LLM/AI automation, end-to-end vulnerability management, policy-as-code, cloud hardening, IaC (Terraform/CDK), IAM, and MDM/EDR.
SOAR, SIEM, LLM, AI, Terraform, CDK, IaC, IAM, MDM, EDR
3mo
Save
Mark Applied
Hide
Lead AI Engineer (AI Foundations, LLM Customization and Finetuning)
Cambridge or McLean or San Jose or New York City
$197k-$225k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE with 4+ years or Master's with 2+ years in AI/ML; 4+ years Python/Go/Scala/Java
AWS, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++
4d
Save
Mark Applied
Hide
Forward Deployed Engineer
Foster City or New York City
$180k-$300k/yr HybridFull Time
5+ YOE5+ years of software engineering experience building production software; strong programming, production LLM application, complex system architecture, technical communication, customer collaboration, and independent project delivery skills.
LLM, APIs, SSO, SaaS, cloud infrastructure, databases, authentication
1w
Save
Mark Applied
Hide
Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)
New York City or San Francisco or San Jose or Cambridge or McLean
$197k-$246k/yr OnsiteFull Time
4+ YOEBachelor's plus 4 years or master's plus 2 years developing AI/ML algorithms or technologies, and 4 years programming in Python, Go, Scala, or Java. Cloud AI deployment experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, Python, Go, Scala, Java, AWS, Google Cloud, Microsoft Azure, C++, C#, Golang
1mo
Save
Mark Applied
Hide
Senior AI AML Engineer
New York, New York, United States
$157k-$236k/yr OnsiteFull Time
3+ YOE3+ years AI/ML engineering (6+ years overall), proficiency in Python and backend development, experience with LLM/agent frameworks, API integration, distributed systems, and regulated environments.
Python, Agent Development Kit (ADK), LangChain, LLM, Gemini, OpenAI, Vertex AI, GCP, AWS, Azure, WebSockets
Explore Jobs