261 llm engineer jobs at 110 companies in New Jersey
2w
Save
Mark Applied
Hide
Principal Software Engineer - LLM Optimization
Jersey City or London
$204k-$285k/yr OnsiteFull Time
7+ YOEFormal software engineering training or certification and 7+ years of experience, with hands-on LLM inference, GPU infrastructure, quantization, benchmarking, cloud systems, and agentic AI development expertise.
vLLM, TensorRT-LLM, SGLang, LLM-D, FP8, INT8, INT4, GPTQ, AWQ, AWS, EKS, GuideLLM, DCGM, NVML, XID
2mo
Save
Mark Applied
Hide
Innovation Senior AI Engineer
Boston or Jersey City or New York City or Massachusetts or New York or New Jersey or United States or Poland
$210k-$260k/yr OnsiteFull Time
3+ YOE3+ years AI/ML engineering (5+ years product development), hands-on leader, expert Python, production LLM/RAG/agent experience, workflow orchestration, Azure/AWS, vector DBs, evaluation and responsible-AI practices.
Python, Agno, LangChain, LlamaIndex, Temporal, Prefect, Airflow, Azure, AWS, Pinecone, Weaviate, pgvector, LLM, RAG
1mo
Save
Mark Applied
Hide
AI Engineer
Camden, New Jersey, United States
$120k-$140k/yr OnsiteFull Time
3+ YOEBachelor's degree,3-5 years software engineering experience with 2+ years in Generative AI/LLM/RAG,knowledge of MLOps,AI security and governance,experience with agent frameworks and enterprise integrations.
LangChain, Semantic Kernel, LangGraph, AutoGen, Microsoft Copilot Studio, CrewAI
3w
Save
Mark Applied
Hide
Forward Deployed Engineer
Morrisville or Chicago or Raleigh or California or Colorado or Connecticut or District of Columbia or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or Nevada or New Jersey or New York or Oregon or Rhode Island or Washington
$180k-$220k/yr HybridFull Time
5+ YOERequires 5+ years in software engineering, solutions engineering, applied AI, or related technical work; experience deploying AI solutions, LLMs, retrieval architectures, agents, enterprise APIs, and workflow platforms.
Microsoft Copilot Studio, Azure OpenAI, Microsoft 365, Microsoft Power Platform, ServiceNow, Python, JavaScript
1mo
Save
Mark Applied
Hide
AI Implementation Engineer - JobID-0245
Arlington or Mount Laurel
$114k-$231k/yr HybridFull Time
5+ YOEDesign and deliver production-grade on‑prem AI/agent systems, integrate LLMs and tools, build RAG pipelines, optimize local inference, and obtain/maintain Secret clearance.
Python, NumPy, Pandas, vLLM, SGLang, Triton Inference Server, TensorRT-LLM, PyTorch, TensorFlow, LangChain, LangGraph, Semantic Kernel, AutoGen, Linux, Model Context Protocol (MCP), LLM, Retrieval-Augmented Generation (RAG)
2mo
Save
Mark Applied
Hide
Staff Quality Assurance Engineer
Hoboken, New Jersey, United States
$130k-$150k/yr HybridFull Time
8+ YOE8+ years in quality engineering; hands-on testing of AI/LLM systems; automation with Playwright or similar; proficiency in JavaScript/TypeScript or Java; API testing, CI/CD integration; experience leading QE teams.
Playwright, JavaScript, TypeScript, Java, RAGAS, Cursor, Copilot, AWS, CI/CD
1w
Save
Mark Applied
Hide
Automation & Process Improvement Engineer
Philadelphia or Pennsylvania or New Jersey or New York or Ambler or India or Medellín
HybridFull Time
4+ YOERequires 4+ years in process automation, integrations, or software; Python, APIs, SQL, AI/LLM and agent development experience; process improvement, troubleshooting, production support, and cross-functional communication skills.
Python, API, SQL, AWS, Snowflake, FastAPI, Streamlit, React, Cursor, Claude, Copilot, LLM
2mo
Save
Mark Applied
Hide
Staff Quality Assurance Engineer
Hoboken, New Jersey, United States
$130k-$150k/yr HybridFull Time
8+ YOE8+ years in quality engineering, hands-on testing of AI/LLM systems, automation with Playwright or comparable frameworks, proficiency in JavaScript/TypeScript and/or Java, API/data validation, and QE leadership experience.
Playwright, JavaScript, TypeScript, Java, AWS, Cursor, Copilot, RAGAS
2mo
Save
Mark Applied
Hide
Principal Engineer
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California
$188k-$277k/yr RemoteFull Time
16+ YOE16+ years building high-scale, secure cloud-native distributed systems; expert in Java or Go and AWS; experience with LLM-driven development, APIs, high-throughput data, Kubernetes/Terraform, and cross-team technical leadership.
Java, Go, AWS, Lambda, EKS, DynamoDB, Kafka, LLMs, GitHub Copilot, Anthropic Claude, SQL, NoSQL, Redis, Spark, Kubernetes, Terraform
3mo
Save
Mark Applied
Hide
Principal Engineer
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or Vermont or District of Columbia or New York or New Jersey or Washington or California
$188k-$277k/yr RemoteFull Time
16+ YOE16+ years building high-scale, secure cloud-native distributed systems; expert in Java or Go, AWS (Lambda, EKS, DynamoDB, Kafka); experience with LLMs/AI-driven workflows, APIs, data platforms, Kubernetes, Terraform, and CI/CD.
Java, Go, AWS, Lambda, EKS, DynamoDB, Kafka, GitHub Copilot, Anthropic Claude, LLMs, SQL, NoSQL, Redis, Spark, Kubernetes, Terraform, CI/CD
3w
Save
Mark Applied
Hide
Forward Deployed Engineer - AI
Arlington or Jersey City
$180k-$230k/yr OnsiteFull Time
5+ YOE5+ years software engineering/solutions architecture/consulting,2+ years building production AI/LLM solutions,experience with Azure OpenAI,AWS Bedrock,Google Vertex AI,LangChain,Semantic Kernel;Python,C#,TypeScript;strong communication;willingness to travel ~40%.
Azure OpenAI, AWS Bedrock, Google Vertex AI, Anthropic, LangChain, Semantic Kernel, Python, C#, TypeScript, Pinecone, Milvus, Weaviate, Chroma, Model Context Protocol (MCP), Azure, AWS, GCP, Microsoft 365
3w
Save
Mark Applied
Hide
Senior AI Engineer
Princeton, New Jersey, United States
HybridFull Time
4+ YOEMaster's or bachelor's in CS or related; 4+ years ML experience with production LLM systems; strong Python, FastAPI, HuggingFace, MLOps, vector DBs, cloud (Azure/AWS/GCP), and DevOps practices.
FastAPI, MLOps, Azure OpenAI, GPT-4, GPT-4 Vision, Langfuse, Celery, asyncio, Python, SQL, Pydantic, PySpark, Scala, MLFlow, Pinecone, Weaviate, Chroma, HuggingFace, Keras, TensorFlow, PyTorch, LangChain, LlamaIndex, Docker, Azure DevOps, GitHub Actions, Kubernetes, Azure Key Vault, Azure Blob Storage, Azure Container Registry
4d
Save
Mark Applied
Hide
Principal Sales Engineer
Arizona or California or Colorado or Connecticut or District of Columbia or Florida or Georgia or Illinois or Indiana or Kansas or Massachusetts or Maryland or Maine or Michigan or Minnesota or Missouri or Mississippi or North Carolina or New Hampshire or New Jersey or New York or Ohio or Oregon or Pennsylvania or Rhode Island or South Carolina or Tennessee or Texas or Utah or Virginia or Vermont or Washington or Wisconsin
$200k-$210k/yr RemoteFull Time
8+ YOERequires 8+ years in SaaS sales engineering or pre-sales, leadership or player-coach experience, enterprise deal expertise, and technical knowledge of APIs, integrations, security, and AI/LLM platforms.
APIs, MCP, AI, LLM, Claude, Gemini, MCP connectors
2mo
Save
Mark Applied
Hide
Senior Lead Python Engineer - Applications Development Group Manager - C14 - RUTHERFORD
Rutherford, New Jersey, United States
$177k-$265k/yr HybridFull Time
12+ YOE8+ Mgmt12+ years in enterprise application, data engineering, or AI platform engineering; 8+ years leading multi-team Agile organizations; advanced expertise in Python, PySpark, Databricks, LLM/GenAI platforms; experience with Kubernetes/OpenShift, Kafka, cloud (AWS/Azure/GCP), and frontend frameworks.
Python, PySpark, Databricks, Devin.AI, GitHub Copilot, LLMs, Google ADK, Gemini, Flash, FastAPI, Spring Boot, Kubernetes, OpenShift, CI/CD, Kafka, React, Angular, AWS, Azure, GCP, Docker, MCP, Data Mesh
1mo
Save
Mark Applied
Hide
Principal Engineer Financial Crime — AI & Modernization
Iselin or Charlotte
$159k-$305k/yr HybridFull Time
7+ YOE7+ years engineering experience with architecture and delivery of large-scale cloud-native solutions; experience with AI/ML, presenting to executives, and modernizing financial crime platforms.
GenAI, Agentic AI, LLM, LLM orchestration, agent frameworks, vector databases, RAG architectures, AI/ML, CI/CD, DevSecOps
1mo
Save
Mark Applied
Hide
Senior AI Platform Engineer
San Francisco or Alabama or Arkansas or California or Colorado or Florida or Georgia or Illinois or Kentucky or Massachusetts or Michigan or Montana or Missouri or Nevada or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Texas or Washington or Utah or Virginia or Wisconsin
$156k-$231k/yr HybridFull Time
3+ YOE3+ years building production software or ML/data systems; strong Python and systems/API design; experience with LLM retrieval/RAG, agents, evaluation, Databricks/MLflow and modern data stacks.
Python, PySpark, dbt, Databricks, Delta Lake, Unity Catalog, MLflow, Astronomer, Airflow, Claude, GitHub, Shortcut, Notion, pgvector, Pinecone, Weaviate, LangGraph, MCP
2mo
Save
Mark Applied
Hide
IT Solutions Developer
Riverdale, New Jersey, United States
HybridFull Time
2+ YOEBachelor's degree, 2+ years software development experience, strong Python, React, TypeScript skills, LLM/AI and Azure experience, prompt engineering, CI/CD and IaC exposure, strong communication.
Python, React, TypeScript, LangChain, LangGraph, Autogen, Azure, Azure AI Search, Microsoft Fabric, Dataverse, LLM, Microsoft Copilot Studio, vector databases, GitHub Actions, Azure DevOps, Terraform, Ansible
3mo
Save
Mark Applied
Hide
Forward Deployed Engineer
Jersey City, New Jersey, United States
$200k-$300k/yr FieldFull Time
8+ YOE8+ years healthcare experience, proficiency building with Claude/Claude API, full-stack AI engineering (LLM integration, RAG, agentic orchestration, REST APIs), rapid prototyping, executive communication, and quantitative ROI analysis.
Claude (Anthropic), Claude API, LangChain, LangGraph, CrewAI, AutoGen, LLM, retrieval-augmented generation (RAG), REST API, HL7, FHIR, ICD-10, CPT
1mo
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience with cloud platforms, Databricks (Delta Lake, Unity Catalog), Python, SQL, Spark/PySpark, GenAI/LLM (RAG, embeddings), and building production-grade ETL/ELT pipelines and data products.
Generative AI (GenAI), Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, LLM
1mo
Save
Mark Applied
Hide
Prompt Engineer
Jersey City, New Jersey, United States
$75-$85/hr HybridFull Time
8+ YOERequires 8+ years of experience, strong LLM and prompt-design knowledge, hands-on experience with named AI platforms, structured testing, prompt security, enterprise governance, and stakeholder communication.
OpenAI APIs, Azure OpenAI, AWS Bedrock, Anthropic, LangChain, LlamaIndex, Semantic Kernel, Copilot Studio, Microsoft Power Platform, Microsoft Copilot Studio, Microsoft Power Platform, CI/CD, RAG, LLM, NLP
Explore Jobs
Expand Your Job Search
Top Cities in New Jersey for Llm Engineer
- Llm Engineer jobs in Newark, NJ
- Llm Engineer jobs in Jersey City, NJ
- Llm Engineer jobs in Paterson, NJ
- Llm Engineer jobs in Elizabeth, NJ
- Llm Engineer jobs in Edison, NJ
- Llm Engineer jobs in Toms River, NJ
- Llm Engineer jobs in Clifton, NJ
- Llm Engineer jobs in Trenton, NJ
- Llm Engineer jobs in Camden, NJ
- Llm Engineer jobs in Passaic, NJ
- Llm Engineer jobs in Cherry Hill, NJ
- Llm Engineer jobs in Union City, NJ
- Llm Engineer jobs in Bayonne, NJ
- Llm Engineer jobs in Middletown, NJ
- Llm Engineer jobs in East Orange, NJ
- Llm Engineer jobs in North Bergen, NJ
- Llm Engineer jobs in Irvington, NJ
- Llm Engineer jobs in Vineland, NJ
- Llm Engineer jobs in Wayne, NJ
- Llm Engineer jobs in New Brunswick, NJ