263 llm engineer jobs at 123 companies in New Jersey
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Arlington or Mount Laurel or San Diego or Fall River
$90k-$184k/yrHybridFull Time
Innovative Defense Technologies: A defense technology delivering mission-critical software and automated solutions to the U.S. government.
3+ YOEBachelor's in STEM or equivalent experience, 3-5+ years relevant experience, ability to obtain/maintain Secret clearance, experience with distributed systems, cloud deployment, Agentic AI/LLM, systems engineering, and ~10% travel.
SiriusXMNASDAQ: SIRI: Audio entertainment providing satellite and streaming services.
7+ YOE7+ years engineering experience with large-scale backend systems in Java, 3+ years Python, deep search/indexing experience, expert AWS (EC2, Lambda, S3, DynamoDB, CloudWatch, ElastiCache, IAM), experience with LLMs and leading cross-functional initiatives; legal right to work in the U.S.
Holtec International: Provides nuclear fuel storage systems and small modular reactors.
3+ YOEBachelor's degree,3-5 years software engineering experience with 2+ years in Generative AI/LLM/RAG,knowledge of MLOps,AI security and governance,experience with agent frameworks and enterprise integrations.
LangChain, Semantic Kernel, LangGraph, AutoGen, Microsoft Copilot Studio, CrewAI
HCLTechNational Stock Exchange of India: HCLTECH: Global technology providing digital, engineering, and cloud services.
8+ YOE8+ years building LLM and agentic systems; distributed-systems, security-model, cost-modeling, state management, eval-design, and client-facing communication skills.
Claude (API), Claude Code, MCP, Anthropic SDK, LangGraph, CrewAI, Autogen, Semantic Kernel, Zep, Mem0
PearsonLondon Stock Exchange: PSON: Provide educational materials, assessments, and digital learning services globally.
8+ YOE8+ years in quality engineering; hands-on testing of AI/LLM systems; automation with Playwright or similar; proficiency in JavaScript/TypeScript or Java; API testing, CI/CD integration; experience leading QE teams.
TD BankToronto Stock Exchange: TD: Provide retail, commercial, and wholesale banking and financial services.
10+ YOEBachelor's or graduate degree, 10+ years' relevant experience, 2+ years Python for AI, experience with LLMs/agentic AI frameworks, prompt engineering, and AI security best practices.
Python, LangChain, LangGraph, AutoGen, Model Context Protocol (MCP), LLMs, RAG, GraphRAG, Azure OpenAI, Azure AI Search, embeddings
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOE6+ years in applications development or systems analysis; expert Angular UI development, SQL/NoSQL, Git, Jira; experience with Kafka, Python, OpenShift, Docker; strong systems analysis and SDLC skills.
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California
$188k-$277k/yrRemoteFull Time
TwilioNYSE: TWLO: Cloud communications platform for programmable messaging, voice, and email.
16+ YOE16+ years building high-scale, secure cloud-native distributed systems; expert in Java or Go and AWS; experience with LLM-driven development, APIs, high-throughput data, Kubernetes/Terraform, and cross-team technical leadership.
Woodland Hills or Los Angeles or Alabama or Arizona or California or Colorado or Connecticut or Florida or Georgia or Illinois or Indiana or Kentucky or Massachusetts or Michigan or North Carolina or New Jersey or Nevada or New York or Ohio or Pennsylvania or South Carolina or Texas or Utah or Virginia
$200k-$230k/yrHybridFull Time
Convoso: AI-powered contact center platform for outbound sales teams.
10+ YOE10+ years software engineering experience, 5+ years backend work in Python or PHP, expertise building LLM-based AI agent systems, production LLM API integration, MySQL proficiency, and automated testing for AI workflows.
Distinguished AI Engineer - Onsite in Jersey City, NJ
Jersey City, New Jersey, United States
$140k-$210k/yrOnsiteFull Time
NTT DATA: Global provider of IT and business consulting services.
10+ YOE10+ years in AI/ML systems or platform engineering; deep experience with LLMs, RAG, embeddings, model serving, LLMOps/MLOps, GPU/inference optimization, governance, and stakeholder engagement.
LLMs, LLMOps, MLOps, RAG, embeddings, AI gateways, model-serving, model hubs, agent frameworks, orchestration layers, GPU, evaluation frameworks, observability
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or Vermont or District of Columbia or New York or New Jersey or Washington or California
$188k-$277k/yrRemoteFull Time
TwilioNYSE: TWLO: Cloud communications platform for building customer engagement applications.
16+ YOE16+ years building high-scale, secure cloud-native distributed systems; expert in Java or Go, AWS (Lambda, EKS, DynamoDB, Kafka); experience with LLMs/AI-driven workflows, APIs, data platforms, Kubernetes, Terraform, and CI/CD.
WiproNYSE: WIT: Global technology services and consulting for digital transformation.
0+ YOERecent BS/MS in CS, Engineering, or related; 0–2 years software or implementation experience; programming in Python/JavaScript/Java; API and database familiarity; exposure to cloud platforms and applied AI concepts; strong communication and problem solving.
CitiNYSE: C: Providing global banking, investment, and wealth management services.
10+ YOE10+ years software engineering, 3+ years in AI/LLM systems; expert Python or Java; JavaScript/TypeScript experience; hands-on with LLM platforms (OpenAI, Anthropic, Google), RAG, agent frameworks, Docker, Kubernetes; Bachelor's/Master's in CS or related.
Python, Java, Spring Boot, JavaScript, TypeScript, Angular, Node.js, OpenAI, Anthropic, Google, LLM, RAG, MCPs, Google ADK, Devin, GitHub Copilot, Claude Code, Antigravity, TensorFlow, PyTorch, Docker, Kubernetes, CI/CD
Senior Lead Python Engineer - Applications Development Group Manager - C14 - RUTHERFORD
Rutherford, New Jersey, United States
$177k-$265k/yrHybridFull Time
CitiNYSE: C: Global diversified financial services holding.
12+ YOE8+ Mgmt12+ years in enterprise application, data engineering, or AI platform engineering; 8+ years leading multi-team Agile organizations; advanced expertise in Python, PySpark, Databricks, LLM/GenAI platforms; experience with Kubernetes/OpenShift, Kafka, cloud (AWS/Azure/GCP), and frontend frameworks.
Python, PySpark, Databricks, Devin.AI, GitHub Copilot, LLMs, Google ADK, Gemini, Flash, FastAPI, Spring Boot, Kubernetes, OpenShift, CI/CD, Kafka, React, Angular, AWS, Azure, GCP, Docker, MCP, Data Mesh
San Francisco or Alabama or Arkansas or California or Colorado or Florida or Georgia or Illinois or Kentucky or Massachusetts or Michigan or Montana or Missouri or Nevada or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Texas or Washington or Utah or Virginia or Wisconsin
$156k-$231k/yrHybridFull Time
Afresh: AI-powered inventory management for grocery store fresh food departments.
3+ YOE3+ years building production software or ML/data systems; strong Python and systems/API design; experience with LLM retrieval/RAG, agents, evaluation, Databricks/MLflow and modern data stacks.