263 llm engineer jobs at 123 companies in New Jersey

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
1w
Save
Mark Applied
Hide
Senior Lead Software Engineer - Python/AWS/AI/LLM
Jersey City, New Jersey, United States
$171k-$260k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years applied software engineering experience with strong Python skills, AWS expertise, ML/LLM experience, cloud architecture, data processing, and leadership/technical guidance abilities.
Python, AWS, Kubernetes, Postgres, OpenSearch, Redis, OpenAI, Anthropic
1mo
Save
Mark Applied
Hide
Advanced Concepts Engineer
Arlington or Mount Laurel or San Diego or Fall River
$90k-$184k/yr HybridFull Time
Innovative Defense Technologies
Innovative Defense Technologies: A defense technology delivering mission-critical software and automated solutions to the U.S. government.
3+ YOEBachelor's in STEM or equivalent experience, 3-5+ years relevant experience, ability to obtain/maintain Secret clearance, experience with distributed systems, cloud deployment, Agentic AI/LLM, systems engineering, and ~10% travel.
Agentic AI, LLM, SysML, UML, C++, Python, MATLAB, DOORS, Agile
4w
Save
Mark Applied
Hide
Innovation Senior AI Engineer
Boston or Jersey City or New York City or Massachusetts or New York or New Jersey or United States or Poland
$210k-$260k/yr OnsiteFull Time
Brown Brothers Harriman
Brown Brothers Harriman: Providing global investment management, custody, and private banking services.
3+ YOE3+ years AI/ML engineering (5+ years product development), hands-on leader, expert Python, production LLM/RAG/agent experience, workflow orchestration, Azure/AWS, vector DBs, evaluation and responsible-AI practices.
Python, Agno, LangChain, LlamaIndex, Temporal, Prefect, Airflow, Azure, AWS, Pinecone, Weaviate, pgvector, LLM, RAG
3w
Save
Mark Applied
Hide
Staff Software Engineer, Search
Texas or Georgia or New Jersey or New York
$102k-$195k/yr RemoteFull Time
SiriusXM
SiriusXMNASDAQ: SIRI: Audio entertainment providing satellite and streaming services.
7+ YOE7+ years engineering experience with large-scale backend systems in Java, 3+ years Python, deep search/indexing experience, expert AWS (EC2, Lambda, S3, DynamoDB, CloudWatch, ElastiCache, IAM), experience with LLMs and leading cross-functional initiatives; legal right to work in the U.S.
Java, Python, LLM, AWS, EC2, Lambda, S3, DynamoDB, CloudWatch, ElastiCache, IAM
1w
Save
Mark Applied
Hide
AI Engineer
Camden, New Jersey, United States
$120k-$140k/yr OnsiteFull Time
Holtec International
Holtec International: Provides nuclear fuel storage systems and small modular reactors.
3+ YOEBachelor's degree,3-5 years software engineering experience with 2+ years in Generative AI/LLM/RAG,knowledge of MLOps,AI security and governance,experience with agent frameworks and enterprise integrations.
LangChain, Semantic Kernel, LangGraph, AutoGen, Microsoft Copilot Studio, CrewAI
11h
Save
Mark Applied
Hide
Principal Engineer
New Jersey, United States
OnsiteFull Time
HCLTech
HCLTechNational Stock Exchange of India: HCLTECH: Global technology providing digital, engineering, and cloud services.
8+ YOE8+ years building LLM and agentic systems; distributed-systems, security-model, cost-modeling, state management, eval-design, and client-facing communication skills.
Claude (API), Claude Code, MCP, Anthropic SDK, LangGraph, CrewAI, Autogen, Semantic Kernel, Zep, Mem0
2w
Save
Mark Applied
Hide
Staff Quality Assurance Engineer
Hoboken, New Jersey, United States
$130k-$150k/yr HybridFull Time
Pearson
PearsonLondon Stock Exchange: PSON: Provide educational materials, assessments, and digital learning services globally.
8+ YOE8+ years in quality engineering; hands-on testing of AI/LLM systems; automation with Playwright or similar; proficiency in JavaScript/TypeScript or Java; API testing, CI/CD integration; experience leading QE teams.
Playwright, JavaScript, TypeScript, Java, RAGAS, Cursor, Copilot, AWS, CI/CD
1w
Save
Mark Applied
Hide
Senior Engineer – Gen AI /Agentic AI (US)
Mount Laurel, New Jersey, United States
$124k-$200k/yr OnsiteFull Time
TD Bank
TD BankToronto Stock Exchange: TD: Provide retail, commercial, and wholesale banking and financial services.
10+ YOEBachelor's or graduate degree, 10+ years' relevant experience, 2+ years Python for AI, experience with LLMs/agentic AI frameworks, prompt engineering, and AI security best practices.
Python, LangChain, LangGraph, AutoGen, Model Context Protocol (MCP), LLMs, RAG, GraphRAG, Azure OpenAI, Azure AI Search, embeddings
6d
Save
Mark Applied
Hide
Engineer
Jersey City, New Jersey, United States
$90k-$110k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOE6+ years in applications development or systems analysis; expert Angular UI development, SQL/NoSQL, Git, Jira; experience with Kafka, Python, OpenShift, Docker; strong systems analysis and SDLC skills.
Angular JS, Angular, Kafka, Python, SQL, Oracle Database, NOSql, GIT, JIRA, OpenShift, Docker, AWS, S3, LLM, Agentic AI, copilot
4w
Save
Mark Applied
Hide
Principal Engineer
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California
$188k-$277k/yr RemoteFull Time
Twilio
TwilioNYSE: TWLO: Cloud communications platform for programmable messaging, voice, and email.
16+ YOE16+ years building high-scale, secure cloud-native distributed systems; expert in Java or Go and AWS; experience with LLM-driven development, APIs, high-throughput data, Kubernetes/Terraform, and cross-team technical leadership.
Java, Go, AWS, Lambda, EKS, DynamoDB, Kafka, LLMs, GitHub Copilot, Anthropic Claude, SQL, NoSQL, Redis, Spark, Kubernetes, Terraform
1mo
Save
Mark Applied
Hide
Senior Cloud Engineer
Brisbane or Seattle or Princeton
$138k-$183k/yr HybridFull Time
Bristol Myers Squibb
Bristol Myers SquibbNYSE: BMY: Develops and manufactures innovative prescription biopharmaceutical medicines.
5+ YOE5+ years cloud/platform engineering experience; Bachelor's degree; hands-on AWS-native cloud development; strong Python/FastAPI or TypeScript/Node skills; experience with containers, CI/CD, IaC (Terraform/AWS CDK/CloudFormation), RDS/PostgreSQL, OpenSearch, Redis, LangGraph/LangChain and LLM/agent tooling.
LangGraph, FastMCP, OpenSearch, Amazon S3 Vectors, Amazon Neptune, PostgreSQL, RDS, Redis, ElastiCache, AWS Fargate, LangSmith, AWS, Amazon S3, Athena, Lambda, IAM, VPC, Python, FastAPI, TypeScript, Node, Terraform, AWS CDK, CloudFormation, LangChain, PydanticAI, Claude Agent SDK, GitHub, OpenAI, Anthropic, Gemini, AWS Bedrock, Claude Code, Codex, Gemini CLI, GitHub Copilot
2w
Save
Mark Applied
Hide
Principal Software Engineer - AI
Woodland Hills or Los Angeles or Alabama or Arizona or California or Colorado or Connecticut or Florida or Georgia or Illinois or Indiana or Kentucky or Massachusetts or Michigan or North Carolina or New Jersey or Nevada or New York or Ohio or Pennsylvania or South Carolina or Texas or Utah or Virginia
$200k-$230k/yr HybridFull Time
Convoso
Convoso: AI-powered contact center platform for outbound sales teams.
10+ YOE10+ years software engineering experience, 5+ years backend work in Python or PHP, expertise building LLM-based AI agent systems, production LLM API integration, MySQL proficiency, and automated testing for AI workflows.
LLM, OpenAI, Claude, GitHub Copilot, MySQL, Python, Django, Flask, PHP, Symfony, Laravel, React
2w
Save
Mark Applied
Hide
Distinguished AI Engineer - Onsite in Jersey City, NJ
Jersey City, New Jersey, United States
$140k-$210k/yr OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
10+ YOE10+ years in AI/ML systems or platform engineering; deep experience with LLMs, RAG, embeddings, model serving, LLMOps/MLOps, GPU/inference optimization, governance, and stakeholder engagement.
LLMs, LLMOps, MLOps, RAG, embeddings, AI gateways, model-serving, model hubs, agent frameworks, orchestration layers, GPU, evaluation frameworks, observability
1mo
Save
Mark Applied
Hide
Principal Engineer
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or Vermont or District of Columbia or New York or New Jersey or Washington or California
$188k-$277k/yr RemoteFull Time
Twilio
TwilioNYSE: TWLO: Cloud communications platform for building customer engagement applications.
16+ YOE16+ years building high-scale, secure cloud-native distributed systems; expert in Java or Go, AWS (Lambda, EKS, DynamoDB, Kafka); experience with LLMs/AI-driven workflows, APIs, data platforms, Kubernetes, Terraform, and CI/CD.
Java, Go, AWS, Lambda, EKS, DynamoDB, Kafka, GitHub Copilot, Anthropic Claude, LLMs, SQL, NoSQL, Redis, Spark, Kubernetes, Terraform, CI/CD
3mo
Save
Mark Applied
Hide
Junior Forward Deployed Engineer
Plano or Boston or East Brunswick
$68k-$79k/yr FieldFull Time
Wipro
WiproNYSE: WIT: Global technology services and consulting for digital transformation.
0+ YOERecent BS/MS in CS, Engineering, or related; 0–2 years software or implementation experience; programming in Python/JavaScript/Java; API and database familiarity; exposure to cloud platforms and applied AI concepts; strong communication and problem solving.
Python, JavaScript, Java, APIs, SQL, NoSQL, AWS, Azure, GCP, Git, LLM, RAG
3mo
Save
Mark Applied
Hide
Lead AI Engineer for Banking Technology
Jersey City or New York City
$177k-$265k/yr HybridFull Time
Citi
CitiNYSE: C: Providing global banking, investment, and wealth management services.
10+ YOE10+ years software engineering, 3+ years in AI/LLM systems; expert Python or Java; JavaScript/TypeScript experience; hands-on with LLM platforms (OpenAI, Anthropic, Google), RAG, agent frameworks, Docker, Kubernetes; Bachelor's/Master's in CS or related.
Python, Java, Spring Boot, JavaScript, TypeScript, Angular, Node.js, OpenAI, Anthropic, Google, LLM, RAG, MCPs, Google ADK, Devin, GitHub Copilot, Claude Code, Antigravity, TensorFlow, PyTorch, Docker, Kubernetes, CI/CD
1mo
Save
Mark Applied
Hide
Senior Lead Python Engineer - Applications Development Group Manager - C14 - RUTHERFORD
Rutherford, New Jersey, United States
$177k-$265k/yr HybridFull Time
Citi
CitiNYSE: C: Global diversified financial services holding.
12+ YOE8+ Mgmt12+ years in enterprise application, data engineering, or AI platform engineering; 8+ years leading multi-team Agile organizations; advanced expertise in Python, PySpark, Databricks, LLM/GenAI platforms; experience with Kubernetes/OpenShift, Kafka, cloud (AWS/Azure/GCP), and frontend frameworks.
Python, PySpark, Databricks, Devin.AI, GitHub Copilot, LLMs, Google ADK, Gemini, Flash, FastAPI, Spring Boot, Kubernetes, OpenShift, CI/CD, Kafka, React, Angular, AWS, Azure, GCP, Docker, MCP, Data Mesh
1mo
Save
Mark Applied
Hide
AI Engineer (Internship) - Intelligent Question Bank Platform
Secaucus, New Jersey, United States
RemoteInternship
Accel Learning
Accel Learning: Provides academic tutoring and enrichment classes for K-12 students.
Strong software engineering foundation; Python; REST APIs; databases; AI/ML pipelines; LLM APIs; RAG; NLP; prompt engineering; cloud deployment; independent work and portfolio.
Python, REST APIs, PostgreSQL, OpenAI API, Anthropic Claude, Google Gemini, Pinecone, Weaviate, pgvector, Chroma, LaTeX, MathJax, KaTeX, AWS, GCP, Vercel, Celery, Bull, LLM, NLP, tokenization, semantic search
1mo
Save
Mark Applied
Hide
IT Solutions Developer
Riverdale, New Jersey, United States
HybridFull Time
Camfil
Camfil: Manufacturer of premium air filtration and clean air solutions.
2+ YOEBachelor's degree, 2+ years software development experience, strong Python, React, TypeScript skills, LLM/AI and Azure experience, prompt engineering, CI/CD and IaC exposure, strong communication.
Python, React, TypeScript, LangChain, LangGraph, Autogen, Azure, Azure AI Search, Microsoft Fabric, Dataverse, LLM, Microsoft Copilot Studio, vector databases, GitHub Actions, Azure DevOps, Terraform, Ansible
1w
Save
Mark Applied
Hide
Senior AI Platform Engineer
San Francisco or Alabama or Arkansas or California or Colorado or Florida or Georgia or Illinois or Kentucky or Massachusetts or Michigan or Montana or Missouri or Nevada or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Texas or Washington or Utah or Virginia or Wisconsin
$156k-$231k/yr HybridFull Time
Afresh
Afresh: AI-powered inventory management for grocery store fresh food departments.
3+ YOE3+ years building production software or ML/data systems; strong Python and systems/API design; experience with LLM retrieval/RAG, agents, evaluation, Databricks/MLflow and modern data stacks.
Python, PySpark, dbt, Databricks, Delta Lake, Unity Catalog, MLflow, Astronomer, Airflow, Claude, GitHub, Shortcut, Notion, pgvector, Pinecone, Weaviate, LangGraph, MCP