126 rag engineer jobs at 65 companies in New Jersey
3mo
Save
Mark Applied
Hide
3mo
AI Engineer- Manager
Orlando or Montvale or Dallas
OnsiteFull Time
KPMG: Global professional services network providing audit, tax, and advisory.
5+ YOEMinimum five years software engineering experience building and deploying AI/ML systems; Bachelor’s degree required (Master’s preferred); expertise with LLMs, RAG, data integration, CI/CD, and mentoring skills.
LLMs, Azure OpenAI, Google Cloud, LangChain, LangGraph, Semantic Kernel, Azure AI Search, Databricks, Microsoft Fabric, Azure DevOps, Git, CI/CD, RAG
NTT DATA: Global provider of IT and business consulting services.
10+ YOE10+ years in AI/ML, distributed systems, enterprise architecture or platform engineering; deep LLM, RAG, embeddings, model-serving and AWS experience; Terraform/IaC and DevOps pipeline expertise; ability to influence senior stakeholders.
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Holtec International: Provides nuclear fuel storage systems and small modular reactors.
3+ YOEBachelor's degree,3-5 years software engineering experience with 2+ years in Generative AI/LLM/RAG,knowledge of MLOps,AI security and governance,experience with agent frameworks and enterprise integrations.
LangChain, Semantic Kernel, LangGraph, AutoGen, Microsoft Copilot Studio, CrewAI
PearsonLondon Stock Exchange: PSON: Provide educational materials, assessments, and digital learning services globally.
10+ YOE10+ years building web applications and distributed systems; hands-on experience with agentic AI, LLMs, RAG, ReactJS, Java, Python, SQL; cloud-native experience (AWS/Azure/GCP); mentoring and architectural leadership.
ReactJS, Java, Python, SQL, Large Language Model (LLM), Retrieval-Augmented Generation (RAG), vector databases, AWS, Azure, GCP
VerizonNYSE: VZ: Provides wireless, broadband, and telecommunications services to customers.
6+ YOE6+ years relevant experience, 4+ years independently developing and deploying complex ML/propensity models; experience with LLM agents, RAG, cloud data engineering, Python/R/SQL, and stakeholder communication.
Coaction Specialty Insurance: Provides specialty property and casualty insurance for commercial businesses.
5+ YOE5+ years building production systems; proficiency in Python/C#/Java; experience with LLMs, RAG, embeddings, vector DBs, ML/LLMOps; cloud experience (AWS/Azure); strong engineering hygiene and AI risk/security awareness.
Salt Lake City or New York or New Jersey or Australia or Canada or France or Germany or Switzerland or Egypt or India or Italy or Netherlands or Peru or Philippines or Singapore or Thailand or United Kingdom or United States
$100k-$120k/yrOnsiteFull Time
eClerxNational Stock Exchange of India: ECLERX: Provides business process management and data analytics services globally.
5+ YOE5+ years software development (Python, C/C++, Go, Java); 3+ years production ML systems; practical LLM experience (API integration, prompt engineering, RAG, tool-using agents); strong applied statistics and core ML knowledge; AWS cloud infra preferred.
Darkroom: Growth marketing firm using AI to scale consumer brands.
5+ YOE5+ years full‑stack engineering experience; deep expertise in Python, Node.js, React/TypeScript, PostgreSQL; hands‑on GCP, Docker, Kubernetes; production integration of LLMs/RAG; strong problem‑solving and product mindset.
San Francisco or Alabama or Arkansas or California or Colorado or Florida or Georgia or Illinois or Kentucky or Massachusetts or Michigan or Montana or Missouri or Nevada or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Texas or Washington or Utah or Virginia or Wisconsin
$156k-$231k/yrHybridFull Time
Afresh: AI-powered inventory management for grocery store fresh food departments.
3+ YOE3+ years building production software or ML/data systems; strong Python and systems/API design; experience with LLM retrieval/RAG, agents, evaluation, Databricks/MLflow and modern data stacks.
Bristol Myers SquibbNew York Stock Exchange: BMY: Develops and distributes innovative medicines for serious diseases.
5+ YOE5+ years data engineering experience with cloud platforms, Databricks (Delta Lake, Unity Catalog), Python, SQL, Spark/PySpark, GenAI/LLM (RAG, embeddings), and building production-grade ETL/ELT pipelines and data products.
AlphaLife Sciences: AI-powered SaaS platform for clinical research and medical writing.
6+ YOE3+ Mgmt6+ years software engineering experience with 3+ years leading AI/ML initiatives; proficiency in Python and another language (Java, C++); hands-on experience with Generative AI, LLMs, RAG, AI agents and production deployment; BS/MS in CS/AI/Data Science.
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years software engineering experience; hands-on LLM app development (agentic architectures, RAG, prompt engineering); strong Python, distributed systems, event-driven architectures, API design; experience with AWS/EKS/ECS and AI-assisted dev tools.
St. Petersburg or Alabama or Arizona or Florida or Georgia or Hawaii or Idaho or Louisiana or Maine or Maryland or Missouri or Montana or New Hampshire or New Jersey or New Mexico or New York or North Carolina or Oklahoma or Oregon or Texas or Utah or Virginia or West Virginia or Wisconsin
$180k-$200k/yrHybridFull Time
The HOTH: Provider of managed SEO and white-label digital marketing services.
10+ YOE10+ years building production software and production AI applications; strong Python and AWS experience; ability to work across frontend, backend, cloud, and AI systems; debugging and architecture skills.
IndegeneNational Stock Exchange of India: INDGN: Digital-led commercialization and clinical solutions for life sciences.
3+ YOERequires 3+ years of software or ML engineering, Python, LLM or Gen AI prototyping, agentic frameworks, RAG, vector stores, prompt engineering, and foundation model experience.
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
2+ YOEHands-on Python and API development (FastAPI/Flask), experience with LLMs, prompt engineering, RAG/agentic architectures, LangChain/Hugging Face/Llama Index, and model deployment.
Guardian Life: Provides life, disability, dental, and vision insurance products.
Advanced knowledge of machine learning engineering, distributed systems, cloud infrastructure, AI platforms, LLMs, RAG pipelines, orchestration, agentic frameworks, secure APIs, and enterprise governance.
Large Language Models (LLMs), retrieval-augmented generation (RAG), model orchestration frameworks, Agentic frameworks, API, cloud infrastructure, AI platforms