126 rag engineer jobs at 65 companies in New Jersey

3mo
Save
Mark Applied
Hide
AI Engineer- Manager
Orlando or Montvale or Dallas
OnsiteFull Time
KPMG
KPMG: Global professional services network providing audit, tax, and advisory.
5+ YOEMinimum five years software engineering experience building and deploying AI/ML systems; Bachelor’s degree required (Master’s preferred); expertise with LLMs, RAG, data integration, CI/CD, and mentoring skills.
LLMs, Azure OpenAI, Google Cloud, LangChain, LangGraph, Semantic Kernel, Azure AI Search, Databricks, Microsoft Fabric, Azure DevOps, Git, CI/CD, RAG
1w
Save
Mark Applied
Hide
Distinguished AI Engineer
Jersey City, New Jersey, United States
$140k-$210k/yr OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
10+ YOE10+ years in AI/ML, distributed systems, enterprise architecture or platform engineering; deep LLM, RAG, embeddings, model-serving and AWS experience; Terraform/IaC and DevOps pipeline expertise; ability to influence senior stakeholders.
AWS, Terraform, IaC, DevOps, LLMs, RAG
3w
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
1mo
Save
Mark Applied
Hide
Innovation Senior AI Engineer
Boston or Jersey City or New York City or Massachusetts or New York or New Jersey or United States or Poland
$210k-$260k/yr OnsiteFull Time
Brown Brothers Harriman
Brown Brothers Harriman: Providing global investment management, custody, and private banking services.
3+ YOE3+ years AI/ML engineering (5+ years product development), hands-on leader, expert Python, production LLM/RAG/agent experience, workflow orchestration, Azure/AWS, vector DBs, evaluation and responsible-AI practices.
Python, Agno, LangChain, LlamaIndex, Temporal, Prefect, Airflow, Azure, AWS, Pinecone, Weaviate, pgvector, LLM, RAG
1mo
Save
Mark Applied
Hide
AI Engineer
Camden, New Jersey, United States
$120k-$140k/yr OnsiteFull Time
Holtec International
Holtec International: Provides nuclear fuel storage systems and small modular reactors.
3+ YOEBachelor's degree,3-5 years software engineering experience with 2+ years in Generative AI/LLM/RAG,knowledge of MLOps,AI security and governance,experience with agent frameworks and enterprise integrations.
LangChain, Semantic Kernel, LangGraph, AutoGen, Microsoft Copilot Studio, CrewAI
1mo
Save
Mark Applied
Hide
Staff Software Engineer
Hoboken, New Jersey, United States
$150k-$165k/yr HybridFull Time
Pearson
PearsonLondon Stock Exchange: PSON: Provide educational materials, assessments, and digital learning services globally.
10+ YOE10+ years building web applications and distributed systems; hands-on experience with agentic AI, LLMs, RAG, ReactJS, Java, Python, SQL; cloud-native experience (AWS/Azure/GCP); mentoring and architectural leadership.
ReactJS, Java, Python, SQL, Large Language Model (LLM), Retrieval-Augmented Generation (RAG), vector databases, AWS, Azure, GCP
1w
Save
Mark Applied
Hide
Principal AI Engineer
Basking Ridge or Alpharetta or Irving
$121k-$231k/yr HybridFull Time
Verizon
VerizonNYSE: VZ: Provides wireless, broadband, and telecommunications services to customers.
6+ YOE6+ years relevant experience, 4+ years independently developing and deploying complex ML/propensity models; experience with LLM agents, RAG, cloud data engineering, Python/R/SQL, and stakeholder communication.
Google ADK, LangChain, LangGraph, RAG, MCP, A2A, ONNX, ONNX-based embeddings, vector databases, semantic search, BigQuery, GCP, Cloud Run, Vertex AI, Python, R, SQL, OpenTelemetry, Arize Phoenix, Galileo, AWS, Azure
2mo
Save
Mark Applied
Hide
Senior AI Engineer
Morristown or Glendale or New York City
$140k-$190k/yr OnsiteFull Time
Coaction Specialty Insurance
Coaction Specialty Insurance: Provides specialty property and casualty insurance for commercial businesses.
5+ YOE5+ years building production systems; proficiency in Python/C#/Java; experience with LLMs, RAG, embeddings, vector DBs, ML/LLMOps; cloud experience (AWS/Azure); strong engineering hygiene and AI risk/security awareness.
Python, C#, Java, LLMs, ML APIs, RAG, embeddings, vector databases, REST, JSON, AWS, Azure, CI/CD, MLOps, LLMOps
2mo
Save
Mark Applied
Hide
AI Engineer
Salt Lake City or New York or New Jersey or Australia or Canada or France or Germany or Switzerland or Egypt or India or Italy or Netherlands or Peru or Philippines or Singapore or Thailand or United Kingdom or United States
$100k-$120k/yr OnsiteFull Time
eClerx
eClerxNational Stock Exchange of India: ECLERX: Provides business process management and data analytics services globally.
5+ YOE5+ years software development (Python, C/C++, Go, Java); 3+ years production ML systems; practical LLM experience (API integration, prompt engineering, RAG, tool-using agents); strong applied statistics and core ML knowledge; AWS cloud infra preferred.
Python, C, C++, Go, Java, Large Language Models (LLMs), OpenAI, Gemini, Llama, Qwen, Claude, RAG, MCP protocol, ECS, EKS, Lambda, S3, DynamoDB, Redshift, Step Functions, SageMaker, Terraform, CloudFormation
1mo
Save
Mark Applied
Hide
Full-Stack Engineer
New York or Miami or New Jersey or Texas
$120k/yr HybridFull Time
Darkroom
Darkroom: Growth marketing firm using AI to scale consumer brands.
5+ YOE5+ years full‑stack engineering experience; deep expertise in Python, Node.js, React/TypeScript, PostgreSQL; hands‑on GCP, Docker, Kubernetes; production integration of LLMs/RAG; strong problem‑solving and product mindset.
Python, Node.js, React, TypeScript, PostgreSQL, Google Cloud Platform, Airflow, Terraform, Docker, Kubernetes, LLMs, RAG, GraphQL, MCP servers
1mo
Save
Mark Applied
Hide
Senior AI Platform Engineer
San Francisco or Alabama or Arkansas or California or Colorado or Florida or Georgia or Illinois or Kentucky or Massachusetts or Michigan or Montana or Missouri or Nevada or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Texas or Washington or Utah or Virginia or Wisconsin
$156k-$231k/yr HybridFull Time
Afresh
Afresh: AI-powered inventory management for grocery store fresh food departments.
3+ YOE3+ years building production software or ML/data systems; strong Python and systems/API design; experience with LLM retrieval/RAG, agents, evaluation, Databricks/MLflow and modern data stacks.
Python, PySpark, dbt, Databricks, Delta Lake, Unity Catalog, MLflow, Astronomer, Airflow, Claude, GitHub, Shortcut, Notion, pgvector, Pinecone, Weaviate, LangGraph, MCP
1mo
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNew York Stock Exchange: BMY: Develops and distributes innovative medicines for serious diseases.
5+ YOE5+ years data engineering experience with cloud platforms, Databricks (Delta Lake, Unity Catalog), Python, SQL, Spark/PySpark, GenAI/LLM (RAG, embeddings), and building production-grade ETL/ELT pipelines and data products.
Generative AI (GenAI), Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, LLM
1mo
Save
Mark Applied
Hide
Lead AI Engineer
Iselin, New Jersey, United States
HybridFull Time
AlphaLife Sciences
AlphaLife Sciences: AI-powered SaaS platform for clinical research and medical writing.
6+ YOE3+ Mgmt6+ years software engineering experience with 3+ years leading AI/ML initiatives; proficiency in Python and another language (Java, C++); hands-on experience with Generative AI, LLMs, RAG, AI agents and production deployment; BS/MS in CS/AI/Data Science.
Python, Java, C++, Generative AI, LLMs, RAG, AI agents, AuroraPrime, cloud computing
2w
Save
Mark Applied
Hide
AI Platform Engineer
Camden or Conshohocken
$140k-$150k/yr HybridFull Time
United States Cold Storage
United States Cold Storage: Provides temperature-controlled warehousing and cold chain logistics services.
4+ YOE4+ years software engineering, 3+ years delivering generative AI solutions; experience with Python/Java/JavaScript/TypeScript, RAG, embeddings, vector search, agents, cloud fundamentals (Azure preferred), CI/CD, REST and SQL.
Python, Java, JavaScript/TypeScript, GitHub Copilot, Cursor, Claude Code, Microsoft Azure AI services, Microsoft Azure, GitHub, REST APIs, Postgres, CI/CD, MCP, RAG, vector search, embeddings
1mo
Save
Mark Applied
Hide
AI Modernization Senior Lead Software Engineer
Jersey City, New Jersey, United States
$171k-$260k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years software engineering experience; hands-on LLM app development (agentic architectures, RAG, prompt engineering); strong Python, distributed systems, event-driven architectures, API design; experience with AWS/EKS/ECS and AI-assisted dev tools.
COBOL, JCL, DB2, Kotlin, Claude Code, Codex, Copilot, GitHub Copilot, Cursor, Python, LLM, RAG, AWS, EKS, ECS, Temporal, Airflow, Kafka, PostgreSQL, Kubernetes
1mo
Save
Mark Applied
Hide
Principal AI Engineer
St. Petersburg or Alabama or Arizona or Florida or Georgia or Hawaii or Idaho or Louisiana or Maine or Maryland or Missouri or Montana or New Hampshire or New Jersey or New Mexico or New York or North Carolina or Oklahoma or Oregon or Texas or Utah or Virginia or West Virginia or Wisconsin
$180k-$200k/yr HybridFull Time
The HOTH
The HOTH: Provider of managed SEO and white-label digital marketing services.
10+ YOE10+ years building production software and production AI applications; strong Python and AWS experience; ability to work across frontend, backend, cloud, and AI systems; debugging and architecture skills.
React, Next.js, TypeScript, Tailwind CSS, Python, Django, FastAPI, PostgreSQL, Redis, OpenAI, Anthropic, Gemini, RAG, vector databases, embeddings, AWS, ECS/Fargate, S3, Lambda, Terraform, Docker, Cloudflare, CI/CD
1w
Save
Mark Applied
Hide
Principal AI Engineer
Basking Ridge or Alpharetta or Irving
$121k-$231k/yr HybridFull Time
Verizon
VerizonNYSE: VZ: Provides wireless, fiber-optic internet, and telecommunications services globally.
6+ YOEBachelor's or equivalent experience; 6+ years relevant experience; 4+ years deploying and optimizing production ML/propensity models; experience with LLM agent architectures, RAG, ONNX embeddings, vector DBs, BigQuery/GCP, Python/R/SQL; strong communication.
Google ADK, LangChain, LangGraph, RAG, ONNX, BigQuery, GCP, Cloud Run, Vertex AI, Python, R, SQL, OpenTelemetry, Arize Phoenix, Galileo
1d
Save
Mark Applied
Hide
Gen AI Engineer
New Jersey, United States
OnsiteFull Time
Indegene
IndegeneNational Stock Exchange of India: INDGN: Digital-led commercialization and clinical solutions for life sciences.
3+ YOERequires 3+ years of software or ML engineering, Python, LLM or Gen AI prototyping, agentic frameworks, RAG, vector stores, prompt engineering, and foundation model experience.
Python, MCP, Model Context Protocol (MCP), A2A, Agent-to-Agent (A2A), LangGraph, LangChain, LlamaIndex, CrewAI, AutoGen, OpenAI Agents SDK, Anthropic Agents SDK, pgvector, FAISS, Pinecone, Weaviate, Anthropic Claude, OpenAI, LangSmith, LangFuse, MLflow, LoRA, QLoRA, React, TypeScript, AWS, Azure, GCP
1w
Save
Mark Applied
Hide
GEN AI Engineer
Jersey City, New Jersey, United States
$90k-$120k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
2+ YOEHands-on Python and API development (FastAPI/Flask), experience with LLMs, prompt engineering, RAG/agentic architectures, LangChain/Hugging Face/Llama Index, and model deployment.
Python, FastAPI, Flask, LangChain, Hugging Face, Llama Index, Gemini, PyTorch, TensorFlow, Keras, Docker, Git
1w
Save
Mark Applied
Hide
Lead AI Engineer
Holmdel or Bethlehem or New York City
$119k-$195k/yr HybridFull Time
Guardian Life
Guardian Life: Provides life, disability, dental, and vision insurance products.
Advanced knowledge of machine learning engineering, distributed systems, cloud infrastructure, AI platforms, LLMs, RAG pipelines, orchestration, agentic frameworks, secure APIs, and enterprise governance.
Large Language Models (LLMs), retrieval-augmented generation (RAG), model orchestration frameworks, Agentic frameworks, API, cloud infrastructure, AI platforms