260 rag engineer jobs at 171 companies in Wayne, NJ

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
3w
Save
Mark Applied
Hide
Senior Engineer, AI
New York City, New York, United States
$215k-$265k/yr OnsiteFull Time
Clark
Clark: AI-powered trust infrastructure for audit and accounting firms.
5+ YOE5+ years software engineering experience; production software systems; experience with LLMs, agents, RAG, workflow orchestration; strong backend/full-stack fundamentals and product sensibility.
LLMs, RAG, evals, agent frameworks
3d
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
3w
Save
Mark Applied
Hide
Staff AI Engineer
Miami or New York or San Francisco or Mexico City or United States
RemoteFull Time
Félix Pago
Félix Pago: Remittance platform for money transfers via WhatsApp messaging.
8+ YOE8+ years software engineering experience with infrastructure and systems development; 2+ years building production LLM/AI applications; strong Python, system architecture, containerization (Docker/Kubernetes), CI/CD, observability, RAG and agentic systems experience.
Python, Docker, Kubernetes, CI/CD, LLM APIs, LLMOps, RAG, vector databases, Open CLAW, Hermes, WhatsApp
1mo
Save
Mark Applied
Hide
Innovation Senior AI Engineer
Boston or Jersey City or New York City or Massachusetts or New York or New Jersey or United States or Poland
$210k-$260k/yr OnsiteFull Time
Brown Brothers Harriman
Brown Brothers Harriman: Providing global investment management, custody, and private banking services.
3+ YOE3+ years AI/ML engineering (5+ years product development), hands-on leader, expert Python, production LLM/RAG/agent experience, workflow orchestration, Azure/AWS, vector DBs, evaluation and responsible-AI practices.
Python, Agno, LangChain, LlamaIndex, Temporal, Prefect, Airflow, Azure, AWS, Pinecone, Weaviate, pgvector, LLM, RAG
1mo
Save
Mark Applied
Hide
AI Tooling Engineer
San Francisco or Seattle or Los Angeles or New York City or United Kingdom or Ireland or Poland or Germany or Australia or North America or Europe
$200k-$260k/yr RemoteFull Time
Whatnot
Whatnot: Social marketplace for buying and selling via live streams
4+ YOE4+ years industry experience, 1+ years applied AI/LLM product experience; strong fluency with prompt engineering, RAG, MCP, agents, evals; systems-integration experience with APIs/webhooks; strong communication and mentorship skills.
Anthropic, OpenAI, Google, APIs, webhooks, LLM, RAG, MCP, evals
3w
Save
Mark Applied
Hide
Vice President, Application Engineer
New York City, New York, United States
$162k-$215k/yr HybridFull Time
BlackRock
BlackRockNYSE: BLK: Provides investment management and financial technology services globally.
Experience building and operating production AI/LLM systems, RAG, fine-tuning, model evaluation; deep Java and Python fluency; API and cloud service design; platform delivery at scale; strong communication and Agile experience; leadership of engineering teams.
Java, Python, Aladdin, LLM, RAG, APIs, Cloud
4d
Save
Mark Applied
Hide
Manager, Forward Deployed Engineer
New York, New York, United States
$160k-$240k/yr FieldFull Time
Trinity Life Sciences
Trinity Life Sciences: Strategic consulting and analytics for life sciences companies.
6+ YOE6–9 years software engineering experience, proficiency in Python/Node.js/React.js, cloud experience (Azure/AWS/GCP), hands-on GenAI/LLMs/RAG experience, client-facing communication, mentoring experience, Bachelor's or equivalent.
Python, Node.js, React.js, Azure, AWS, GCP, LLMs, RAG
2w
Save
Mark Applied
Hide
Distinguished AI Engineer - Onsite in Jersey City, NJ
Jersey City, New Jersey, United States
$140k-$210k/yr OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
10+ YOE10+ years in AI/ML systems or platform engineering; deep experience with LLMs, RAG, embeddings, model serving, LLMOps/MLOps, GPU/inference optimization, governance, and stakeholder engagement.
LLMs, LLMOps, MLOps, RAG, embeddings, AI gateways, model-serving, model hubs, agent frameworks, orchestration layers, GPU, evaluation frameworks, observability
1mo
Save
Mark Applied
Hide
Senior AI Engineer I
Phoenix or New York
$123k-$215k/yr HybridFull Time
American Express
American ExpressNYSE: AXP: Global financial services and credit card payment network.
5+ YOE5+ years software engineering experience with production LLM/ML systems, strong backend/API/cloud fundamentals, hands-on LLM tooling and RAG pipelines, AI-assisted workflows, and US work authorization required.
Python, Go, TypeScript, AWS, GCP, Kubernetes, REST, gRPC, Kafka, LLM, RAG
5d
Save
Mark Applied
Hide
Software Engineer, ML Products
New York City, New York, United States
$175k-$275k/yr OnsiteFull Time
Mirage
Mirage: AI platform for automated video creation and professional editing.
5+ YOE5+ years experience building ML/agentic systems, expertise in context engineering (RAG, token optimization), evaluation systems, and production-quality agent infrastructure.
2mo
Save
Mark Applied
Hide
Solution Engineer - Vice President
New York City, New York, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Global diversified financial services holding.
6+ YOE6+ years engineering experience in financial services or large/global environments; expertise in prompt engineering, RAG, CoT/ToT, solution design, architecture, and stakeholder communication; bachelor\u0002s degree or equivalent experience.
Chain-of-thought (CoT), Tree-of-thought (ToT), Retrieval-Augmented Generation (RAG)
2mo
Save
Mark Applied
Hide
Solution Engineer - Vice President
New York City, New York, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Providing global banking, investment, and wealth management services.
6+ YOE6+ years engineering experience in financial services or large/global environments; designing solutions, prompt frameworks, RAG pipelines, and enterprise architecture; strong communication, analytic, and stakeholder skills; bachelor’s degree or equivalent.
Chain-of-thought (CoT), Tree-of-thought (ToT), Retrieval-Augmented Generation (RAG)
1mo
Save
Mark Applied
Hide
Forward Deployed Engineer III, Generative AI, Google Cloud
San Francisco or Atlanta or Boulder or Cambridge or Chicago or Addison or Detroit or Irvine or Kirkland or Los Angeles or Miami or Mountain View or New York or Portland or Reston or San Diego or Seattle or Sunnyvale or Washington D.C.
$174k-$252k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
5+ YOE5 years software development; AI systems on cloud; production-grade AI solutions; customer engagement; data pipelines with vector DB/RAG
Python, LangGraph, CrewAI, ADK, RAG, Vector Databases, LLM Metrics, Vertex AI, MCP servers
6d
Save
Mark Applied
Hide
Director Applied AI / ML Engineer
Jersey City, New Jersey, United States
$126k-$255k/yr OnsiteFull Time
Fidelity Investments
Fidelity Investments: Provides investment management, retirement planning, and brokerage services.
Hands-on ML engineering experience building document parsing, embedding pipelines, semantic search, RAG, and production AI systems; familiarity with vector DBs and OCR; ability to collaborate with data engineering and mentor junior engineers. No visa sponsorship.
Pinecone, Weaviate, Milvus, pgvector, Elasticsearch, LangChain, LlamaIndex, Hugging Face
1mo
Save
Mark Applied
Hide
Forward Deployed Engineer, Enterprise - Tavily
New York City, New York, United States
$170k-$220k/yr OnsiteFull Time
Nebius
NebiusNasdaq: NBIS: Builds cloud infrastructure and software for artificial intelligence development.
3+ YOE3+ years software engineering experience in customer-facing technical roles; strong Python, API, and backend skills; experience with LLMs, RAG, agent architectures and enterprise deployments; excellent communication and stakeholder management.
Python, LLMs, Retrieval-Augmented Generation (RAG), LangChain, LlamaIndex, LangGraph, OpenAI Agents SDK, CrewAI, Pinecone, Weaviate, pgvector, Qdrant, Tavily API
2w
Save
Mark Applied
Hide
Staff Software Engineer - AI/ML
New York City or San Francisco
$192k-$260k/yr OnsiteFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
10+ YOE10+ years engineering experience building and shipping ML/LLM products; hands-on in Python and modern ML frameworks (e.g., PyTorch); experience with personalization, model evaluation/monitoring, RAG, fine-tuning, and translating customer problems into product solutions.
Python, PyTorch, Apache Spark, Delta Lake, MLflow
1mo
Save
Mark Applied
Hide
Forward Deployed ML Engineer
New York City, New York, United States
$170k-$190k/yr HybridFull Time
Triomics
Triomics: AI agents for oncology EHR data processing and workflows.
2+ YOE2+ years building ML/AI systems in production, strong Python, experience with agentic LLM pipelines, prompt engineering, fine-tuning, RAG, EMR-document extraction evaluation (precision/recall), and willingness to learn oncology clinical documentation.
Python, JSON, LLM
2mo
Save
Mark Applied
Hide
AI/ML Engineer
New York City, New York, United States
$160k-$250k/yr OnsiteFull Time
Linero
Linero: An AI-native, venture-backed creating software at the intersection of national security, industrial infrastructure, and enterprise AI.
4+ YOE4+ years in AI/ML engineering with production systems; fine-tuning LLMs for domain-specific tasks; building RAG systems; multi-agent orchestration; private, air-gapped environments; strong software engineering fundamentals.
Python, PyTorch, LLMs, RAG, Embeddings, VectorDB, Docker, Kubernetes
1d
Save
Mark Applied
Hide
Senior AI Engineer
New York City, New York, United States
$110k-$160k/yr OnsiteFull Time
DualEntry
DualEntry: AI-native ERP software for automated enterprise financial operations.
3+ YOE3+ years technical experience, 2+ years shipping production AI systems; strong backend, APIs, cloud experience; production LLM/RAG/agent experience; proficiency in Python; excellent communication and critical thinking.
Python, Kotlin, Java, TypeScript, Postgres
1w
Save
Mark Applied
Hide
Staff Software Engineer
Hoboken, New Jersey, United States
$150k-$165k/yr HybridFull Time
Pearson
PearsonLondon Stock Exchange: PSON: Provide educational materials, assessments, and digital learning services globally.
10+ YOE10+ years building web applications and distributed systems; hands-on experience with agentic AI, LLMs, RAG, ReactJS, Java, Python, SQL; cloud-native experience (AWS/Azure/GCP); mentoring and architectural leadership.
ReactJS, Java, Python, SQL, Large Language Model (LLM), Retrieval-Augmented Generation (RAG), vector databases, AWS, Azure, GCP