260 rag engineer jobs at 171 companies in Wayne, NJ
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Miami or New York or San Francisco or Mexico City or United States
RemoteFull Time
Félix Pago: Remittance platform for money transfers via WhatsApp messaging.
8+ YOE8+ years software engineering experience with infrastructure and systems development; 2+ years building production LLM/AI applications; strong Python, system architecture, containerization (Docker/Kubernetes), CI/CD, observability, RAG and agentic systems experience.
San Francisco or Seattle or Los Angeles or New York City or United Kingdom or Ireland or Poland or Germany or Australia or North America or Europe
$200k-$260k/yrRemoteFull Time
Whatnot: Social marketplace for buying and selling via live streams
4+ YOE4+ years industry experience, 1+ years applied AI/LLM product experience; strong fluency with prompt engineering, RAG, MCP, agents, evals; systems-integration experience with APIs/webhooks; strong communication and mentorship skills.
BlackRockNYSE: BLK: Provides investment management and financial technology services globally.
Experience building and operating production AI/LLM systems, RAG, fine-tuning, model evaluation; deep Java and Python fluency; API and cloud service design; platform delivery at scale; strong communication and Agile experience; leadership of engineering teams.
Distinguished AI Engineer - Onsite in Jersey City, NJ
Jersey City, New Jersey, United States
$140k-$210k/yrOnsiteFull Time
NTT DATA: Global provider of IT and business consulting services.
10+ YOE10+ years in AI/ML systems or platform engineering; deep experience with LLMs, RAG, embeddings, model serving, LLMOps/MLOps, GPU/inference optimization, governance, and stakeholder engagement.
LLMs, LLMOps, MLOps, RAG, embeddings, AI gateways, model-serving, model hubs, agent frameworks, orchestration layers, GPU, evaluation frameworks, observability
American ExpressNYSE: AXP: Global financial services and credit card payment network.
5+ YOE5+ years software engineering experience with production LLM/ML systems, strong backend/API/cloud fundamentals, hands-on LLM tooling and RAG pipelines, AI-assisted workflows, and US work authorization required.
Mirage: AI platform for automated video creation and professional editing.
5+ YOE5+ years experience building ML/agentic systems, expertise in context engineering (RAG, token optimization), evaluation systems, and production-quality agent infrastructure.
CitiNYSE: C: Global diversified financial services holding.
6+ YOE6+ years engineering experience in financial services or large/global environments; expertise in prompt engineering, RAG, CoT/ToT, solution design, architecture, and stakeholder communication; bachelor\u0002s degree or equivalent experience.
CitiNYSE: C: Providing global banking, investment, and wealth management services.
6+ YOE6+ years engineering experience in financial services or large/global environments; designing solutions, prompt frameworks, RAG pipelines, and enterprise architecture; strong communication, analytic, and stakeholder skills; bachelor’s degree or equivalent.
Forward Deployed Engineer III, Generative AI, Google Cloud
San Francisco or Atlanta or Boulder or Cambridge or Chicago or Addison or Detroit or Irvine or Kirkland or Los Angeles or Miami or Mountain View or New York or Portland or Reston or San Diego or Seattle or Sunnyvale or Washington D.C.
Fidelity Investments: Provides investment management, retirement planning, and brokerage services.
Hands-on ML engineering experience building document parsing, embedding pipelines, semantic search, RAG, and production AI systems; familiarity with vector DBs and OCR; ability to collaborate with data engineering and mentor junior engineers. No visa sponsorship.
Pinecone, Weaviate, Milvus, pgvector, Elasticsearch, LangChain, LlamaIndex, Hugging Face
NebiusNasdaq: NBIS: Builds cloud infrastructure and software for artificial intelligence development.
3+ YOE3+ years software engineering experience in customer-facing technical roles; strong Python, API, and backend skills; experience with LLMs, RAG, agent architectures and enterprise deployments; excellent communication and stakeholder management.
Databricks: A unified platform for data analytics and artificial intelligence.
10+ YOE10+ years engineering experience building and shipping ML/LLM products; hands-on in Python and modern ML frameworks (e.g., PyTorch); experience with personalization, model evaluation/monitoring, RAG, fine-tuning, and translating customer problems into product solutions.
Triomics: AI agents for oncology EHR data processing and workflows.
2+ YOE2+ years building ML/AI systems in production, strong Python, experience with agentic LLM pipelines, prompt engineering, fine-tuning, RAG, EMR-document extraction evaluation (precision/recall), and willingness to learn oncology clinical documentation.
Linero: An AI-native, venture-backed creating software at the intersection of national security, industrial infrastructure, and enterprise AI.
4+ YOE4+ years in AI/ML engineering with production systems; fine-tuning LLMs for domain-specific tasks; building RAG systems; multi-agent orchestration; private, air-gapped environments; strong software engineering fundamentals.
DualEntry: AI-native ERP software for automated enterprise financial operations.
3+ YOE3+ years technical experience, 2+ years shipping production AI systems; strong backend, APIs, cloud experience; production LLM/RAG/agent experience; proficiency in Python; excellent communication and critical thinking.
PearsonLondon Stock Exchange: PSON: Provide educational materials, assessments, and digital learning services globally.
10+ YOE10+ years building web applications and distributed systems; hands-on experience with agentic AI, LLMs, RAG, ReactJS, Java, Python, SQL; cloud-native experience (AWS/Azure/GCP); mentoring and architectural leadership.
ReactJS, Java, Python, SQL, Large Language Model (LLM), Retrieval-Augmented Generation (RAG), vector databases, AWS, Azure, GCP