273 rag engineer jobs at 172 companies in Paramus, NJ
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
2+ YOEBachelor's in CS/Data Science, 2+ years Python and ML experience, knowledge of RAG pipelines/vector databases/LLM workflows; AWS and Terraform preferred.
KPMG: Global professional services network providing audit, tax, and advisory.
5+ YOEMinimum five years software engineering experience building and deploying AI/ML systems; Bachelor’s degree required (Master’s preferred); expertise with LLMs, RAG, data integration, CI/CD, and mentoring skills.
LLMs, Azure OpenAI, Google Cloud, LangChain, LangGraph, Semantic Kernel, Azure AI Search, Databricks, Microsoft Fabric, Azure DevOps, Git, CI/CD, RAG
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Miami or New York or San Francisco or Mexico City or United States
RemoteFull Time
Félix Pago: Remittance platform for money transfers via WhatsApp messaging.
8+ YOE8+ years software engineering experience with infrastructure and systems development; 2+ years building production LLM/AI applications; strong Python, system architecture, containerization (Docker/Kubernetes), CI/CD, observability, RAG and agentic systems experience.
San Francisco or Seattle or Los Angeles or New York City or United Kingdom or Ireland or Poland or Germany or Australia or North America or Europe
$200k-$260k/yrRemoteFull Time
Whatnot: Social marketplace for buying and selling via live streams
4+ YOE4+ years industry experience, 1+ years applied AI/LLM product experience; strong fluency with prompt engineering, RAG, MCP, agents, evals; systems-integration experience with APIs/webhooks; strong communication and mentorship skills.
BlackRockNYSE: BLK: Provides investment management and financial technology services globally.
Experience building and operating production AI/LLM systems, RAG, fine-tuning, model evaluation; deep Java and Python fluency; API and cloud service design; platform delivery at scale; strong communication and Agile experience; leadership of engineering teams.
American ExpressNYSE: AXP: Global financial services and credit card payment network.
5+ YOE5+ years software engineering experience with production LLM/ML systems, strong backend/API/cloud fundamentals, hands-on LLM tooling and RAG pipelines, AI-assisted workflows, and US work authorization required.
Mirage: AI platform for automated video creation and professional editing.
5+ YOE5+ years experience building ML/agentic systems, expertise in context engineering (RAG, token optimization), evaluation systems, and production-quality agent infrastructure.
Forward Deployed Engineer III, Generative AI, Google Cloud
San Francisco or Atlanta or Boulder or Cambridge or Chicago or Addison or Detroit or Irvine or Kirkland or Los Angeles or Miami or Mountain View or New York or Portland or Reston or San Diego or Seattle or Sunnyvale or Washington D.C.
Fidelity Investments: Provides investment management, retirement planning, and brokerage services.
Hands-on ML engineering experience building document parsing, embedding pipelines, semantic search, RAG, and production AI systems; familiarity with vector DBs and OCR; ability to collaborate with data engineering and mentor junior engineers. No visa sponsorship.
Pinecone, Weaviate, Milvus, pgvector, Elasticsearch, LangChain, LlamaIndex, Hugging Face
Millennium Management: Global alternative investment firm managing diverse investment strategies.
5+ YOE5+ years data engineering experience,1–2 years hands-on AI experience,production GenAI experience,Python,AWS,Bedrock,LLMs,RAG,agent architectures;Bachelor's in CS or related.
NebiusNasdaq: NBIS: Builds cloud infrastructure and software for artificial intelligence development.
3+ YOE3+ years software engineering experience in customer-facing technical roles; strong Python, API, and backend skills; experience with LLMs, RAG, agent architectures and enterprise deployments; excellent communication and stakeholder management.
Databricks: A unified platform for data analytics and artificial intelligence.
10+ YOE10+ years engineering experience building and shipping ML/LLM products; hands-on in Python and modern ML frameworks (e.g., PyTorch); experience with personalization, model evaluation/monitoring, RAG, fine-tuning, and translating customer problems into product solutions.
Triomics: AI agents for oncology EHR data processing and workflows.
2+ YOE2+ years building ML/AI systems in production, strong Python, experience with agentic LLM pipelines, prompt engineering, fine-tuning, RAG, EMR-document extraction evaluation (precision/recall), and willingness to learn oncology clinical documentation.
Linero: An AI-native, venture-backed creating software at the intersection of national security, industrial infrastructure, and enterprise AI.
4+ YOE4+ years in AI/ML engineering with production systems; fine-tuning LLMs for domain-specific tasks; building RAG systems; multi-agent orchestration; private, air-gapped environments; strong software engineering fundamentals.