17 rag engineer jobs at 11 companies in Fishkill, NY
3mo
Save
Mark Applied
Hide
3mo
AI Engineer- Manager
Orlando or Montvale or Dallas
OnsiteFull Time
KPMG: Global professional services network providing audit, tax, and advisory.
5+ YOEMinimum five years software engineering experience building and deploying AI/ML systems; Bachelor’s degree required (Master’s preferred); expertise with LLMs, RAG, data integration, CI/CD, and mentoring skills.
LLMs, Azure OpenAI, Google Cloud, LangChain, LangGraph, Semantic Kernel, Azure AI Search, Databricks, Microsoft Fabric, Azure DevOps, Git, CI/CD, RAG
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Quincy or Toronto or Princeton or Boston or Clifton or Austin
$120k-$203k/yrHybridFull Time
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
7+ YOE7+ years software engineering, 3+ years building AI/ML/LLM solutions; expertise in cloud-native architectures, RAG, AI evaluation/observability, CI/CD, security, and mentoring engineers.
Washington or Orlando or Montvale or New York City or Dallas
OnsiteFull Time
KPMG: Global professional services network providing audit, tax, and advisory.
5+ YOE5+ years data engineering experience, Bachelor's required (Master's preferred), expertise with Databricks/Microsoft Fabric, Python, RAG/AI data preparation, Azure AI Search, and CI/CD toolchains.
Databricks, Microsoft Fabric, Azure AI Search, Python, Azure DevOps, Git, CI/CD
Quincy or Toronto or Berwyn or Princeton or Clifton
$120k-$203k/yrOnsiteFull Time
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOE3+ years in data/AI engineering or related field, bachelor's degree or equivalent, experience with large-scale data pipelines, Python and SQL, AI orchestration, RAG, MLOps/LLMOps, and governance.
CognizantNasdaq: CTSH: Provides IT consulting and digital business process services.
Strong experience with generative AI, LLMs and prompt engineering; hands-on development using .NET, React, Python; designing RAG pipelines, model training/fine-tuning, and Azure deployments.
CognizantNasdaq: CTSH: Provides global information technology and business process outsourcing services.
Generative AI, LLMs, prompt engineering; hands-on with .NET, React, Python; AI/ML architecture design (RAG); model training and optimization; Azure deployment
Senior Research Engineer - Experimental Engineering
Yonkers or Washington or Colchester or Arizona or California or Connecticut or Illinois or Maryland or Massachusetts or Michigan or New Hampshire or New Jersey or New York or Texas or Vermont or Virginia or District of Columbia
$115k-$160k/yrRemoteFull Time
Consumer Reports: Tests products and publishes ratings for consumer advocacy.
Senior research engineer with deep full-stack software engineering experience, strong applied AI/ML knowledge, prototyping and R&D experience, Python/FastAPI and frontend (React/React Native) familiarity, and ability to lead experiments and mentor engineers.
Franklin TempletonNYSE: BEN: Global investment firm providing asset and wealth management services.
5+ YOE5+ years software engineering experience including 2+ years deploying LLM/GenAI or agent-based systems; expert Python; experience with LangChain/OpenAI tool calling, vector DBs (Pinecone, FAISS), RAG, observability, and distributed services.
7+ YOE7+ years in cybersecurity/security engineering, 3+ years securing cloud platforms/APIs/CI/CD, working knowledge of AI/ML, security monitoring and incident response, preferred CISSP/CCSP/GIAC, strong communication skills.
Quincy or Toronto or Boston or Princeton or Clifton or Austin
$120k-$218k/yrHybridFull Time
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
10+ YOELead and deliver enterprise-scale AI, security automation, and data platforms; 10+ years software engineering, 4+ years AI/ML/Generative AI experience, strong cloud, CI/CD, RAG and security background; Master's preferred.
Boehringer Ingelheim: Researches and develops pharmaceutical products for humans and animals.
Proficiency in Python, LangChain/LangGraph, RAG pipelines, vector DBs, familiarity with major LLM providers, AI evaluation/testing, Git, CI/CD, Docker, and strong communication skills. US work authorization required.
Senior AI Systems Engineer – LLM & Agentic Systems
Englewood Cliffs or Manhattan or Brooklyn or Hoboken or Jersey City
$140k-$175k/yrHybridFull Time
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
5+ YOEBachelor's degree or equivalent; 5+ years building production software systems; Python and backend expertise; LLM/GenAI, agentic workflows, distributed systems, cloud, data pipelines, observability, and technical leadership experience.
New York City or Los Angeles or Chicago or Stamford
$188k-$220k/yrHybridFull Time
A+E Global Media: Operates global media brands and produces original multi-platform content.
8+ YOE3+ Mgmt8+ years in tech engineering with 2+ years in Applied AI integration; 3+ years of leadership; proficiency in Python and/or TypeScript/JavaScript; SQL; experience with LLM APIs and RAG; scalable AI deployments; cross-functional collaboration.