97 rag engineer jobs at 73 companies in Massachusetts

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
4w
Save
Mark Applied
Hide
Innovation Senior AI Engineer
Boston or Jersey City or New York City or Massachusetts or New York or New Jersey or United States or Poland
$210k-$260k/yr OnsiteFull Time
Brown Brothers Harriman
Brown Brothers Harriman: Providing global investment management, custody, and private banking services.
3+ YOE3+ years AI/ML engineering (5+ years product development), hands-on leader, expert Python, production LLM/RAG/agent experience, workflow orchestration, Azure/AWS, vector DBs, evaluation and responsible-AI practices.
Python, Agno, LangChain, LlamaIndex, Temporal, Prefect, Airflow, Azure, AWS, Pinecone, Weaviate, pgvector, LLM, RAG
1mo
Save
Mark Applied
Hide
AI Evaluation Engineer
Bucharest or Boulder or Boston or Chicago or Glendora or Richmond or London or Auckland
lei16k-lei19k/mo HybridFull Time
Yes Energy
Yes Energy: Provides real-time electric power market data and trading analytics.
5+ YOEBachelor's in CS/Data/Math, 5+ years software engineering with focus on testing/evaluation or AI/ML tooling, strong Python, experience building evaluation pipelines and LLM eval concepts, familiarity with RAG and production data pipelines.
RAGAS, LangSmith, PromptFlow, Snowflake, Python, RAG
1mo
Save
Mark Applied
Hide
Forward Deployed Engineer III, Generative AI, Google Cloud
San Francisco or Atlanta or Boulder or Cambridge or Chicago or Addison or Detroit or Irvine or Kirkland or Los Angeles or Miami or Mountain View or New York or Portland or Reston or San Diego or Seattle or Sunnyvale or Washington D.C.
$174k-$252k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
5+ YOE5 years software development; AI systems on cloud; production-grade AI solutions; customer engagement; data pipelines with vector DB/RAG
Python, LangGraph, CrewAI, ADK, RAG, Vector Databases, LLM Metrics, Vertex AI, MCP servers
1w
Save
Mark Applied
Hide
Senior Software Engineer
Wakefield, Massachusetts, United States
$102k-$190k/yr HybridFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
5+ YOE5-8 years software engineering experience focused on large-scale data engineering, distributed systems, Databricks, Python/PySpark, AWS, Kafka, SQL/NoSQL, CI/CD and IaC; BE/BTech/MTech/MCA in CS/IT or related.
Databricks, Python, PySpark, Apache Spark, Delta Lake, Java, S3, Lambda, API Gateway, EventBridge, Kafka, SQL Server, MongoDB, Jenkins, GitHub, GitLab, Bitbucket, Terraform, Ansible, Azure, Google Cloud Platform (GCP), LLMs, RAG
2mo
Save
Mark Applied
Hide
Senior / Staff Software Engineer
Boston or United States
HybridFull Time
Axella Biosciences
Axella Biosciences: AI-driven biomanufacturing execution platform for drug production.
7+ YOE7+ years in software engineering with end-to-end production systems; experience owning LLM-powered systems (RAG, agents); strong cloud and code-quality practices.
React, Node.js, MongoDB, AWS, Terraform, TypeScript, GitHub Actions, RAG, agents
2w
Save
Mark Applied
Hide
AI Engineer - Forward Deployed
San Francisco or New York or Boston or United States
$200k-$350k/yr FieldFull Time
Edison Scientific
Edison Scientific: Developing autonomous AI agents for scientific research and discovery.
2+ YOE2+ years professional software engineering; strong Python and/or TypeScript/JavaScript; experience deploying LLM/agentic AI systems, RAG pipelines, prompt engineering, and production integrations; 20-40% travel; degree in CS/related or equivalent experience.
Python, TypeScript, JavaScript, LLM, RAG
1w
Save
Mark Applied
Hide
AI Platform Engineer
Somerville, Massachusetts, United States
$100k-$155k/yr HybridFull Time
Tulip
Tulip: Provides a no-code platform for industrial frontline operations.
5+ YOE5+ years building AI/LLM solutions, Bachelor's in CS/Engineering or equivalent, production experience with LLMs, agent frameworks, RAG, prompt engineering, Typescript, RESTful APIs, AWS/GCP, and CI/CD; strong communication and product judgment.
Typescript, RESTful, LLM, RAG, AWS, GCP, CI/CD
1mo
Save
Mark Applied
Hide
Applied AI Engineer
Chestnut Hill, Massachusetts, United States
OnsiteFull Time
WS Development
WS Development: Develops and manages mixed-use retail and community real estate.
3+ YOEBS or MS in engineering/computer science/math or related field; 3+ years in production software/AI/ML; strong Python; experience with LLMs/RAG; agentic architectures; observability; governance; stakeholder communication.
Python, LLMs, RAG, Agentic architectures, Observability, APIs
1mo
Save
Mark Applied
Hide
Senior Software Engineer I
Boston or Manhattan
$150k-$166k/yr OnsiteFull Time
Compass
CompassNYSE: COMP: Technology-enabled residential real estate brokerage and agent software platform.
6+ YOE6+ years software engineering experience; 1+ year building LLM/GenAI applications; experience with RAG, vector databases, LangChain/LlamaIndex/LangGraph/AutoGen; distributed systems, APIs, security, AWS, Docker, CI/CD.
LangChain, LlamaIndex, LangGraph, AutoGen, RAG, LLMs, RESTful APIs, GraphQL, Kafka, RabbitMQ, OAuth, AWS, Docker, CI/CD
3mo
Save
Mark Applied
Hide
Junior Forward Deployed Engineer
Plano or Boston or East Brunswick
$68k-$79k/yr FieldFull Time
Wipro
WiproNYSE: WIT: Global technology services and consulting for digital transformation.
0+ YOERecent BS/MS in CS, Engineering, or related; 0–2 years software or implementation experience; programming in Python/JavaScript/Java; API and database familiarity; exposure to cloud platforms and applied AI concepts; strong communication and problem solving.
Python, JavaScript, Java, APIs, SQL, NoSQL, AWS, Azure, GCP, Git, LLM, RAG
2mo
Save
Mark Applied
Hide
Senior Software Engineer, AI/ML
Cambridge, Massachusetts, United States
HybridFull Time
Datalign Advisory
Datalign Advisory: AI-driven platform matching individuals with financial advisors.
7+ YOE7+ years of software engineering; lead AI/ML/LLM projects; Python; AWS; distributed systems; strong communication; BS in CS, MS preferred.
Python, TypeScript, Go, AWS, LLM, RAG, tool calling, LoRA, distributed systems, cloud monitoring
3w
Save
Mark Applied
Hide
Distinguished AI Engineer (Agentic AI Platform)
San Francisco or McLean or Cambridge or San Jose or New York City
$294k-$335k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
6+ YOEBachelor's or Master's in CS/Engineering/AI with 6–8+ years building and deploying scalable AI/ML systems; strong programming in Python/Go/Scala/Java and experience with agentic frameworks, cloud platforms, and LLMs.
Python, Go, Scala, Java, C++, C#, Golang, LangGraph, AutoGen, Semantic Kernal, Semantic Kernel (Microsoft), CrewAI, LlamaIndex, LangChain, AWS, Google Cloud, Azure, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, K8s, Helm charts, CRDs, SDK, CLI, VectorDBs, RAG, LLM Inference, Similarity Search
1w
Save
Mark Applied
Hide
Senior AI Platform Engineer
San Francisco or Alabama or Arkansas or California or Colorado or Florida or Georgia or Illinois or Kentucky or Massachusetts or Michigan or Montana or Missouri or Nevada or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Texas or Washington or Utah or Virginia or Wisconsin
$156k-$231k/yr HybridFull Time
Afresh
Afresh: AI-powered inventory management for grocery store fresh food departments.
3+ YOE3+ years building production software or ML/data systems; strong Python and systems/API design; experience with LLM retrieval/RAG, agents, evaluation, Databricks/MLflow and modern data stacks.
Python, PySpark, dbt, Databricks, Delta Lake, Unity Catalog, MLflow, Astronomer, Airflow, Claude, GitHub, Shortcut, Notion, pgvector, Pinecone, Weaviate, LangGraph, MCP
4w
Save
Mark Applied
Hide
AI Developer, AVP
Burlington, Massachusetts, United States
$90k-$158k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
2+ YOEHands-on engineer with 2+ years building production AI systems: LLMs, RAG, agent frameworks, Python (plus Java/C#/TypeScript), cloud platforms (Azure preferred), Kafka/Event Hub, Redis/Hazelcast, and CI/CD practices.
LLMs, RAG, MCP, Python, Java, C#, TypeScript, Kafka, Event Hub, Redis, Hazelcast, Snowflake, Microsoft Azure, AWS, GCP, API Management, APIs, CI/CD, Agile, Scrum
3mo
Save
Mark Applied
Hide
Data Engineer
Wakefield or Denver or New York or Atlanta or Cary or Dallas or Pasadena or Rancho Cordova or West Palm Beach
$90k-$150k/yr HybridFull Time
GEI Consultants
GEI Consultants: Professional engineering and environmental consulting services.
4+ YOE4+ years of data engineering; Python and SQL; Azure data services; ETL/ELT; data governance; supports AI/RAG and analytics.
Python, SQL, PySpark, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure SQL, Cosmos DB, Databricks, Delta Lake, Unity Catalog, Power BI, API, Graph connectors, CI/CD, Terraform
1mo
Save
Mark Applied
Hide
Software Engineer
Boston, Massachusetts, United States
$111k-$177k/yr HybridFull Time
Red Hat
Red Hat: Provides enterprise-grade open source software and cloud solutions.
1+ YOEBachelor's degree in Computer Science with 1 year of experience; experience with Python or GoLang, AI-assisted dev tools, Git; CI/CD with Argo CD and Tekton; OpenShift; AI tech including RAG and MCP; experience in agile teams.
Python, Go, Git, Argo CD, Tekton, OpenShift, Cursor, Claude Code, MCP, RAG
2mo
Save
Mark Applied
Hide
AI Engineer
Burlington, Massachusetts, United States
$150k-$180k/yr HybridFull Time
NetBrain
NetBrain: Provides AI-powered no-code network automation and visibility software.
5+ YOE5+ years software engineering; production-grade LLM/RAG systems; strong Python; C/C++ or C#; experience with AI frameworks and evaluation pipelines
Python, C++, C#, LangChain, LangGraph, AutoGen, LlamaIndex, GraphRAG, APIs, Testing
2w
Save
Mark Applied
Hide
Applied AI Engineer/Architect
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$225k-$304k/yr OnsiteFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
7+ YOE7+ years in software/data/ML/AI or architecture with hands-on AI engineering; strong Python plus TypeScript/Java/C# experience; experience with LLMs, RAG, agents, MLOps, and hyperscaler AI platforms; ability to work in US without sponsorship.
LLMs, agents, RAG, ChatGPT, Python, TypeScript, Java, C#, Azure OpenAI, AWS Bedrock, Google Vertex AI, Databricks, Snowflake, Microsoft Fabric, MLOps, APIs
4w
Save
Mark Applied
Hide
Lead AI Engineer
Boston, Massachusetts, United States
$150k-$190k/yr HybridFull Time
Mirakl
Mirakl: Provides enterprise marketplace and dropship software solutions.
7+ YOE7+ years in software/ML engineering with expertise in LLMs, RAG, AI Agents, production ML systems, Python/SQL, cloud infrastructure, and leadership on cross-functional initiatives.
Python, SQL, OpenAI, Anthropic, Gemini, Mistral, LangGraph, LangChain, LlamaIndex, MCP, Vector Databases, AWS, GCP, Docker, Kubernetes
2mo
Save
Mark Applied
Hide
Senior AI Engineer
Boston, Massachusetts, United States
HybridFull Time
Topline Pro
Topline Pro: AI-powered marketing and website platform for home service professionals.
5+ YOE5+ years AI/ML/NLP engineering; Python; Django, React, PostgreSQL; RAG and vector databases; OpenAI/Anthropic APIs; LLMs and NLP; MLOps; agile collaboration.
Python, Django, React, PostgreSQL, OpenAI API, Anthropic API, LangChain, LangGraph, Pydantic AI, MLOps, Vector databases, Retrieval Augmented Generation