41 ai system architect jobs at 27 companies in Boston, MA
2mo
Save
Mark Applied
Hide
AI System Architect - US
Boston, Massachusetts, United States
RemoteFull Time
8+ YOE8+ years in enterprise solutions architecture with Workato or comparable iPaaS, CRM/ERP integrations (Salesforce, NetSuite), production AI/ML delivery, integration governance, REST/GraphQL API patterns, and team leadership.
Workato, Workato eMCP, Workato AI Hub, Model Context Protocol (MCP), ChatGPT, Claude, Salesforce, NetSuite, HiBob, Jira, MuleSoft, Boomi, Azure Integration Services, REST, GraphQL, API, ETL, ELT, webhook, vector databases, RAG, LLM
1w
Save
Mark Applied
Hide
Staff AI Architect
Boston or Cambridge
$191k-$239k/yr RemoteFull Time
10+ YOETypically 10+ years in software, solution, or enterprise architecture; production LLM and agentic systems experience; proficiency in Python, Go, TypeScript, or Java; cloud-native, enterprise integration, security, governance, and communication expertise.
LangGraph, CrewAI, AutoGen, Semantic Kernel, OpenAI Agents SDK, Model Context Protocol (MCP), Python, Go, TypeScript, Java, Kubernetes, Workday, Salesforce, NetSuite, Greenhouse, ServiceNow, Workato, MuleSoft, Boomi, n8n, OWASP, NIST AI RMF, ISO/IEC 42001, EU AI Act, Cursor, Claude Code, GitHub Copilot, A2A, SPIFFE/SPIRE, LangFuse, Arize, Braintrust, LangSmith, OpenTelemetry, GraphRAG, TOGAF, LinkedIn Learning
3w
Save
Mark Applied
Hide
Principal Agentic AI Architect
Allentown or Louisville or Providence
HybridFull Time
15+ YOEBachelor's degree and 15+ years experience in enterprise AI/ML and platform architecture; expertise in Generative AI, LLMs, multi-agent systems, cloud platforms, data governance, and regulated industries.
Generative AI, LLMs, Azure, Databricks, ADLS, Snowflake, SAP IS-U, APIs, microservices, OMS, GIS, SCADA
1w
Save
Mark Applied
Hide
Senior Managing Consultant - AI Architect
Coral Gables or Research Triangle Park or Durham or Boston or Atlanta or Jersey City or Dallas or Houston or Austin or Washington or Chicago or New York
$144k-$268k/yr HybridFull Time
10+ YOEBachelor's degree and 10–12+ years in software, data, machine learning, or cloud architecture, with ML deployment, MLOps, generative AI, cloud, data architecture, and system design expertise.
MLflow, Kubeflow, Vertex AI, Amazon SageMaker, OpenAI, Anthropic, Llama, Hugging Face, Spark, Airflow, Kafka, Snowflake, BigQuery, Redshift, IBM Cloud
1mo
Save
Mark Applied
Hide
Senior AI Software Architect
Redmond or Boston or Mountain View
$120k-$235k/yr HybridFull Time
4+ YOEBachelor's in CS or related plus 4+ years engineering experience or equivalent; strong coding in C/C++/C#/Java/JavaScript/Python; experience with AI systems, performance analysis, and large-scale distributed workloads.
C, C++, C#, Java, JavaScript, Python
3mo
Save
Mark Applied
Hide
BCG Platinion | Lead AI Tech Architect - AI Platforms
Atlanta or Austin or Boston or Brooklyn or Chicago or Dallas or Denver or Detroit or Durham or Houston or Miami or Minneapolis or Nashville or New York or Philadelphia or Pittsburgh or Summit or Washington
$190k/yr OnsiteFull Time
6+ YOEBachelor's in CS/IT or related,6+ years in software/data/AI systems with architecture or technical leadership, experience designing LLM/AI platform solutions, cloud and containerization experience, proficiency with Python/JS/TypeScript and AI frameworks.
LangChain, LlamaIndez, LangGraph, Strands, Google ADK, Semantic Kernel, AutoGen, LlamaIndex, Python, Javascript, TypeScript, Cursor, Claude Code, Replit, Lovable, RAG, Docker, Kubernetes, Pinecone, Qdrant, Aure Search, ChatGPT, Claude, AWS, Azure, GCP
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (East)
Atlanta or Boston or Charlotte or Hartford or Miami or New Brunswick or New York City or Philadelphia or Raleigh or Washington
$108k-$218k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python and API frameworks, evaluation and governance for production AI systems.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, Model Context Protocol (MCP), LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, Python, FastAPI, Flask
3mo
Save
Mark Applied
Hide
Senior System Software Architect, Enterprise Reference Architectures
Santa Clara or Westford or Austin or Boulder
$208k-$328k/yr OnsiteFull Time
12+ YOE12+ years software/infrastructure architecture; 3+ years microservices; experience in AI, HPC, or cloud-native infra; GPU-accelerated systems; on-prem and cloud deployments.
Kubernetes, Docker, Kafka, RabbitMQ, NVLink, PCIe, InfiniBand, Ethernet, RoCE, Python, C++, CUDA
1w
Save
Mark Applied
Hide
Sr. AI Systems & Solutions Architect
Boston or Denver or San Francisco
$112k-$168k/yr OnsiteFull Time
4+ YOERequires a technical foundation, AI prototype development, LLMs, APIs, system integrations, prompt engineering, documentation, communication, and 4+ years in AI solutions, architecture, tooling, automation, or similar roles.
Claude, ChatGPT, Glean, LLMs, APIs, MCPs
3w
Save
Mark Applied
Hide
AI Systems Design Architect - Assistant Vice President
Quincy or Boston or Princeton or Austin
$90k-$158k/yr OnsiteFull Time
8+ YOE8+ years in solution/platform architecture with Generative AI/LLMs, cloud architecture (AWS/Azure/GCP), API and distributed systems experience; strong stakeholder communication and Responsible AI knowledge.
AWS, Azure, Google Cloud Platform (GCP), LLMs, vector databases, RAG, DevSecOps
3w
Save
Mark Applied
Hide
AI Systems Design Architect, Vice President
Quincy, Massachusetts, United States
$120k-$218k/yr OnsiteFull Time
12+ YOE12+ years in solution or enterprise architecture with deep Generative AI, cloud (AWS/Azure/GCP), platform engineering, RAG/LLMs, vector DBs, CI/CD and governance experience.
AWS, Azure, Google Cloud Platform (GCP), LLMs, RAG, vector databases, DevSecOps, CI/CD
2mo
Save
Mark Applied
Hide
Senior Solution Architect
Boston, Massachusetts, United States
$194k-$237k/yr OnsiteFull Time
10+ YOEStrategic lead architect for Finance systems; ERP and AI/ML experience; 10+ years IT/architecture; healthcare compliance knowledge.
SQL, Java, ERP, Oracle Financials, AI/ML
2w
Save
Mark Applied
Hide
Presales Solution Architect – Mendix & AI Solutions
Boston or United States
$125k-$251k/yr RemoteFull Time
Presales technical leader to design Mendix and AI solutions, lead discovery, build demos and POCs, integrate AI/ICX/Graph with enterprise systems, and present to technical and executive stakeholders.
Mendix, Intelligence Center X (ICX), Graph, LLMs, Retrieval-Augmented Generation (RAG), vector databases, Azure, AWS, Google Cloud, MEDDPICC
4d
Save
Mark Applied
Hide
AI Solution Architect_Boston
Boston, Massachusetts, United States
$64k-$224k/yr OnsiteFull Time, Contract
Photon: An organization developing enterprise artificial intelligence platforms and software solutions.
10+ YOERequires 10–15+ years of software engineering experience, including 4+ years in AI/ML architecture, with expertise in agentic AI, RAG, Python, cloud AI, vector search, APIs, event-driven systems, and microservices.
Python, LangChain, LangGraph, AutoGen, CrewAI, LlamaIndex, Azure OpenAI, AWS Bedrock, Google Vertex AI, Pinecone, Qdrant, OpenSearch, pgvector, Kafka, RabbitMQ, Docker, Kubernetes, Terraform, Redis, Salesforce, Microsoft SharePoint, Confluence, SQL, NoSQL, Ragas, TruLens, DeepEval, CI/CD, IAM, RBAC, RAG, LLMOps
1mo
Save
Mark Applied
Hide
AI Systems Architect (Models & Hardware Co-Design)
Santa Clara or Austin or Boston
$200k-$500k/yr OnsiteFull Time
Deep knowledge of modern ML architectures (e.g., transformers), strong mathematical foundations, experience with ML training/inference, and familiarity with ML frameworks and hardware co-design.
PyTorch, JAX, TensorFlow
1mo
Save
Mark Applied
Hide
Senior. Distinguished AI Engineer (Agentic AI Platform)
San Francisco or McLean or Cambridge or San Jose or New York
$343k-$392k/yr OnsiteFull Time
8+ YOEMaster's + 8 years or Bachelor's + 10 years in AI/ML; deep software engineering skills; experience with agentic frameworks, LLMOps, cloud platforms, Kubernetes, and mentoring/architecting large-scale AI systems.
Python, Go, Golang, Scala, Java, C++, C#, LangGraph, AutoGen, Semantic Kernel (Microsoft), Semantic Kernel, LangChain, CrewAI, LlamaIndex, LLMOps, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, AWS, Google Cloud, Azure, K8s, Helm, CRDs, CLI, SDK, VectorDBs
1w
Save
Mark Applied
Hide
Worldwide Specialist Solutions Architect - Messaging & Analytics, Data & AI GTM
Boston or Seattle or Arlington or Herndon
$154k-$208k/yr OnsiteFull Time
3+ YOERequires 3+ years designing or operating messaging systems, 5+ years in customer-facing technical specialist, solutions architect, or systems engineering roles, and experience with distributed asynchronous architectures.
Amazon SQS, Amazon SNS, Amazon MQ, EventBridge, Kinesis, RabbitMQ, Apache ActiveMQ, MQTT, IBM MQ, TIBCO, Apache Kafka, AWS EventBridge, AMQP, STOMP, JMS, TIBCO EMS, webMethods
2mo
Save
Mark Applied
Hide
Principal Heterogenues AI Accelerator Lead
Boston or San Jose
$200k-$275k/yr OnsiteFull Time
10+ YOEPhD or Master’s in computer/electrical engineering, 10+ years in analog/digital AI accelerator or embedded systems, ASIC/RTL/SystemVerilog expertise, SystemC modeling, UVM, C, and technical leadership experience.
Synopsys Platform Architect, SystemVerilog, SystemC, UVM, C, RTL
2mo
Save
Mark Applied
Hide
AI Systems Engineering Instructor
Boston or United States or Israel
RemotePart Time
5+ YOE5+ years as a senior systems/backend/platform engineer or architect, shipped systems at scale, deep knowledge of system design, APIs, cloud (AWS, Kubernetes, Terraform, CI/CD), distributed systems, strong technical communication, English C1+.
AWS, Kubernetes, Terraform, CI/CD, Notion, Miro, Slack, Figma, AI tools
2mo
Save
Mark Applied
Hide
Principal Software Engineer (AI/ML Architect-Engineer)
Seattle or Lowell or Atlanta or Alpharetta or Sunrise
$164k-$271k/yr HybridFull Time
12+ YOEMS/PhD or equivalent; 12+ years in software development and AI with 5+ years in generative AI; proven experience architecting and deploying large-scale AI/ML systems; proficiency in Python, Java, TensorFlow, PyTorch, and cloud platforms.
Python, Java, TensorFlow, PyTorch, AWS, Google Cloud, Azure, Kubernetes, Terraform, GitHub Actions
Explore Jobs
Expand Your Job Search
Top Cities Near Boston for AI System Architect
- AI System Architect jobs in Worcester, MA
- AI System Architect jobs in Providence, RI
- AI System Architect jobs in Lowell, MA
- AI System Architect jobs in Cambridge, MA
- AI System Architect jobs in Manchester, NH
- AI System Architect jobs in Brockton, MA
- AI System Architect jobs in Fall River, MA
- AI System Architect jobs in Quincy, MA
- AI System Architect jobs in Lynn, MA
- AI System Architect jobs in Newton, MA
- AI System Architect jobs in Nashua, NH
- AI System Architect jobs in Warwick, RI
- AI System Architect jobs in Cranston, RI
- AI System Architect jobs in Somerville, MA
- AI System Architect jobs in Lawrence, MA
- AI System Architect jobs in Pawtucket, RI
- AI System Architect jobs in Framingham, MA
- AI System Architect jobs in Waltham, MA
- AI System Architect jobs in Haverhill, MA
- AI System Architect jobs in Malden, MA