599 ai system architect jobs at 314 companies in United States
2mo
Save
Mark Applied
Hide
2mo
AI System Architect - US
Boston, Massachusetts, United States
RemoteFull Time
Tufin: Automates network security policies across complex hybrid cloud environments.
8+ YOE8+ years in enterprise solutions architecture with Workato or comparable iPaaS, CRM/ERP integrations (Salesforce, NetSuite), production AI/ML delivery, integration governance, REST/GraphQL API patterns, and team leadership.
Majestic Labs: Developing memory-first AI server platforms for data centers.
10+ YOEPhD in EE/CS or related, 10+ years in performance modeling and system architecture for AI/hyperscale or semiconductor organizations; expertise in ISAs, cache coherence, memory systems, interconnects; proficiency in Modern C++ and Python; experience with NSight, ROCm, VTune.
Modern C++, Python, NSight, ROCm, VTune, HBM4, CXL, Network-on-Chip (NoC), GPUs, NPUs, SoCs, Instruction Set Architectures (ISA)
Virtusa: Digital engineering and IT business transformation services provider.
Architect-level experience designing and operating automated evaluation frameworks for AI agents, production support, strong communication and technical leadership skills.
SandiskNasdaq: SNDK: Designs and manufactures flash memory and data storage products.
10+ YOEMaster's or Ph.D. in EE/CE/CS,10+ years in system/SoC architecture and memory system development, strong C/C++ and Python skills, RTL and system-level modeling experience, knowledge of memory technologies and interconnects.
Cyclotron: Technology consultancy providing Microsoft cloud and digital transformation solutions.
4+ YOE4+ years enterprise software/data/AI architecture experience with 1+ year architecting or shipping generative AI or agentic systems; strong stakeholder communication; hands-on Azure, OpenAI, and Anthropic experience; Microsoft certification (or willingness to earn).
Azure OpenAI, Azure AI Foundry, AI Studio, AI Search, Document Intelligence, Copilot Studio, Responses API, Agents SDK, function calling, Claude API, Claude Agent SDK, MCP, Semantic Kernel, LangGraph, Microsoft Fabric, Microsoft Power Platform, Promptfoo, Braintrust, DeepEval, LangSmith, OpenAI Evals, Claude Code, Cursor, GitHub Copilot, Codex
FedExNYSE: FDX: Global provider of courier, logistics, and transportation services.
8+ YOE8+ years of experience architecting complex AI and machine learning systems, enterprise AI strategy, reference architectures, data architecture, governance, security, and executive communication.
Generative AI, LLMs, Retrieval-Augmented Generation (RAG), Agentic AI, GCP, Azure, Natural Language Processing (NLP), Model Context Protocol (MCP), AI Agents, DevOps, MLOps
System Architect - AI and Rack-Scale Systems Architect
Oregon or Fremont
$179k-$225k/yrOnsiteFull Time
Hyve SolutionsNYSE: SNX: Designs and manufactures custom hardware for hyperscale data centers.
10+ YOEBachelor's degree in CS/EE, 10+ years system architecture experience focused on AI/HPC, rack-scale design, AI/ML frameworks, GPU/accelerator integration, interconnects, virtualization/containerization, and cloud platforms.
New York City or Nashville or Irving or Chicago or Bridgewater or Atlanta or Dallas
$73k-$174k/yrHybridFull Time
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
5+ YOEExperienced architect with 5+ years shipping enterprise-scale production software, expertise in AI/LLM systems, search, backend and full-stack development; proficiency in Python/Java/Golang/JavaScript and cloud/container technologies.
Dallas or Vermont or Maryland or Rhode Island or Nebraska or Georgia or Florida or Pennsylvania or Virginia or Utah or New Mexico or Louisiana or Michigan or Colorado or Massachusetts or Illinois or Connecticut or Washington or Oklahoma or Indiana or Missouri or Ohio or Tennessee or Oregon or Delaware or Minnesota or Maine or Washington or South Dakota or Mississippi or North Dakota or California or New Hampshire or Iowa or Wyoming or Arkansas or Kentucky or Alabama or New York or Montana or New Jersey or West Virginia or South Carolina or Arizona or Wisconsin or Nevada or Kansas or North Carolina or Hawaii or Alaska or Texas or Idaho
$204k-$280k/yrHybridFull Time
o9 Solutions: Provides an AI-powered platform for integrated enterprise planning and operations.
15+ YOE15+ years engineering experience building production-grade AI/ML systems; expertise with LLMs, embeddings, vector architectures, and constraint-based planning; proven principal/lead architect experience and strong autonomy.
Large language models (LLMs), vector databases, Enterprise Knowledge Graph, constraint-based planning engines
Cvent: Cloud-based software for event and venue management.
10+ YOE10+ years in systems architecture, software engineering, and AI implementation; hands-on AI/ML, Python/JS; strong in distributed systems, APIs, data modeling; experience with integrations and cross-functional teams.
VTG: Provides force modernization and digital transformation for defense agencies.
10+ YOE10+ years building and operationalizing enterprise-scale AI/ML solutions; experience with LLMs, agentic systems, MLOps, evaluation frameworks, and secure AI practices; Bachelor’s degree required.
Community Care Plan: Providing health insurance plans for Florida residents and families.
5+ YOEBachelor's in CS/AI/Data Science, 5+ years AI/ML system development and management, 3+ years AI architecture/model deployment/data engineering, expertise with TensorFlow/PyTorch/scikit-learn and cloud (Microsoft Azure or AWS), ETL and ML lifecycle skills.
TensorFlow, PyTorch, scikit-learn, Microsoft Azure, Microsoft Azure AI Services, Microsoft Azure OpenAI, Microsoft Azure Machine Learning, Amazon Web Services (AWS), AWS SageMaker, Python, R, SQL, REST, GraphQL, CI/CD, MLOps, ETL, vector databases, RAG (Retrieval-Augmented Generation), NLP, computer vision, Microsoft Office Suite
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
10+ YOE10+ years architecting AI-enabled systems; 10+ years data pipelines and platforms; 10+ years secure analytics; DevSecOps; AI/ML production experience; Secret clearance; Bachelor's degree.
Bell Integration: Provides end-to-end IT managed services and digital transformation solutions.
5+ YOERequires 5+ years as a solutions architect and hands-on AI agent, RAG, and LLM inference experience, plus expertise in AI infrastructure, containers, Kubernetes, distributed systems, networking, security, and cloud or on-premises deployments.
10+ YOE10+ years building AI/ML/NLP solutions, 5+ years building applied AI/LLM systems in production; Bachelor's required (Master's preferred); strong Python and software engineering skills; experience with data, retrieval, and production architectures.
Appex Innovation: Provides AI-driven software solutions for healthcare revenue and management.
8+ YOE8+ years in AI/ML, data science, or software engineering; strong Python backend development; hands-on LLM and generative AI, agent-based systems, RAG/vector DBs, API development; AWS, CI/CD, observability, and production ML deployment experience.