158 ai system architect jobs at 72 companies in San Jose, CA
2d
Save
Mark Applied
Hide
AI Accelerator System Architect
San Jose, California, United States
$250k-$350k/yr OnsiteFull Time
12+ YOEBachelor's or master's degree or equivalent experience; 12+ years architecting hardware systems for hyperscale, HPC, or AI/ML infrastructure; expertise in interconnect, power, thermal, or mechanical systems.
RDU, SambaFlow, GPU, TPU, ASIC, NIC, HSA, FSA, Headspace, Gympass+, One Medical
2mo
Save
Mark Applied
Hide
System Performance & AI Architect
Los Altos, California, United States
OnsiteFull Time
10+ YOEPhD in EE/CS or related, 10+ years in performance modeling and system architecture for AI/hyperscale or semiconductor organizations; expertise in ISAs, cache coherence, memory systems, interconnects; proficiency in Modern C++ and Python; experience with NSight, ROCm, VTune.
Modern C++, Python, NSight, ROCm, VTune, HBM4, CXL, Network-on-Chip (NoC), GPUs, NPUs, SoCs, Instruction Set Architectures (ISA)
2w
Save
Mark Applied
Hide
Senior Principal AI System Architect
Milpitas, California, United States
$194k-$322k/yr HybridFull Time
10+ YOEMaster's or Ph.D. in EE/CE/CS,10+ years in system/SoC architecture and memory system development, strong C/C++ and Python skills, RTL and system-level modeling experience, knowledge of memory technologies and interconnects.
C/C++, Python, RTL, SoC, GPU, DRAM, DDR, LPDDR, GDDR, NAND, PCIe, CXL, NoCs, ethernet, RDMA
2mo
Save
Mark Applied
Hide
System Architect - AI and Rack-Scale Systems Architect
Oregon or Fremont
$179k-$225k/yr OnsiteFull Time
10+ YOEBachelor's degree in CS/EE, 10+ years system architecture experience focused on AI/HPC, rack-scale design, AI/ML frameworks, GPU/accelerator integration, interconnects, virtualization/containerization, and cloud platforms.
GPU, TPU, FPGA, TensorFlow, PyTorch, NVIDIA CUDA, InfiniBand, Ethernet, NVLink, VMware, Kubernetes, Docker, AWS, Azure, GCP
1d
Save
Mark Applied
Hide
AI Instinct System Management Architect
Santa Clara, California, United States
$237k-$356k/yr HybridFull Time
Expert systems or platform software architecture background, deep BMC firmware and manageability expertise, DMTF standards knowledge, interconnect and scheduler experience, and technical customer leadership.
Redfish, DMTF, BMC, BSP, MCTP, PLDM, SPDM, PCIe, CXL, NVMe, Kubernetes, Slurm, GPU, Prometheus, Loki, ELK, OpenTelemetry, PDU, C, C++, Python, Go, Linux
2mo
Save
Mark Applied
Hide
AI Solutions Architect
Pleasanton, California, United States
$170k-$230k/yr HybridFull Time
8+ YOE8+ years data/systems engineering (3-5 years with ML/AI), bachelor\u0002s in related field, hands-on experience building and deploying production AI systems, proficiency with Glean, Claude, Co-pilot Enterprise, strong NLP and system design skills, executive communication.
Glean, Claude, Co-pilot Enterprise
3mo
Save
Mark Applied
Hide
AI Security Architect
San Jose, California, United States
$165k-$306k/yr OnsiteFull Time
8+ YOE8+ years in cybersecurity architecture or engineering; experience securing AI/ML systems; Bachelor’s or Master’s in CS/Cybersecurity or related field.
MLflow, Kubeflow, SageMaker, SIEM, XDR, Cloud security tools
2w
Save
Mark Applied
Hide
Applied AI Solutions Architect
San Francisco or United States
HybridFull Time
Customer-facing technical architect with enterprise software experience, knowledge of APIs, cloud architecture, integrations, identity management, data engineering, AI workflows, and strong communication skills. Python and healthcare systems experience preferred.
Python, APIs, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG)
2mo
Save
Mark Applied
Hide
AI Solutions Architect
Pleasanton, California, United States
$170k-$230k/yr HybridFull Time
8+ YOE8+ years data/systems engineering experience (3–5 years with ML preferred), bachelor’s in CS/Math, proficiency with Glean, Claude, Microsoft Copilot Enterprise, strong system design, NLP and production AI deployment experience, executive communication skills.
Glean, Claude, Microsoft Copilot Enterprise
1mo
Save
Mark Applied
Hide
Brand AI Architect
Menlo Park, California, United States
$148k-$194k/yr OnsiteFull Time
8+ YOE8+ years combined experience; 3–5 years hands-on AI with LLM APIs (OpenAI, Anthropic, Google); production tooling, prompt engineering, automation pipelines, design and systems thinking; strong communication.
OpenAI, Anthropic, Google, Streamlit, Snowflake
1mo
Save
Mark Applied
Hide
AI Library Architect
Los Altos or Seattle or United States or Canada or United Kingdom or Europe
$198k-$319k/yr HybridFull Time
Significant experience designing developer-facing APIs and SDKs; deep understanding of modern AI frameworks (PyTorch, JAX, TensorFlow, vLLM, XLA/MLIR); experience with inference and training systems; fluency in C++, Rust, Go and Python; strong spec-writing and API ergonomics.
MAX Framework, PyTorch, JAX, TensorFlow, vLLM, XLA, MLIR, C++, Rust, Go, Python, Mojo
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (West)
Denver or East Bay or Los Angeles or Orange County or Phoenix or Portland or Salt Lake City or San Diego or San Francisco or Seattle or Silicon Valley
$108k-$237k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years on generative/agentic AI, multi-agent system design, RAG architectures, cloud AI platform deployment, Python proficiency, and strong communication skills.
Python, FastAPI, Flask, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, LangSmith, Model Context Protocol (MCP), AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Claude Code, Cursor, Kiro, RAGAS, DeepEval
2mo
Save
Mark Applied
Hide
Staff AI/ML Architect, Embodied AI
Sunnyvale, California, United States
$230k-$330k/yr OnsiteFull Time
10+ YOEMS or PhD plus 10+ years building AI/ML models and end-to-end system architectures for autonomous or embodied systems; expertise in hierarchical perception/reasoning/control, real-time safety-critical ML, and hands-on experience with modern deep learning frameworks and C++/Python.
PyTorch, TensorFlow, JAX, Python, C++, JEPA, MAE, DINO, NVIDIA Isaac Sim, Triton, CUDA, LLM
1mo
Save
Mark Applied
Hide
Camera System Architect - PICO Lab VST - San Jose
San Jose, California, United States
OnsiteFull Time
3+ YOEMaster's degree in a relevant field, 3+ years camera or imaging system development experience spanning hardware and software, product development through production, and experience with AI-assisted engineering tools.
LLMs, VLMs, SoC, ISP, NPU
3w
Save
Mark Applied
Hide
Director, Transformation AI Architect
Redmond or Mountain View
$131k-$277k/yr HybridFull Time
6+ YOEMaster's+6 years or Bachelor's+8 years in engineering/business or equivalent; proven enterprise transformation and AI implementation experience; systems thinking, change architecture, governance, and executive presence.
4d
Save
Mark Applied
Hide
Distinguished Technologist, Edge AI Architect
Palo Alto, California, United States
$174k-$278k/yr OnsiteFull Time
12+ YOE12+ years in software design, development, architecture, programming, or related work; degree or equivalent experience; expertise across AI stack architecture, edge AI, distributed systems, security, cloud, and model lifecycle.
Large Language Models (LLM), vLM, CUDA, Kubernetes, Docker, Python, C++, Rust, MLOps, LLMOps, CI/CD, AWS, Microsoft Azure, APIs
3mo
Save
Mark Applied
Hide
Senior System Software Architect, Enterprise Reference Architectures
Santa Clara or Westford or Austin or Boulder
$208k-$328k/yr OnsiteFull Time
12+ YOE12+ years software/infrastructure architecture; 3+ years microservices; experience in AI, HPC, or cloud-native infra; GPU-accelerated systems; on-prem and cloud deployments.
Kubernetes, Docker, Kafka, RabbitMQ, NVLink, PCIe, InfiniBand, Ethernet, RoCE, Python, C++, CUDA
1mo
Save
Mark Applied
Hide
AI Solutions Architect - West Region
Phoenix or San Diego or San Francisco or Los Angeles or Denver or Portland or Seattle
$185k-$235k/yr OnsiteFull Time
10+ YOEMinimum 10 years in technical pre-sales or solutions architecture; hands-on AI/ML infrastructure design experience; ability to whiteboard end-to-end AI architectures; bachelor’s degree required; experience with NVIDIA systems and public cloud platforms.
NVIDIA DGX/HGX, CUDA, AI Enterprise, NeMo, Omniverse, NVAIE, AWS, Azure, GCP, Dell, HPE, Cisco, NetApp, Pure Storage, Vast Data
2w
Save
Mark Applied
Hide
Sr. AI Systems & Solutions Architect
Boston or Denver or San Francisco
$112k-$168k/yr OnsiteFull Time
4+ YOERequires a technical foundation, AI prototype development, LLMs, APIs, system integrations, prompt engineering, documentation, communication, and 4+ years in AI solutions, architecture, tooling, automation, or similar roles.
Claude, ChatGPT, Glean, LLMs, APIs, MCPs
4d
Save
Mark Applied
Hide
Distinguished Technologist, Edge AI Architect
Palo Alto or Spring
$174k-$278k/yr OnsiteFull Time
12+ YOEComputer science or related degree or equivalent experience; typically 12+ years in software design, development, architecture, or programming. Requires full-stack AI architecture, distributed systems, security, cloud, and edge expertise.
Python, C++, Rust, Java, AWS, Microsoft Azure, Kubernetes, Docker, CNCF, CUDA, CI/CD, MLOps, LLMOps, DevOps, APIs
Explore Jobs
Expand Your Job Search
Top Cities Near San Jose for AI System Architect
- AI System Architect jobs in San Francisco, CA
- AI System Architect jobs in Oakland, CA
- AI System Architect jobs in Fremont, CA
- AI System Architect jobs in Hayward, CA
- AI System Architect jobs in Salinas, CA
- AI System Architect jobs in Sunnyvale, CA
- AI System Architect jobs in Concord, CA
- AI System Architect jobs in Santa Clara, CA
- AI System Architect jobs in Berkeley, CA
- AI System Architect jobs in Antioch, CA
- AI System Architect jobs in Richmond, CA
- AI System Architect jobs in Daly City, CA
- AI System Architect jobs in San Mateo, CA
- AI System Architect jobs in San Leandro, CA
- AI System Architect jobs in Livermore, CA
- AI System Architect jobs in Tracy, CA
- AI System Architect jobs in Redwood City, CA
- AI System Architect jobs in Mountain View, CA
- AI System Architect jobs in Pleasanton, CA
- AI System Architect jobs in Alameda, CA