DDN
Posted 1mo ago

Senior Software Engineering Manager – KV Cache Platform

DDN
Santa Clara, California, United States
HybridFull Time
Responsibilities
  • leading teams
  • defining strategy
  • delivering infrastructure
Requirements
  • 15+ years building distributed systems or infrastructure,7+ years managing distributed engineering teams,expertise in distributed systems, Linux
  • Networking
  • Performance
  • Hands-on Go and Python
  • Experience with AI infrastructure and customer-facing deployments
Technical tools mentioned
GoPythonC/C++LinuxKubernetesRDMAGPUDirect StorageBlueField DPUsTensorRT-LLMTritonNVIDIA Dynamo

Job description

DDN is seeking a Senior Software Engineering Manager to lead the engineering organization responsible for our KV Cache Platform—a distributed memory and storage platform that accelerates large-scale LLM inference across GPU clusters.

In this role, you will lead geographically distributed engineering teams responsible for building highly scalable, low-latency distributed systems that power AI inference. You will define the technical vision and execution strategy for the platform while partnering closely with Product Management, Sales, Customer Engineering, NVIDIA, and executive leadership to deliver innovative AI infrastructure that meets customer needs and supports DDN's long-term product strategy.

 

This is a highly visible leadership role with responsibility for engineering execution, customer success, roadmap delivery, and building a world-class engineering organization.

 

Responsibilities

  • Lead, mentor, and grow a geographically distributed team of software engineers and technical leaders, fostering a culture of technical excellence, innovation, ownership, and collaboration.

  • Define and execute the technical strategy and roadmap for the KV Cache Platform, ensuring scalability, reliability, security, and operational excellence.

  • Drive the architecture, development, and delivery of distributed systems supporting AI inference, GPU memory optimization, distributed caching, RDMA networking, GPUDirect Storage, NVIDIA BlueField DPUs, and emerging AI infrastructure technologies.

  • Partner closely with Product Management, Sales, Customer Engineering, NVIDIA, and strategic technology partners to prioritize customer requirements, drive proof-of-concepts (POCs), influence product direction, and successfully deliver customer deployments.

  • Own day-to-day engineering execution, including feature development, release planning, bug triage, production issues, customer escalations, and cross-functional execution to ensure timely, high-quality software delivery.

  • Establish engineering best practices for software quality, observability, automation, performance, testing, and production readiness.

  • Collaborate across engineering, infrastructure, and hardware teams to deliver scalable, production-ready AI infrastructure while developing future engineering leaders and driving continuous improvement.

Qualifications

Required

  • 15+ years of experience building distributed systems, cloud infrastructure, storage platforms, or AI infrastructure software.

  • 7+ years leading high-performing software engineering organizations, including geographically distributed teams.

  • Proven experience delivering large-scale distributed infrastructure products from architecture through production deployment.

  • Strong background in distributed systems, Linux, networking, performance engineering, and cloud-native architectures.

  • Hands-on programming experience with Go and Python; experience with C/C++ is a plus.

  • Demonstrated ability to lead cross-functional initiatives and influence technical direction across multiple organizations.

  • Experience building AI infrastructure, LLM serving platforms, distributed caching systems, or high-performance storage solutions.

  • Experience with technologies such as NVIDIA Dynamo, TensorRT-LLM, Triton, RDMA, GPUDirect Storage, BlueField DPUs, Kubernetes, or related AI infrastructure.

  • Background in HPC, distributed storage, networking, or enterprise infrastructure software.

  • Experience working directly with strategic customers, technology partners, OEMs, or hyperscalers to deliver enterprise AI solutions.

About DDN

Private American data storage and AI infrastructure serving enterprises, cloud providers, governments, and research institutions.

Similar jobs

Software Engineering Manager roles near Santa Clara, California
8h
Save
Mark Applied
Hide
Senior Software Engineering Manager, AI/ML
Sunnyvale or Kirkland
$262k-$364k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOG, GOOGL: Global technology specializing in internet-related services and products.
8+ YOE5+ MgmtBachelor’s degree or equivalent experience, 8 years software development, 5 years technical leadership, people management, and generative AI agents experience; deep AI expertise required.
Google Cloud
2d
Save
Mark Applied
Hide
Software Engineering Manager Payments
New York City or San Francisco or Denver or Seattle or San Jose or Scottsdale
$222k-$245k/yr HybridFull Time
Gusto
Gusto: Gusto is a payroll, benefits, and human-resources software platform serving small and medium-sized businesses.
8+ YOE3+ MgmtRequires 8+ years programming experience, 3+ years engineering management, payments platform experience, hands-on coding, talent management, cross-functional delivery, and a bachelor's degree in computer science, computer engineering, or related field.
AI
3d
Save
Mark Applied
Hide
Senior Manager, Software Engineering - Agentic IT Operations
Santa Clara, California, United States
$248k-$391k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Computing platform for AI and accelerated graphics.
10+ YOE5+ MgmtBachelor's or master's degree or equivalent; 10+ years software engineering experience; 5+ years leading teams; expertise in infrastructure, SRE, DevOps, or production engineering; proficiency in Python or Go.
LLM-based agents, RAG, ServiceNow, ERP, Kubernetes, AWS, GCP, Azure, Prometheus, Grafana, Datadog, PagerDuty, Python, Go
3d
Save
Mark Applied
Hide
Senior Manager, Software Engineering - Agentic IT Operations
Santa Clara, California, United States
$248k-$391k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Computing platform for AI and accelerated graphics.
10+ YOE5+ MgmtBachelor's or master's degree or equivalent experience; 10+ years software engineering, 5+ years engineering team leadership, production systems expertise, AI, infrastructure, cloud, automation, and programming experience.
LLM-based agents, RAG, ServiceNow, ERP, Kubernetes, AWS, GCP, Azure, Prometheus, Grafana, Datadog, PagerDuty, Python, Go, CI/CD
3d
Save
Mark Applied
Hide
Senior Manager, Software Engineering - Agentic IT Operations
Santa Clara, California, United States
$248k-$391k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Computing platform for AI and accelerated graphics.
10+ YOE5+ MgmtBachelor's or master's degree or equivalent; 10+ years software engineering experience; 5+ years leading teams; expertise in infrastructure, SRE, DevOps, or production engineering; production AI, cloud, Kubernetes, and coding experience.
LLM, RAG, ServiceNow, ERP, Kubernetes, AWS, GCP, Azure, Prometheus, Grafana, Datadog, PagerDuty, Python, Go
3d
Save
Mark Applied
Hide
Manager 3, Software Engineering - Enterprise Accountant Suite
Mountain View, California, United States
$244k-$330k/yr OnsiteFull Time
Intuit
IntuitNASDAQ: INTU: A global financial technology platform powering prosperity.
8+ YOERequires 8+ years leading software engineering teams, 12–14 years hands-on development, frontend and backend experience, Agile and SaaS experience, real-time multitenant platforms, and a bachelor's degree or equivalent.
Agile, SaaS, AI, GenAI
3d
Save
Mark Applied
Hide
Software Engineering Mgr - L5
Grand Prairie or Littleton or Orlando or Bethesda or Sunnyvale or Palo Alto or New York City or New Jersey or Denver or King of Prussia or Stratford or Moorestown or Marietta or Camden or Lexington or Ocala or Lufkin or Washington
$148k-$276k/yr RemoteFull Time
Lockheed Martin
Lockheed MartinNYSE: LMT: Global security and aerospace driving innovative defense solutions.
5+ YOE5+ MgmtRequires ERP delivery experience in production or manufacturing, knowledge of ERP platforms, APIs, middleware, data modeling, communication, stakeholder management, problem-solving, and leadership.
SAP, Twenty5, Agile, Scrum, SAFe, DevOps, CI/CD, IaC, Java, C#, Python, ABAP, Fiori, SQL, HANA
4d
Save
Mark Applied
Hide
Manager, Software Engineer, Agents
San Francisco or Denver or Dallas or Boston or Atlanta or United States
RemoteFull Time
Airlock Digital
Airlock Digital: Australian cybersecurity software providing application-control and allowlisting tools to enterprises and government organizations worldwide.
8+ YOE3+ MgmtRequires 8–12+ years of software engineering experience, native Windows development in C/C++, Windows systems programming, and 3+ years managing engineers. Bachelor's degree preferred, not required.
C, C++, SQLite, SQLCipher, OpenSSL, libcurl, Win32, MSI, WinDbg, Event Tracing for Windows, Process Monitor, PowerShell, Windows Driver Kit, Filter Manager, x86, x64, ARM64, macOS, Linux