NVIDIA
Posted 1mo ago

Software Engineer, OpenShell

NVIDIA
United States
$184k-$288k/yrRemoteFull Time
Responsibilities
  • tracking research
  • building prototypes
  • benchmarking methods
Requirements
  • 8+ years in research engineering or software development
  • MS/PhD or equivalent
  • Proven ability to convert research into production systems
  • Deep experience with LLMs/agent systems and evaluation
  • Strong experimental and product sense
Technical tools mentioned
TritonTensorRT-LLMvLLMSGLangRayKubernetes

Job description

Are you ready to translate groundbreaking AI research into secure, production-grade systems? Want to shape the next generation of AI agent infrastructure? Join us!

At NVIDIA OpenShell, we are building the runtime infrastructure for secure, scalable, production-grade AI agents. As an OpenShell Research Engineer, we will look to you to help bring the latest advances in agentic systems into the runtime, tools, and workflows that enterprise builders rely on.

This role sits at the intersection of research, product, and engineering. We expect you to identify promising methods from academia, industry, open source, and internal NVIDIA research, understand where they matter for OpenShell, validate their impact through hands-on prototypes, benchmarks, and real agent workflows, and help us integrate the best ideas into the product.

What You’ll be Doing:

  • Track the cutting edge: How are agentic systems evolving? You'll follow research in tool use, planning, memory, evaluation, self-improvement, multi-agent workflows, runtime infrastructure, and agent safety/security.

  • Bridge research and product: Identify research ideas that can meaningfully improve OpenShell and translate them into concrete product opportunities.

  • Benchmark and adapt: Reproduce and test promising methods from papers, open-source projects, industry work, and internal NVIDIA research.

  • Build rapid prototypes: Create hands-on proof-of-concepts using OpenShell, including agent harnesses, evaluation loops, self-improving workflows, and runtime-native developer experiences.

  • Red-team systems: Design evaluation and red-team harnesses that measure agent reliability, usefulness, scalability, safety, security, and developer experience.

  • Secure the workflow: Help us design secure-by-default workflows for agents operating with tools, code, files, credentials, and enterprise systems.

  • Partner across teams: Collaborate closely with engineering, product, design, research, solutions, and developer-facing teams to move ideas from prototype to product.

What you’ll need:

  • 8+ years of professional practical experience in research engineering, software development, or a related technical field

  • MS/PhD in Computer Science, Physics, or a related field or equivalent experience

  • A strong background in turning complex research into reusable products, tools, demos, benchmarks, or production systems at scale.

  • Deep experience in several of the following: LLMs, agent harnesses, multimodal generative models, evaluation frameworks, synthetic data generation, post-training, inference infrastructure/optimization, adversarial ML, or agent safety/security.

  • Demonstrated ability to drive independent technical investigation: survey relevant work, run experiments, form a clear point of view, and communicate findings clearly.

  • Strong product sense and care for UX and AX: tools should be intuitive for developers and ergonomic for agents.

  • A focus on real-world impact: we want research to become enterprise capabilities, reference implementations, developer workflows, or product improvements.

  • Outstanding team orientation and comfort collaborating across research, engineering, product, design, solutions, and developer-facing teams.

Ways to stand out from the crowd:

  • Experience with secure agent runtimes, tool sandboxing, capability-based security, or enterprise policy systems.

  • Experience with compliance or enterprise governance requirements such as auditability, data retention, access control, SOC2, HIPAA, GDPR, or regulated deployment environments.

  • Experience with LLM inference infrastructure, model serving, or inference optimization using tools such as Triton, TensorRT-LLM, vLLM, SGLang, Ray, Kubernetes, or cloud GPU platforms.

  • Experience integrating inference backends into agentic systems, including routing across models, tool-aware context management, streaming, structured outputs, retries, monitoring, and cost/performance optimization.

  • Experience developing or maintaining open-source software in AI agents, LLM systems, developer tooling, ML infrastructure, model serving, or related areas.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. If you're creative, passionate and self-motivated, we want to hear from you! NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until July 17, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

About NVIDIA

Designs GPU-accelerated computing and artificial intelligence hardware.

Similar jobs

Software Engineer roles
7mo
Save
Mark Applied
Hide
Software Developer / Software Engineer
United States
RemoteFull Time
Psudo
Psudo: Building software and infrastructure to reinvent the internet experience.
2+ YOE2+ years of experience in software development; proficient in Java, C++, Ruby on Rails; SQL/NoSQL; familiar with SDLC; able to document and collaborate.
Java, C++, Ruby on Rails, SQL, NoSQL, ASP .Net, JQuery, Apache Wicket, JSF, Spring MVC, AWS, Azure, Google Cloud, OpenStack
11y
Save
Mark Applied
Hide
Software Developer/Software Engineer
Reston, Virginia, United States
OnsiteFull Time
Morfologica
Morfologica: Provides specialized natural language processing and computational linguistics engineering services.
Software Engineers/Developers experienced with lifecycle software development; strong programming and automated testing skills; ability to work with government customers.
Java, Ruby, Python, C++, SQL, Oracle, NLP
2h
Save
Mark Applied
Hide
Staff Software Engineer, Voice AI Platform
United States or Boston or New York City
$125k-$254k/yr HybridFull Time
Toast
ToastNYSE: TOST: Cloud-based technology platform for the restaurant and hospitality industry.
8+ YOE8+ years with Java or Kotlin, a relevant bachelor's degree, AI-integrated product development, distributed systems, scalable production services, and leadership of complex cross-team projects.
Java, Kotlin, Dropwizard, AWS, Amazon DynamoDB, Amazon RDS, AWS Lambda, PostgreSQL, React, ES6, Claude Code, Cursor, LLMs
3h
Save
Mark Applied
Hide
Senior Software Engineering, Microsoft Digital
Redmond, Washington, United States
$120k-$235k/yr HybridFull Time
Microsoft
MicrosoftNASDAQ: MSFT: Develops software, services, devices, and cloud computing solutions.
4+ YOEBachelor’s degree or equivalent experience, 4+ years of technical engineering experience, coding skills, and 5+ years designing and developing ServiceNow solutions preferred.
ServiceNow, Microsoft 365 Copilot, Microsoft Teams, Microsoft Power Platform, Microsoft Azure, Flow Designer, Integration Hub, REST APIs, C, C++, C#, Java, JavaScript, Python
4h
Save
Mark Applied
Hide
Senior Software Engineer (Semiconductor Process and Device Simulation)
San Francisco or Hsinchu or Hokkaido or Tokyo or Seoul
$90k-$162k/yr HybridFull Time
Siemens Healthineers
Siemens HealthineersXetra: SHL: Global provider of medical technology and diagnostic imaging solutions.
5+ YOEPhD, or MS with 5+ years of research or industry experience, in computer science, applied mathematics, or engineering. Requires scientific computing, HPC, C/C++, CUDA, Python, and collaborative problem-solving expertise.
C, C++, CUDA, Python, Code Copilot, Message Passing Interface (MPI), AI, ML, Calibre, EDA, CAD, FEM, FD, FVM, BEM, Monte Carlo
4h
Save
Mark Applied
Hide
Associate, Software Engineer (Herndon, VA) (42823)
Herndon, Virginia, United States
$85k-$101k/yr OnsiteFull Time
L3Harris Technologies
L3Harris TechnologiesNYSE: LHX: Aerospace and defense providing mission-critical technology solutions.
Pursuing or recently completed a bachelor's degree in computer science, electrical engineering, or a related field; software development experience preferred; security clearance required or obtainable.
Linux, Windows, C, C++, VC++, Java, Docker, Kubernetes, CUDA
6h
Save
Mark Applied
Hide
Lead Sr. Software Engineer
Bethesda, Maryland, United States
$190k-$210k/yr HybridFull Time
Ideal Innovations
Ideal Innovations: Provide biometric and forensic solutions for government agencies.
Requires C# development, technical leadership, WPF, .NET website development, REST APIs, relational databases, communication skills, U.S. citizenship, and current Top Secret/SCI Poly clearance.
C#, .NET, WPF, REST API, Microsoft SQL Server, RabbitMQ, Git, DevSecOps
6h
Save
Mark Applied
Hide
Staff Software Engineer - Video Performance - (Bay area only)
San Francisco, California, United States
$251k-$329k/yr OnsiteFull Time
Canva
Canva: Cloud-based visual communication and graphic design software platform.
Strong C++ proficiency; systems performance optimization, CPU/GPU architecture, SIMD, graphics APIs, multimedia codecs, profiling, diagnostics, telemetry, and cross-team technical collaboration experience.
C++, Rust, GLSL, HLSL, Metal, Vulkan, WebGPU, OpenGL, Perf, Instruments, Chrome DevTools, Systrace, CMake, Web, iOS, Android, H.264, H.265, VP9, AV1, SIMD