Save Job
Posted 2mo ago

Staff Software Engineer - Serverless

@ Runware
United Kingdom
RemoteFull Time
Responsibilities:build platform, lead design, mentor engineers
Requirements Summary:Staff/Senior backend engineer with experience building distributed systems and backend services; strong ownership and clear communication; proficient in Python or Go; ability to lead technical direction.
Technical Tools Mentioned:Python, Go, Kubernetes, Nomad, Knative, TensorRT, Triton, vLLM, SDK
Save
Mark Applied
Hide Job
Report & Hide
Job Description

We’re looking for a Staff/Senior Software Engineer to technically lead and build Runware’s serverless platform. You’ll be part of a small team working closely with senior leadership to bring a new product line to market.

Runware is evolving beyond model APIs into a platform where developers can deploy models and run AI workloads without managing GPUs, servers or infrastructure. You’ll build the software layer that connects our proprietary high-performance sonic inference engine and turns complex infrastructure into a compelling developer experience.

This is a role for someone who enjoys technical leadership, hard platform problems and clean, simple systems. Your work will help enterprises, model labs and developers move from idea to production faster, then scale without needing to build and operate the infrastructure themselves.

What you’ll do

  • Build the core systems behind Runware’s serverless platform, including workload execution, routing, scheduling, isolation and scaling leveraging our inference engine
  • Make it simple for developers to deploy models and run AI workloads without managing GPUs, servers, queues or infrastructure through a simple SDK interface
  • Design and improve the control plane for serverless execution, including APIs, workers, lifecycle management, retries and failure handling
  • Work closely with our infrastructure and ML teams to improve workload startup time, GPU utilisation, model warm-up, caching and placement
  • Build observability that makes serverless workloads easy to monitor, debug and operate at scale globally
  • Lead the technical design, mentor other engineers and help define the engineering standards for a new product area