OpenAI
Posted 4mo ago

Software Engineer, Infrastructure - Analytics Platform

OpenAI
San Francisco, California, United States
$230k-$385k/yrHybridFull Time
Responsibilities
  • Own infrastructure
  • Build backends
  • Design distributed systems
Requirements
  • Backend/system software engineer with strong Rust or C++
  • Experience in distributed
  • Performance-sensitive infrastructure
  • On-call, observability, and ops
Technical tools mentioned
RustC++KubernetesClickHouseDistributed SystemsAsync I/O

Job description

About the Team

The Scaling team designs, builds, and operates critical infrastructure that enables research at OpenAI.

Our mission is simple: accelerate the progress of research towards AGI. We do this by building core systems that researchers rely on - ranging from low-level infrastructure components to research-facing custom applications. These systems must scale with the increasing complexity and size of our workloads, while remaining reliable and easy to use.

About the Role

We’re looking for a staff-level software engineer to own production-critical infrastructure end to end.

This role is centered on backend / systems engineering, with emphasis on low-level performance, distributed systems, and hands-on operation of critical services at scale. You’ll take ambiguous problems, turn them into concrete plans, ship pragmatic solutions quickly, and improve them through production feedback and iteration.

This is not a general Python backend role. We’re specifically looking for strong systems experience in Rust or C++, especially in performance-sensitive infrastructure.

This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.

In this role, you will:

  • Own critical infrastructure across design, implementation, rollout, operation, and iteration.

  • Build and operate performant backend systems in Rust or C++ that support core research workflows.

  • Design and improve distributed data and serving systems, including tradeoffs around partitioning, replication, consistency, retries, backpressure, and failure isolation.

  • Debug real production bottlenecks across latency, throughput, contention, hot spots, and overload behavior.

  • Operate business-critical services through on-call, incidents, postmortems, observability, rollout safety, and zero-downtime migrations.

  • Improve reliability of services running on Kubernetes, including resource tuning and failure handling.

  • Partner closely with engineers and researchers to deliver fast, reliable, useful systems.

  • Raise the bar through strong technical judgment, ownership, and follow-through.

You might thrive in this role if you have:

  • A track record of owning operationally critical systems end to end and delivering outcomes in ambiguous environments.

  • Strong hands-on experience building performance-sensitive backend systems in Rust or C++.

  • Comfort working below typical service abstractions, including concurrency, async execution, memory behavior, serialization, I/O, networking, profiling, and failure analysis.

  • Experience designing, building, or operating distributed systems or distributed databases at meaningful scale.

  • Preferably, experience with ClickHouse-like systems or infrastructure for analytics, telemetry, logging, search, ingestion, storage, or query execution.

  • Hands-on experience operating production-critical systems, including incidents, observability, rollout safety, and recurrence prevention.

  • Strong judgment in balancing engineering quality, speed, risk, and business impact.

  • A habit of shipping practical first versions and improving them through production feedback.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. 

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.

Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

About OpenAI

Develops artificial intelligence models and generative AI software services.

Year founded
2015
Employees
4000
Organization type
Private
Latest investment
Raised $110.00B Funding Round (2026) — led by SoftBank, NVIDIA, Amazon
Headquarters
US

Similar jobs

Software Engineer, Infrastructure roles near San Francisco, California
2d
Save
Mark Applied
Hide
Infrastructure Software Engineer (Provisioning) - Apple Services Engineering
Cupertino, California, United States
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Builds systems, infrastructure, and automation that provision hardware and support Apple services, including iTunes, iCloud, Siri, and Maps.
iTunes, iCloud, Siri, Maps
5d
Save
Mark Applied
Hide
Infrastructure Software Engineer, Fleet & Automation
Houston or New York City or San Francisco or Seattle
OnsiteFull Time
Nscale
Nscale: Vertically integrated AI infrastructure provider for high-performance computing.
5+ YOEBachelor's degree or equivalent experience, 5+ years building large-scale infrastructure applications, and expertise in Python, Linux, networking, distributed systems, and infrastructure tooling.
C, C++, Java, Python, Linux, TCP/IP, BGP, Ansible, Terraform, DCIMs, NetBox, OpenStack, MAAS, Ironic, IPMI, NVIDIA GPUs, InfiniBand, NCCL, SLURM, Prometheus, Grafana, OpenTelemetry, Kubernetes, Docker
1w
Save
Mark Applied
Hide
Member of Technical Staff - SWE Infrastructure
Palo Alto, California, United States
OnsiteFull Time
Ricursive Intelligence
Ricursive Intelligence: Automates semiconductor chip design using recursive artificial intelligence.
5+ YOERequires 5+ years of software engineering experience, with expertise in production systems, CI/CD, regression testing, cloud infrastructure, distributed systems, and automated deployment.
CI/CD
2w
Save
Mark Applied
Hide
Senior Infrastructure Software Engineer, TensorRT Edge-LLM
Santa Clara or United States
$184k-$288k/yr HybridFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
7+ YOEBachelor's degree or equivalent, 7+ years of experience, Python and modern C/C++ skills, CI systems, cloud platforms, Git or Perforce, and build systems. Experience with infrastructure, DevOps, and automation preferred.
Python, C, C++, CMake, GitLab, GitHub Actions, Kubernetes, Docker, Jenkins, AWS, GCP, Azure, Git, Perforce, Make, Bazel, TensorRT, TensorRT-LLM, vLLM, SGLang, Ubuntu, JetPack, QNX
2w
Save
Mark Applied
Hide
Senior Infrastructure Software Engineer, TensorRT Edge-LLM
Santa Clara or California
$184k-$288k/yr HybridFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
7+ YOEBachelor's degree or equivalent in computer science or computer engineering, 7+ years of experience, Python and C/C++ skills, CI systems, cloud platforms, SCM, and build systems experience.
Python, C, C++, CMake, GitLab, GitHub Actions, Kubernetes, Docker, Jenkins, GitLab CI, AWS, GCP, Azure, Git, Perforce, Make, Bazel, TensorRT, TensorRT-LLM, vLLM, SGLang, Ubuntu, JetPack, QNX
3w
Save
Mark Applied
Hide
Staff Infrastructure Software Engineer
Sunnyvale, California, United States
$210k-$314k/yr OnsiteFull Time
Carbon
Carbon: Manufacturer of industrial 3D printers and advanced polymer materials.
7+ YOE7+ years building and operating production cloud infrastructure with deep AWS or GCP expertise, Terraform, Kubernetes, Istio, CI/CD (Jenkins/GitHub Actions), Linux, and a scripting language (Python/Go/Bash).
AWS, GCP, Terraform, Kubernetes, Istio, Jenkins, GitHub Actions, Linux, Python, Go, Bash, Envoy, Bazel
4w
Save
Mark Applied
Hide
Infrastructure Software Engineer
Campbell, California, United States
$180k-$230k/yr RemoteFull Time
Camus Energy
Camus Energy: Software platform for managing renewable energy grid integration.
3+ YOE3+ years software engineering with infrastructure focus; Python 3, Kubernetes, GCP, CI/CD, observability (Prometheus,Grafana); familiarity with SQL; collaborative incident response and reliability practices.
Python 3, Kubernetes, GCP, CI/CD pipelines, Prometheus, Grafana, Bazel, Go, Node.js, SQL
2mo
Save
Mark Applied
Hide
Constellation Software Engineer, Infrastructure
Redwood Shores or Palo Alto
OnsiteFull Time
WindBorne Systems
WindBorne Systems: Operates smart weather balloons to provide global atmospheric data.
Experience building/shipping full-stack applications (Ruby on Rails, Postgres), operating 24/7 uptime systems with on-call responsibility, and designing low-latency data pipelines and robust infrastructure for flight operations and data processing.
Ruby on Rails, Postgres