Surge AI
Posted 1mo ago

Software Engineer, Coding Evaluation & Training Data

Surge AI
United States
RemoteFull Time
Responsibilities
  • owning projects
  • designing workflows
  • evaluating data
Requirements
  • 2+ years software engineering experience
  • Strong coding in a mainstream language
  • Debugging of containerized/test environments
  • Project ownership, and excellent written/verbal communication

Job description

About Us

Our mission is to raise AGI with the richness of human intelligence — curious, witty, imaginative, and full of unexpected brilliance.

Surge was founded by engineers and researchers who dreamed of building the next generation AI. We're building a platform that powers the most powerful models in the world in partnership with companies like, Anthropic, Google, Microsoft, and Meta.

At Surge, we believe the path to AGI isn't just about scaling compute—it's about embracing the unlimited ceiling of human intelligence and creativity in the data that shapes these systems. Our platform combines elite human expertise with cutting-edge tools for scalable oversight, from building rich RL environments to conducting rigorous evaluations that go beyond benchmarks. We've run a profitable business from day one without raising venture funding.

The Role

As a Software Engineer, Coding Evaluation & Training Data at Surge, you'll sit at the intersection of software engineering and product to build and run the systems that teach frontier models how to code.

You’ll own end-to-end coding data projects for top AI labs, designing tasks, RL environments, and evaluation schemes that reflect real-world software engineering. This is an ideal role for a software engineer who wants to keep using their engineering skill set every day, but is most excited by training data quality, agentic evaluation, and system design (humans + models + tools) rather than traditional product feature work.

What You'll Do

  • Own end-to-end coding data projects, from initial scoping and pilot design through execution, iteration, and scale-up.

  • Design agentic training workflows and task structures that mirror real-world SWE work (e.g., refactoring, debugging, code review, large-repo navigation, tool use).

  • Define and iterate on rubrics, golden sets, and reward signals that capture true engineering value, not just “does it compile.”

  • Evaluate data and worker output with strong SWE taste, and make calls about what meets the bar for frontier training.

  • Design and run qualification processes for coding workers, including hands-on assessments of their coding ability.

  • Set up or partner on complex technical environments (e.g., containers, repos, test harnesses, sandboxes, code execution infrastructure).

  • Partner with technical staff at our clients to translate high-level training goals into concrete projects and technical environments.

  • Collaborate closely with Surge engineering, product, and operations to improve our coding data products, internal tools, and execution processes.

What We're Looking For

  • 2–6+ years of professional software engineering experience building and maintaining real systems.

  • Strong coding ability in at least one mainstream language and comfort working in production codebases.

  • High “taste” for good engineering: you care about correctness, code quality, and how real engineering teams actually work.

  • Ability to reason about and debug technical environments, including containers, dependencies, and automated test setups.

  • Interest in owning projects end-to-end, including scoping, workflow design, execution, and continuous improvement.

  • Excellent written and verbal communication skills, with the ability to speak credibly with senior client engineers and translate fuzzy goals into actionable plans.

  • Excitement about AI/ML systems and the role of data, evaluation, and reward design in improving agentic coding capabilities.

About Surge AI

Provides high-quality human feedback and data labeling for AI.

Similar jobs

Software Engineer roles
7mo
Save
Mark Applied
Hide
Software Developer / Software Engineer
United States
RemoteFull Time
Psudo
Psudo: Building software and infrastructure to reinvent the internet experience.
2+ YOE2+ years of experience in software development; proficient in Java, C++, Ruby on Rails; SQL/NoSQL; familiar with SDLC; able to document and collaborate.
Java, C++, Ruby on Rails, SQL, NoSQL, ASP .Net, JQuery, Apache Wicket, JSF, Spring MVC, AWS, Azure, Google Cloud, OpenStack
11y
Save
Mark Applied
Hide
Software Developer/Software Engineer
Reston, Virginia, United States
OnsiteFull Time
Morfologica
Morfologica: Provides specialized natural language processing and computational linguistics engineering services.
Software Engineers/Developers experienced with lifecycle software development; strong programming and automated testing skills; ability to work with government customers.
Java, Ruby, Python, C++, SQL, Oracle, NLP
2h
Save
Mark Applied
Hide
Lead Software Engineer
United States
OnsiteFull Time
Cognizant
CognizantNasdaq: CTSH: Provides global information technology and business process outsourcing services.
Full-stack engineering experience with Java, React or Angular, TypeScript, and Python; distributed systems, APIs, microservices, CI/CD, cloud platforms, GenAI tools, prompt engineering, RAG, and agentic workflows.
Devin, Claude Code, Cursor, Java, React, Angular, TypeScript, Python, CI/CD, OpenShift Container Platform (OCP), Google Cloud Platform (GCP), Anthropic, GitHub Copilot, RAG, Model Context Protocol (MCP)
4h
Save
Mark Applied
Hide
Software Engineer, Service Networking Engineering Productivity
Cambridge, Massachusetts, United States
$123k-$174k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
1+ YOEBachelor's degree or equivalent experience, 1+ year software development and algorithms experience, and 1+ year building developer tools. Preferred: advanced degree and backend or ML coding experience.
Python, C, C++, Java, JavaScript, Go, Rust, Electronic Medical Records (EMR)
4h
Save
Mark Applied
Hide
Sr. / Staff Software Engineer, Infrastructure (Autonomy)
San Jose or Mountain View
$170k-$339k/yr OnsiteFull Time
DiDi Autonomous Driving
DiDi Autonomous Driving: Develops Level 4 autonomous driving technology for shared mobility.
6+ YOEBachelor’s degree or higher in a technical field; 6–10+ years developing complex real-time or Linux infrastructure systems in C++; expertise in concurrency, IPC, compilers, build systems, debugging, and architecture.
C++, Linux, ccatch, ezsim, Clang, GCC, LLVM, Bazel, CMake, QNX, Linux RT, NVIDIA Orin, eBPF, gperf
5h
Save
Mark Applied
Hide
Senior Software Engineer (Semiconductor Process and Device Simulation)
San Francisco or Santa Clara or Hsinchu or Sapporo or Tokyo or Seoul
$90k-$162k/yr HybridFull Time
Siemens
SiemensXETRA: SIE: Manufactures industrial automation, infrastructure, and energy technology systems.
5+ YOEPhD or MS with 5+ years of research or industry experience in computer science, applied mathematics, or engineering; expertise in scientific computing, high-performance computing, and C/C++, CUDA, and Python.
C, C++, CUDA, Python, Code Copilot, AI/ML, Message Passing Interface (MPI)
5h
Save
Mark Applied
Hide
Senior Software Engineer
Bethesda, Maryland, United States
OnsiteFull Time
Base-2 Solutions
Base-2 Solutions: Delivers engineering and technology services for national security.
8+ YOERequires C# and API development, SQL Server, ETL, microservices, logging systems, and 8+ years with a bachelor's or 6+ years with a master's. Active Top Secret/SCI clearance required.
C#, SQL Server, Docker, AWS, AWS Lambda, CUDA, PyTorch, GraphQL, Python, Bash, Apache NiFi, Kafka, GitLab, Jenkins, Elasticsearch, Linux
8h
Save
Mark Applied
Hide
Staff Software Engineer, Voice AI Platform
United States or Boston or New York City
$125k-$254k/yr HybridFull Time
Toast
ToastNYSE: TOST: Cloud-based technology platform for the restaurant and hospitality industry.
8+ YOE8+ years with Java or Kotlin, a relevant bachelor's degree, AI-integrated product development, distributed systems, scalable production services, and leadership of complex cross-team projects.
Java, Kotlin, Dropwizard, AWS, Amazon DynamoDB, Amazon RDS, AWS Lambda, PostgreSQL, React, ES6, Claude Code, Cursor, LLMs