SpreeAI
Posted 6mo ago

Software Engineer Intern (AI Infrastructure / Training / Inference)

SpreeAI
San Francisco, California, United States
OnsiteAll Commitments Available
Responsibilities
  • Design scalable infrastructure
  • Develop high-performance APIs
  • Optimize GPU utilization
Requirements
  • Degree in CS/Engineering
  • Strong OOP skills
  • Data structures/algorithms
  • Production backend or distributed systems
  • Cloud/container concepts
Technical tools mentioned
KubernetesDockerTritonRay ServevLLMPyTorchPythonC++GoJavaCloud

Job description

About the Role

We are hiring Software Engineers focused on AI Infrastructure to build the systems that enable frontier multimodal AI to operate reliably at production scale. This role exists because modern generative and vision models require infrastructure beyond traditional backend engineering — including GPU orchestration, large-scale inference systems, performance optimization, and developer platforms that allow applied scientists to move fast without sacrificing reliability or cost efficiency. 

You will work on:

  • Scalable model serving and inference pipelines
  • Distributed GPU infrastructure
  • Performance and cost optimization
  • Reliability, observability, and production readiness

 You will operate at the boundary between systems engineering and machine learning — building the “paved roads” that allow advanced AI systems to scale safely and efficiently.

What you'll do

  • Design and build scalable infrastructure supporting training and inference workflows.
  • Develop high-performance APIs and backend services for AI model serving.
  • Optimize GPU utilization, latency, and throughput for multimodal workloads.
  • Build distributed systems supporting large-scale generative models.
  • Improve observability, monitoring, and reliability of AI systems.
  • Partner closely with Applied Science teams to productionize research systems.
  • Drive improvements in deployment workflows, automation, and platform usability.


Qualifications

  • Degree in Computer Science, Engineering, or comparable combination of education and practical experience.
  • Strong object-oriented programming skills (Python, C++, Java, Go, or similar).
  • Strong data structures and algorithms foundations.
  • Experience building production backend or distributed systems.
  • Understanding of cloud infrastructure concepts and containerized systems.

 

Preferred Qualifications

  • Experience with Kubernetes, Docker, or container orchestration.
  • Familiarity with GPU-based ML workloads or distributed training/inference systems.
  • Experience with model serving frameworks (vLLM, Triton, Ray Serve, or similar).
  • Experience with observability tools and performance debugging.
  • Familiarity with PyTorch or ML workflows.
  • Interest in optimizing systems for efficiency, scalability, and developer velocity.


Why Join SPREEAI? 

  • Real Impact & Ownership: This is an opportunity to shape a product and brand at the forefront of fashion-tech innovation. Your design work will directly impact how thousands (eventually millions) of people experience shopping with SPREEAI – no bureaucratic layers, your ideas can go live and make a difference immediately. You’ll own projects that truly matter in the company’s growth. 
  • Visionary Team & Exposure: Work side-by-side with a passionate founding team and collaborate with industry visionaries. You’ll have direct access to our CEO and leadership, and even get to interact with world-class advisors (our board includes an iconic fashion figure). It’s a chance to learn from and contribute to the best of both the tech and fashion worlds. 
  • Creative Freedom & Innovation: Join a high-growth startup environment that celebrates bold ideas and moves at lightning speed. You’ll have the autonomy to introduce new design concepts, test emerging technologies, and innovate without red tape. If you’ve ever wanted to combine your love of design, luxury fashion, and cutting-edge tech, you’ll have the freedom to do it here and see your vision realized. 


About SpreeAI

AI-powered virtual try-on and sizing software for fashion retailers.

Year founded
2022
Employees
40
Organization type
Private
Latest investment
Raised $100.00M Series B (2025) — led by Davidson Group
Headquarters
US

Similar jobs

Software Engineer roles near San Francisco, California
3h
Save
Mark Applied
Hide
Software Engineer, Cash Line
United States or Canada or San Carlos or Columbus or Austin or San Francisco or New York City
$142k-$197k/yr RemoteFull Time
Upstart
UpstartNasdaq: UPST: AI-powered lending marketplace for consumer and automotive loans.
4+ YOEBachelor's degree in computer science, engineering, or related field or equivalent experience; 4+ years of software engineering experience; backend services, APIs, distributed systems, and tested maintainable code.
Python, Java, Kotlin, Ruby, Node.js, REST, GraphQL, CI/CD, A/B testing
3h
Save
Mark Applied
Hide
Staff Software Engineer - Customer Identity & Access Management (CIAM)
San Francisco or Denver or New York City
$211k-$254k/yr HybridFull Time
Fastly
FastlyNYSE: FSLY: Provides edge cloud platform for content delivery and cybersecurity.
7+ YOE7+ years of relevant experience designing production authentication and authorization systems; expertise in OIDC, OAuth, SAML, SCIM, JWT, SSO, architecture, distributed systems, scalability, security, and technical leadership.
OpenID Connect (OIDC), OAuth, SAML, SCIM, JWT, SSO, Go, Java, Ruby, Keycloak
3h
Save
Mark Applied
Hide
Software Engineer, Hardware Test & Automation
San Carlos or Seattle
$100k-$200k/yr OnsiteFull Time
Cowboy Space
Cowboy Space: Building satellite-based orbital infrastructure for AI data centers.
3+ YOERequires 3+ years in test infrastructure, embedded software, or hardware/software integration; Python, C/C++, physical hardware testing, lab equipment, embedded interfaces, version control, CI, and automation experience.
Python, C, C++, SPI, I2C, UART, CAN, Ethernet, version control, continuous integration, power supplies, oscilloscopes, logic analyzers
4h
Save
Mark Applied
Hide
Senior Software Engineer, AI/ML GenAI, Google Cloud Compute Infrastructure
Mountain View, California, United States
$174k-$252k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
5+ YOEBachelor's degree or equivalent experience, 5 years programming in Python or C++, 3 years ML infrastructure and software product experience, and experience with software architecture and GenAI techniques.
Python, C++, ML infrastructure, LLMs
4h
Save
Mark Applied
Hide
Remote Software Developer
United States or Canada or United Kingdom or Netherlands or Italy or Germany or Seattle or San Francisco
$200-$300/hr RemoteContract
Turing
Turing: AI-powered platform connecting companies with global remote software developers.
3+ YOERequires 3+ years of software engineering experience, full-stack development and production deployment expertise, software architecture and debugging knowledge, and strong written and oral communication skills.
Python, JavaScript, ReactJS, C, C++, Java, Rust, Go
4h
Save
Mark Applied
Hide
Senior Software Engineer, Runtime
San Mateo, California, United States
$197k-$243k/yr HybridFull Time
Roblox
RobloxNYSE: RBLX: Platform for creating and playing user-generated 3D digital experiences.
Strong modern C++17+ experience in complex production codebases, deep multithreading and concurrency expertise, and ability to profile performance at the operating-system and CPU level.
C++, C++17, MicroProfiler, Android, iOS, Xbox, Oculus Rift
5h
Save
Mark Applied
Hide
Senior Software Engineer, Enterprise Engineering
San Francisco or New York City or Vancouver or Amsterdam or London or Paris or Singapore or Tokyo or Colorado or Washington or California
$183k-$276k/yr HybridFull Time
Amplitude
AmplitudeNASDAQ: AMPL: Digital analytics platform for understanding and optimizing customer behavior.
Strong software engineering experience with production code, backend or infrastructure depth, debugging expertise, production systems knowledge, and clear communication across technical and non-technical stakeholders.
Slack, Unthread, APIs, Modern Health
5h
Save
Mark Applied
Hide
Senior Software Engineer, Enterprise Engineering
San Francisco or Colorado or New York City or California or Washington or Vancouver or Amsterdam or London or Paris or Singapore or Tokyo
$183k-$276k/yr HybridFull Time
Amplitude
AmplitudeNasdaq: AMPL: Develops digital analytics software for tracking customer product behavior.
Strong software engineering experience with production code, backend or infrastructure depth, debugging expertise, production systems experience, and clear communication with technical and non-technical stakeholders.
Slack, APIs