1 llm serving engineer job at 1 company in Boston, MA
1mo
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield
$134k-$176k/yr HybridFull Time
2+ YOE2+ years platform/infrastructure/SRE experience; cloud-native experience (AWS, GCP, or Azure); delivered platform features to production; experience with IaC and GitOps (Terraform or Pulumi, ArgoCD); familiarity with Kubernetes and LLM serving frameworks.
AWS, GCP, Azure, Terraform, Pulumi, ArgoCD, Kubernetes, vLLM, Triton, Ray Serve, Degreed