2 llm serving engineer jobs at 2 companies in Colorado
1w
Save
Mark Applied
Hide
1w
Senior Engineer, Inference Data Plane
Denver or Seattle
$139k-$174k/yrRemoteFull Time
DigitalOceanNew York Stock Exchange: DOCN: Simplifies cloud infrastructure for developers, startups, and SMBs.
Design and deliver high-scale, resilient data-plane services for inference; experience with LLM serving, distributed systems, and AI hardware; expert in Go or Python and gRPC; familiarity with inference frameworks and observability.
Tallgrass: Provides midstream energy infrastructure and delivery services.
4+ YOEDesign and implement RAG, multi-agent systems, LLM fine-tuning, model serving, integrations, CI/CD, and AI security; 4+ years IT/AI development experience; Python, SQL, MS Office proficiency; valid driver's license.
Python, MS SQL, Oracle, Microsoft Excel, Microsoft Word, Microsoft Access, Microsoft PowerPoint, Microsoft Outlook, Microsoft .NET, Docker, Kubernetes, MLflow