1 inference optimization engineer job at 1 company in Charlotte, NC
2mo
Save
Mark Applied
Hide
Data Science Consultant 2
Charlotte, North Carolina, United States
OnsiteFull Time
Experience building and optimizing LLM inference stacks (vLLM, TensorRT-LLM, Triton), Kubernetes-based serving (KServe, GKE), GPU orchestration, quantization techniques, performance tuning, GCP/Azure, Terraform, observability (Prometheus/Grafana). Bachelor's degree required or equivalent experience; US work authorization required.
vLLM, TensorRT-LLM, Triton, Triton Inference Server, SGLang, SAS, R, Python, Kubernetes, GKE, KServe, Helm, Operators, Terraform, HashiCorp Vault, Prometheus, Grafana, BigQuery, Hadoop, SageMaker, Snowflake, OpenShift (OCP)