uzunenes/triton-server-hpa

Autoscale NVIDIA Triton on Kubernetes by GPU utilisation — DCGM, Prometheus adapter, HPA, GPU time-slicing. Tested end-to-end.

1 best points · 1 comments · 1 Hacker News post · 16 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: GPU-Based Kubernetes HPA for Triton Inference Server (1 points, 1 comments, by uzunenes, 2025-12-07)