helasaoudi/llm-inspector

The htop for LLM inference see exactly where every GB of VRAM goes and get measured quantization savings.

4 best points · 1 comments · 1 Hacker News post · 76 GitHub stars · View on GitHub

Hacker News discussions

• The Htop for LLM Inference (4 points, 1 comments, by helasaoudi, 2026-07-18)