HackerGit Trending Discord Star

logxio/picchio

Catch local LLMs spilling into the CPU. One run shows GPU placement, prefill, decode, memory, power and a verdict.

19 best points · 2 comments · 3 Hacker News posts · 18 GitHub stars · View on GitHub

Hacker News discussions