FedericoTs/quantprobe

Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any GGUF on your exact hardware, self-calibrates, emits the exact llama.cpp command — or 'quantprobe auto' does it all. Falsification-tested laws; misses published at full size. pip install quantprobe

5 best points · 0 comments · 2 Hacker News posts · 93 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: I run 30B 22tok/s, 109tok/s not novel,6GB/16GB RAM overcoming llama.cpp (5 points, 0 comments, by federicoTXTS, 2026-07-29)
• Show HN: Run GLM-4.5-Air(110B)on a 16GBRAM consumer machine (4 points, 0 comments, by federicoTXTS, 2026-07-23)