infiniteregrets/kv-psi

Use Linux Pressure Stall Information to trim an LLM KV cache

8 best points · 0 comments · 1 Hacker News post · 5 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: KV-psi, using Linux PSI to to trim an LLM KV cache (8 points, 0 comments, by infiniteregrets, 2026-06-27)