KaiFelixBennett/gemma4-turboquant-rdna4

Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.

2 best points · 0 comments · 1 Hacker News post · 13 GitHub stars · View on GitHub

Hacker News discussions

• Gemma-4-31B at 256K context on a $1,400 AMD GPU – measured, with patches (2 points, 0 comments, by alsaha, 2026-06-10)