swellweb/reame

CPU-first LLM inference server on llama.cpp. Runs useful models on free-tier ARM boxes; rewriting the input made it ~6x faster and more accurate than tuning the engine. MIT, benchmarks and failures included.

59 best points · 19 comments · 1 Hacker News post · 114 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Reame – a CPU inference server that gets faster as it runs (59 points, 19 comments, by targetbridge, 2026-07-11)