dingste/mallama

LLM inference in C/C++ in progressive ways

2 best points · 0 comments · 1 Hacker News post · 2 GitHub stars · View on GitHub

Hacker News discussions

• 2.4x Faster Token Generation on CPU – Without Sacrificing Persona (2 points, 0 comments, by dingte, 2026-01-19)