MartinCrespoC/QuantumLeap---Llama.cpp-TurboQuant

🚀 Run any LLM on any hardware. 130% faster MoE inference with ExpertFlow + TurboQuant KV compression. Ollama-compatible API. Built on llama.cpp.

1 best points · 0 comments · 1 Hacker News post · 12 GitHub stars · View on GitHub

Hacker News discussions

• QuantumLeap: 2.3× faster MoE inference with intelligent expert caching (1 points, 0 comments, by ikharoz, 2026-03-31)