brantje/LlamaRack

Self-hosted llama.cpp manager with a modern web UI, multi-model orchestration, GPU-aware scheduling, OpenAI-compatible APIs, monitoring, and runtime management. It really whips the llama's ...

2 best points · 3 comments · 1 Hacker News post · 1 GitHub stars · View on GitHub

Hacker News discussions

• Anyone using llama.cpp willing to test LlamaRack? (2 points, 3 comments, by Vibecoder_, 2026-09-05)