yazon/flexllama

🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GPU support

4 best points · 0 comments · 1 Hacker News post · 63 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: FlexLLama – Run multiple local LLMs at once with a simple dashboard (4 points, 0 comments, by yazon, 2025-08-05)