Chleba/ollamaMQ

High-performance LLM backends proxy with per-user fair-share queuing, round-robin scheduling, and a real-time TUI dashboard. Built in Rust.

4 best points · 1 comments · 3 Hacker News posts · 133 GitHub stars · View on GitHub

Hacker News discussions