bmartin-systems/cortex-serving-arena-preview
2 best points · 0 comments · 1 Hacker News post · View on GitHub
Hacker News discussions
- LLM continuous batching host scheduler in Rust (191k tok/s on 1 vCPU) (2 points, 0 comments, by bmartin-systems, 2026-09-15)