HackerGit Trending Discord Star

mirkolenz/llmhop

Tiny, stateless Go router that dispatches OpenAI-compatible requests to single-model vLLM and sglang backends with zero external dependencies

2 best points · 0 comments · 1 Hacker News post · 13 GitHub stars · View on GitHub

Hacker News discussions