HackerGit Trending Discord Star

wyolet/relay

High-throughput, self-hostable LLM router in Go. BYO provider keys, k8s-native, key pooling + batch + usage observability.

3 best points · 0 comments · 1 Hacker News post · 30 GitHub stars · View on GitHub

Hacker News discussions