HackerGit Trending Discord Star

canergulay/tokps

Measure tokens/sec of any LLM behind an OpenAI-compatible API.

1 best points · 0 comments · 1 Hacker News post · 2 GitHub stars · View on GitHub

Hacker News discussions