llmonpy/ratellmiter

Rate limiter for LLM clients

2 best points · 1 comments · 1 Hacker News post · 22 GitHub stars · View on GitHub

Hacker News discussions

• Rate limiter for LLMs outperforms exponential backoff (2 points, 1 comments, by sftombu, 2024-09-18)