HackerGit Trending Star

ghuntley/underclass

underclass: an OpenAI-compatible pooling proxy that pins sessions to one account (prompt cache stays warm), cools quota-exhausted subscriptions until their window resets, and fails fast with the earliest Retry-After when the whole pool is dry.

2 best points · 0 comments · 1 Hacker News post · 295 GitHub stars · View on GitHub

Hacker News discussions