skorotkiewicz/llm-rt

Small Ruby prototype for an OpenAI-compatible LLM proxy with a refillable token bucket

2 best points · 1 comments · 1 Hacker News post · 2 GitHub stars · View on GitHub

Hacker News discussions

• Run your own local LLM with rate limits via API-keys (2 points, 1 comments, by modinfo, 2026-05-27)