neul-labs/fast-litellm

High-performance Rust acceleration for LiteLLM - providing significant performance improvements for connection pooling, rate limiting, and memory-intensive workloads.

27 best points · 9 comments · 1 Hacker News post · 49 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Optimizing LiteLLM with Rust – When Expectations Meet Reality (27 points, 9 comments, by ticktockten, 2025-11-18)