bentoml/llm-optimizer

Benchmark and optimize LLM inference across frameworks with ease

3 best points · 0 comments · 1 Hacker News post · 203 GitHub stars · View on GitHub

Hacker News discussions