bentoml/BentoVLLM

Self-host LLMs with vLLM and BentoML

3 best points · 1 comments · 1 Hacker News post · 175 GitHub stars · View on GitHub

Hacker News discussions

• Self-Host LLMs with VLLM and BentoML (3 points, 1 comments, by sherlockxu, 2024-04-24)