vllm-project/aibrix
Cost-efficient and pluggable Infrastructure components for GenAI inference
1 best points · 0 comments · 2 Hacker News posts · 5,182 GitHub stars · View on GitHub
Hacker News discussions
- Cost-efficient and pluggable Infrastructure components for GenAI inference (1 points, 0 comments, by mococa, 2025-02-22)
- Cost-efficient and pluggable Infrastructure components for GenAI inference (1 points, 0 comments, by rrampage, 2025-02-23)