efeslab/Nanoflow

A throughput-oriented high-performance serving framework for LLMs

2 best points · 0 comments · 1 Hacker News post · 976 GitHub stars · View on GitHub

Hacker News discussions