tyfeng1997/tailor

mini llm infer engine w/ radix cache + paged attention + blockmanager

1 best points · 0 comments · 1 Hacker News post · 1 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: A mini paged-KV and prefix-cache scheduler (learning inference engine) (1 points, 0 comments, by bofeng1997, 2026-01-11)