kvcache-ai/Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

13 best points · 0 comments · 1 Hacker News post · 6,986 GitHub stars · View on GitHub

Hacker News discussions

• Mooncake: A KVCache-Centric Disaggregated Architecture for LLM Serving (13 points, 0 comments, by zinccat, 2024-06-29)