punica-ai/punica

Serving multiple LoRA finetuned LLM as one

135 best points · 26 comments · 1 Hacker News post · 1,177 GitHub stars · View on GitHub

Hacker News discussions

• Punica: Serving multiple LoRA finetuned LLM as one (135 points, 26 comments, by abcdabcd987, 2023-11-08)