mlc-ai/mlc-llm

Universal LLM Deployment Engine with ML Compilation

303 best points · 107 comments · 3 Hacker News posts · 23,309 GitHub stars · View on GitHub

Hacker News discussions

• MLC-LLM: GPT/Llama on consumer-class GPUs and phones (303 points, 106 comments, by junrushao1994, 2023-04-30)
• MLC LLM: Universal LLM Deployment with GPU Acceleration (3 points, 1 comments, by crowwork, 2023-04-29)
• Bringing Hardware Accelerated Language Models to Android Devices (2 points, 0 comments, by crowwork, 2023-05-09)