kuleshov/minillm
MiniLLM is a minimal system for running modern LLMs on consumer-grade GPUs
3 best points · 2 comments · 2 Hacker News posts · 977 GitHub stars · View on GitHub
Hacker News discussions
- Don't have a $5k MacBook to run LLAMA65B? MiniLLM runs LLMs on GPUs in <500 LOC (3 points, 2 comments, by volodia, 2023-03-18)
- MiniLLM is a minimal system for running modern LLMs on consumer-grade GPUs (1 points, 0 comments, by tosh, 2023-04-30)