Picovoice/picollm
On-device LLM Inference Powered by X-Bit Quantization
15 best points · 0 comments · 1 Hacker News post · 319 GitHub stars · View on GitHub
Hacker News discussions
- On-Device LLM Inference Powered by X-Bit Quantization (15 points, 0 comments, by dynamix, 2024-05-29)