sushrut141/kaoken

Speed up CPU inference on small language models

2 best points · 2 comments · 1 Hacker News post · 4 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Speed up model inference on CPU with hand crafted layer implementations (2 points, 2 comments, by wanderinglight, 2024-11-16)