evilsocket/llama3-cake

Distributed inference for mobile, desktop and server.

7 best points · 0 comments · 1 Hacker News post · 3,134 GitHub stars · View on GitHub

Hacker News discussions

• Distributed LLama3 Inference (7 points, 0 comments, by 345765476586, 2024-07-14)