abi/secret-llama

Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.

547 best points · 139 comments · 1 Hacker News post · 2,678 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: I built a free in-browser Llama 3 chatbot powered by WebGPU (547 points, 139 comments, by abi, 2024-05-03)