bertaye/wifi-llm

A technical demo of streaming LLM weights over wifi to run a 16 MB quantized llama2 in an ESP32 with 300KB of ram

2 best points · 0 comments · 1 Hacker News post · 6 GitHub stars · View on GitHub

Hacker News discussions