therezor/cardputer-ai

Fully offline tiny LLM chatbot on the ESP32-S3 Cardputer ADV - 8M params, Q4 weights baked into the firmware, ~5 tok/s.

2 best points · 0 comments · 1 Hacker News post · 129 GitHub stars · View on GitHub

Hacker News discussions

• Chatbot Running on an ESP32-S3 (2 points, 0 comments, by REZOR, 2026-09-25)