hyperionaidev/smolmaxxing

maxxing the ability to run different LLMs on the smallest devices possible

259 best points · 88 comments · 1 Hacker News post · 244 GitHub stars · View on GitHub

#2 on the Front Page on Hacker News.

Social preview of hyperionaidev/smolmaxxing

From the README

🤏 smolmaxxing Every device around you is more capable than it looks. TV boxes, old phones, single-board computers and routers all ship with CPUs, RAM and flash that sit idle most of the day. smolmaxxing is about unlocking that capability: finding the biggest language model each device can really run, then pushing it further with custom kernels, smarter memory use and weight streaming. Every claim is measured on the hardware itself. Device #1 is a Xiaomi TV Box S (3rd Gen) : Amlogic S7D, 4× Cortex-A55 @ 2.5 GHz, 1.9 GB of RAM (about 1 GB usable), eMMC flash, Android 14, no root.

Hacker News discussions

I'm making LLMs work on small and old devices (259 points, 88 comments, by mrashad74, 2026-11-12)