laithrw/llm-threader

Efficiently run many local LLM calls on limited hardware without overheating or freezing your machine.

1 best points · 0 comments · 1 Hacker News post · 9 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Push local LLMs to max speed without overheating (1 points, 0 comments, by nate_rw, 2025-11-29)