cyqlelabs/flux

The fastest way to run an LLM on your machine: Flux measures your GPUs, CPU, and storage once, splits the model across them, and serves it OpenAI-style in seconds.

1 best points · 0 comments · 1 Hacker News post · 8 GitHub stars · View on GitHub

Hacker News discussions

• Flux – Compile an LLM to your hardware, then serve it (1 points, 0 comments, by qalfy, 2026-10-07)