janit/viiwork

viiwork is a distributed meshing GPU LLM inference platform with pluggable engines - e.g. llama.cpp, vLLM, FreeToken, Strata…

3 best points · 0 comments · 1 Hacker News post · 12 GitHub stars · View on GitHub

Hacker News discussions

• LLM inference load balancer optimized for AMD Radeon VII GPUs (3 points, 0 comments, by velmu, 2026-04-05)