noonghunna/club-3090

Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and model-agnostic. Currently shipping Qwen3.8-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1×/2×/4x/8x cards.

1 best points · 0 comments · 1 Hacker News post · 2,480 GitHub stars · View on GitHub

Hacker News discussions

• Club-3090 Recipes for serving QWEN3.6 27B locally on RTX 3090s (1 points, 0 comments, by lastdong, 2026-05-05)