dakshjain-1616/gguf-serve

Zero-friction local server that loads any GGUF model behind an OpenAI-compatible REST API. No venv, no cloud. Wraps llama.cpp with a thin FastAPI surface supporting streaming and function calling.

3 best points · 0 comments · 1 Hacker News post · 2 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Host any GGUF model in one command (3 points, 0 comments, by gauravvij137, 2026-03-31)