HackerGit Trending Discord Star

lordmathis/llamactl

Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.

2 best points · 0 comments · 1 Hacker News post · 161 GitHub stars · View on GitHub

Hacker News discussions