HackerGit Trending Discord Star

magnitudedev/magnitude

Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.

194 best points · 180 comments · 3 Hacker News posts · 7,729 GitHub stars · View on GitHub

Hacker News discussions