Luce-Org/luce-megakernel

LLM speculative inference server for heterogeneous hardware & consumer GPUs

6 best points · 1 comments · 1 Hacker News post · 2,976 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: OS Megakernel that match M5 Max Tok/w at 2x the Throughput on RTX 3090 (6 points, 1 comments, by GreenGames, 2026-04-08)