lithos-ai/lithos-metal

lithos-metal: high-performance LLM inference kernels and serving for Apple silicon.

11 best points · 1 comments · 1 Hacker News post · 338 GitHub stars · View on GitHub

Hacker News discussions

• Lithos-metal: Qwen3.8-27B on 40-core M5 Max at 168 tokens/s (11 points, 1 comments, by emp_, 2026-10-17)