neurono-ml/typed-lm

Single-forward-pass semantic routing in Rust: turn dense LLMs (Llama, Qwen, Mistral, Gemma) into a typed decision API with LoRA/QLoRA training and FP8/FP4 quantization, built on Candle.

3 best points · 2 comments · 1 Hacker News post · 10 GitHub stars · View on GitHub

Hacker News discussions

• Typed-lm: a Rust jev open source alternative (3 points, 2 comments, by andrelgcclaudin, 2026-09-26)