Michael-A-Kuykendall/shimmytok

Pure Rust GGUF tokenizer: 100% llama.cpp parity, zero C/C++ FFI, zero unsafe, WASM-ready. Free forever.

2 best points · 2 comments · 1 Hacker News post · 26 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Shimmytok – Pure Rust GGUF tokenizer (no C++, no extra files) (2 points, 2 comments, by MKuykendall, 2026-01-13)