karpathy/rustbpe

The missing tiktoken training code

1 best points · 0 comments · 1 Hacker News post · 527 GitHub stars · View on GitHub

Hacker News discussions

• A simple, efficient BPE training implementation in Rust with Python bindings (1 points, 0 comments, by pbd, 2026-01-04)