dmatth1/quicktok

Fast exact BPE tokenizer. Byte-identical to tiktoken, 7x faster

3 best points · 1 comments · 1 Hacker News post · 10 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Quicktok, an exact BPE tokenizer 7x faster than tiktoken (3 points, 1 comments, by dmatth1, 2026-07-03)