kootenpv/tok

Fast and customizable tokenization :speedboat:

2 best points · 0 comments · 1 Hacker News post · 67 GitHub stars · View on GitHub

Hacker News discussions

• Created a fast and customizable NLP tokenizer in Python using a novel approach (2 points, 0 comments, by kootenpv, 2019-07-04)