pytorch-labs/gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

5 best points · 1 comments · 2 Hacker News posts · 6,269 GitHub stars · View on GitHub

Hacker News discussions

• Fast and hackable PyTorch native transformer inference (5 points, 0 comments, by gavi, 2023-11-30)
• GPT-Fast: Simple and efficient GPT inference in <1000 LOC of Python (1 points, 1 comments, by Palmik, 2023-12-06)