EleutherAI/gpt-neo

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

561 best points · 127 comments · 1 Hacker News post · 8,252 GitHub stars · View on GitHub

Hacker News discussions

• GPT Neo: open-source GPT model, with pretrained 1.3B & 2.7B weight models (561 points, 127 comments, by pizza, 2021-03-21)