sighingnow/Megatron-LM

Ongoing research training transformer models at scale

3 best points · 1 comments · 1 Hacker News post · 1 GitHub stars · View on GitHub

Hacker News discussions

• Why async gradient update doesn't get popular in LLM community? (3 points, 1 comments, by sighingnow, 2023-10-10)