LambdaLabsML/distributed-training-guide

Best practices & guides on how to write distributed pytorch training code

3 best points · 4 comments · 1 Hacker News post · 635 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: How to guide on training Llama-405B using PyTorch distributed APIs (3 points, 4 comments, by lambda-research, 2024-10-15)