sail-sg/zero-bubble-pipeline-parallelism
Zero Bubble Pipeline Parallelism
4 best points · 2 comments · 1 Hacker News post · 467 GitHub stars · View on GitHub
Hacker News discussions
- Speedup Megatron-LM from 10% to 30% with Zero Bubble Pipeline Parallelism (4 points, 2 comments, by yzh, 2024-01-17)