kir-gadjello/zipslicer

A library for incremental loading of large PyTorch checkpoints

38 best points · 8 comments · 1 Hacker News post · 56 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Zipslicer, a library for loading LLM checkpoints on consumer hardware (38 points, 8 comments, by kir-gadjello, 2023-03-03)