leyten/shard

Pipeline-parallel LLM inference across GPUs on separate machines.

5 best points · 0 comments · 1 Hacker News post · 470 GitHub stars · View on GitHub

Hacker News discussions

• Pipeline-parallel LLM inference across GPUs on separate machines (5 points, 0 comments, by ngaut, 2026-06-19)