meta-pytorch/spmd_types

This module defines a type system for distributed training code, based off of JAX's sharding in types, but adapted for the PyTorch ecosystem.

2 best points · 1 comments · 1 Hacker News post · 46 GitHub stars · View on GitHub

Hacker News discussions

• spmd_types: A type system for distributed (SPMD) tensor computations in PyTorch (2 points, 1 comments, by matt_d, 2026-04-24)