autonomi-ai/nos

⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.

3 best points · 0 comments · 1 Hacker News post · 148 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: NOS – A fast, and ergonomic PyTorch inference server (3 points, 0 comments, by EarlyOom, 2023-12-14)