nalinraut/inferential

Multi-client inference orchestration on top of Ray Serve.

2 best points · 0 comments · 1 Hacker News post · 3 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Inferential – Multi-robot inference scheduling on shared GPUs (2 points, 0 comments, by nalinraut, 2026-03-17)