spinfinc/spinf-serve

Bulk classification and decision inference on one GPU: the content is read once, every question about it is scored in the same pass. OpenAI-compatible, Apache 2.0

22 best points · 5 comments · 1 Hacker News post · 21 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Spinf-serve – inference server for bulk scoring and decisions (22 points, 5 comments, by giarec, 2026-10-30)