modelship-ai/modelship

Self-hosted, OpenAI-compatible inference for the agentic era: reasoning LLMs, universal tool calling, and the Responses API alongside embeddings, speech, and image models — many models sharing your GPUs, one gateway. Powered by Ray Serve.

1 best points · 0 comments · 1 Hacker News post · 54 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Modelship – an open source ray backed model cluster (1 points, 0 comments, by Alez007, 2026-10-11)