substratusai/kubeai

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

4 best points · 0 comments · 2 Hacker News posts · 1,289 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: KubeAI – Open AI on Kubernetes (4 points, 0 comments, by nstogner, 2024-08-26)
• KubeAI – AI Inference Operator for Kubernetes (1 points, 0 comments, by dunwaldo, 2024-12-08)