substratusai/lingo

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

2 best points · 0 comments · 1 Hacker News post · 1,289 GitHub stars · View on GitHub

Hacker News discussions

• Lightweight ML model proxy and autoscaler for Kubernetes (2 points, 0 comments, by samosx, 2024-02-06)