HackerGit Trending Discord Star

mixpeek/multimodal-inference-server

Production-grade Rust inference server for multimodal models (image + text → streamed text), with OpenAI-compatible APIs and high-throughput GPU scheduling.

1 best points · 0 comments · 1 Hacker News post · 8 GitHub stars · View on GitHub

Hacker News discussions