toverainc/willow-inference-server

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

13 best points · 13 comments · 1 Hacker News post · 511 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Willow Inference Server: Optimized ASR/TTS/LLM for Willow/WebRTC/REST (13 points, 13 comments, by kkielhofner, 2023-05-23)