tensorchord/modelz-llm
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
2 best points · 3 comments · 2 Hacker News posts · 273 GitHub stars · View on GitHub
Hacker News discussions
- Show HN: Self-hosted OpenAI api server for open source LLMs (2 points, 3 comments, by gaocegege, 2023-06-07)
- OpenAI compatible API for LLMs (and embeddings) with ready-to-use Docker images (1 points, 0 comments, by gaocegege, 2023-08-14)