oobabooga/text-generation-webui

Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

11 best points · 6 comments · 6 Hacker News posts · 47,736 GitHub stars · View on GitHub

Hacker News discussions

• LLaMA Text-Generation-Webui (11 points, 6 comments, by 0xbadc0de5, 2023-03-10)
• How to stop Vicuna talking to itself (3 points, 0 comments, by syntaxing, 2023-04-10)
• A gradio web UI for running Large Language Models (2 points, 0 comments, by call-me-al, 2023-03-10)
• Text Generation Web UI (2 points, 0 comments, by songzme, 2023-03-29)
• XTC: An LLM sampler that boosts creativity, breaks writing clichés (2 points, 0 comments, by RicoElectrico, 2024-08-19)
• QuIP#: SOTA 2-bit quantization method, now implemented in text-generation-webui (1 points, 0 comments, by pyinstallwoes, 2023-12-04)