zilliztech/GPTCache
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
18 best points · 16 comments · 19 Hacker News posts · 8,220 GitHub stars · View on GitHub
Hacker News discussions
- GPTCache: Slash Your LLM API Costs by 10x (18 points, 6 comments, by fhaltmayer, 2023-04-06)
- Show HN: GPTCache – Redis for LLMs (7 points, 5 comments, by fzliu, 2023-04-12)
- How GPTCache works with llama index (5 points, 1 comments, by SimFG, 2023-05-22)
- Reduce your GPT bill via semantic caching (4 points, 2 comments, by fzliu, 2023-04-15)
- GPTCache: Semantic Cache for LLM Queries (3 points, 0 comments, by opisthenar84, 2023-04-08)
- Reduce your GPT bill via semantic caching (3 points, 0 comments, by fzliu, 2023-04-17)
- Show HN: GPT4 New Cache Component for App Developers (3 points, 0 comments, by rt_guo, 2023-04-18)
- Reduce your GPT bill via semantic caching (3 points, 0 comments, by fzliu, 2023-04-19)
- Does ChatGPT Need a Cache? (2 points, 1 comments, by redskyluan, 2023-04-05)
- GPTCache: Semantic Cache for LLMs (2 points, 0 comments, by fzliu, 2023-04-10)
- Redis for ChatGPT (2 points, 0 comments, by yujian, 2023-04-20)
- Limited budget or machine resources, how to achieve a decent LLM experience? (2 points, 1 comments, by SimFG, 2023-05-26)
- GPTCache (2 points, 0 comments, by wseqyrku, 2023-06-07)
- GPTCache (2 points, 0 comments, by fzliu, 2023-07-05)
- GPTCache (2 points, 0 comments, by tikkun, 2023-07-09)
- GPTCache – High-Performance Cache for Language Models (1 points, 0 comments, by fhaltmayer, 2023-04-14)
- Show HN: Reduce your GPT bill via semantic caching (1 points, 0 comments, by fzliu, 2023-04-19)
- GPTCache (1 points, 0 comments, by nunodonato, 2023-04-22)
- Semantic Cache (1 points, 0 comments, by fzliu, 2023-07-16)