messkan/prompt-cache

Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response

1 best points · 0 comments · 1 Hacker News post · 426 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: PromptCache – a self-hosted semantic cache for LLMs (Go and BadgerDB) (1 points, 0 comments, by messkan, 2025-11-23)