imxinchengyou/CacheVerifier

Research behind CacheVerifier (cacheverifier.com): verifier gating for semantic cache hits vs. static and adaptive thresholds, on ~210k requests across three public benchmarks plus real Twitter support traffic (4 datasets). Fine-tuning vs. off-the-shelf, label noise, drift, conformal risk control under shift, online ACI from randomized audits.

2 best points · 0 comments · 1 Hacker News post · 3 GitHub stars · View on GitHub

Hacker News discussions

• I tested whether verifying LLM cache hits in real time helps (weak yes) (2 points, 0 comments, by ChengyouXin, 2026-07-30)