thaw-ai/thaw

git for live agent sessions: snapshot, branch, and diff a running vLLM/SGLang session as a durable file. inspect & diff on a laptop, no GPU; restore skips prefill. Rust + CUDA, Apache-2.0. pip install thaw-vllm

3 best points · 0 comments · 1 Hacker News post · 8 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Thaw – Git branch for a running LLM (fork agents, skip prefill) (3 points, 0 comments, by nilsmatteson, 2026-05-30)