HackerGit Trending Discord Star

tensorhq/suture-stream-repair

Ultra-low-latency reverse proxy that repairs truncated & malformed JSON in LLM streaming responses (OpenAI, Anthropic, Vertex AI, Bedrock) — fixes JSONDecodeError / serde_json EOF on truncated tool calls.

1 best points · 0 comments · 1 Hacker News post · 4 GitHub stars · View on GitHub

Hacker News discussions