AntoineF23/verdict

Vasari is a local, open source tool for evaluating AI features (agents, chatbots, RAG). Review LLM traces, run error analysis (open and axial coding), and validate an LLM as a judge against human labels with a confusion matrix, TPR/TNR and Cohen's kappa. Inspired by Hamel Husain's AI evals.

1 best points · 0 comments · 1 Hacker News post · 1 GitHub stars · View on GitHub

Hacker News discussions

• I built a free tool to evaluate AI agent outputs (human labels and LLM judges) (1 points, 0 comments, by antoinefornas, 2026-07-11)