huggingface/evaluation-guidebook

Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!

80 best points · 8 comments · 2 Hacker News posts · 2,163 GitHub stars · View on GitHub

Hacker News discussions

• Evals in 2025: going beyond simple benchmarks to build models people can use (80 points, 8 comments, by jxmorris12, 2025-09-18)
• LLM Evaluation Guidebook (2 points, 0 comments, by erinys, 2024-10-10)