vyang472/five-bugs

A 10-minute smoke test for AI coding agents. Five seeded Python bugs, one checker the agent sees and one it never does — five agents across two labs and three model tiers all pass the first and fail the same case in the second.

3 best points · 0 comments · 1 Hacker News post · 1 GitHub stars · View on GitHub

Hacker News discussions

• One seeded bug, 26 AI agents: all passed the tests, all stayed broken (3 points, 0 comments, by vyang472, 2026-09-16)