google-deepmind/uncertain_ground_truth

Dermatology ddx dataset, Jax implementations of Monte Carlo conformal prediction, plausibility regions and statistical annotation aggregation from our recent work on uncertain ground truth (TMLR'23 and ArXiv pre-print).

2 best points · 0 comments · 1 Hacker News post · 681 GitHub stars · View on GitHub

Hacker News discussions

• Google DeepMind's research on uncertain ground truth in AI eval (2 points, 0 comments, by minraws, 2023-12-06)