Can We Trust Item Response Theory for AI Evaluation?

The study examines the limitations and potential misapplications of using item response theory to evaluate artificial intelligence benchmarks.

Firefly links to the original publisher. The summary above is AI-generated for orientation and may differ from the source. The “current rank score” decays over time so newer significant stories surface first.