21
When RLHF Fails: A Mechanistic Taxonomy of Reward Hacking, Collapse, and Evaluator Gaming
The study presents a mechanistic taxonomy and diagnostic pipeline to track how failures like reward hacking and policy collapse emerge during reinforcement learning from human feedback.
Impact
42/100
Current rank score
20.5
Source tier
Tier 1
Category
Research
Firefly links to the original publisher. The summary above is AI-generated for orientation and may differ from the source. The “current rank score” decays over time so newer significant stories surface first.