The Power of Power Law: Asymmetry Enables Compositional Reasoning

A new study reveals that training models on data following a power-law distribution, rather than a curated uniform distribution, actually improves their ability to perform compositional reasoning tasks.

Firefly links to the original publisher. The summary above is AI-generated for orientation and may differ from the source. The “current rank score” decays over time so newer significant stories surface first.