Towards Isolated Interventions via Almost Orthogonal Features in Language Models

This paper addresses feature entanglement in language models by proposing a method to encourage almost orthogonal features, enabling more precise and isolated mechanistic interventions.

Firefly links to the original publisher. The summary above is AI-generated for orientation and may differ from the source. The “current rank score” decays over time so newer significant stories surface first.