Sparse Inter-Layer Dependencies of Transformer FFN Neurons

A new training-free attribution method is introduced to analyze the sparse dependencies between neurons in Transformer feedforward network blocks.

Firefly links to the original publisher. The summary above is AI-generated for orientation and may differ from the source. The “current rank score” decays over time so newer significant stories surface first.