Topoformer: brain-like topographic organization in Transformer language models through spatial querying and reweighting

TOA Binhuraib, G Tuckute, N Blauch - ICLR 2024 Workshop on …, 2024 - openreview.net
Spatial functional organization is a hallmark of biological brains: neurons are arranged
topographically according to their response properties, at multiple scales. In contrast …