Topoformer: brain-like topographic organization in Transformer language models through spatial querying and reweighting
Spatial functional organization is a hallmark of biological brains: neurons are arranged
topographically according to their response properties, at multiple scales. In contrast …
topographically according to their response properties, at multiple scales. In contrast …