Factual recall in linear associative memories: sharp asymptotics and mechanistic insights
This study characterizes the storage capacity of linear associative memories using a 'decoupled' model, finding a sharp threshold at 1/2. The optimal solution stores information by raising correct scores just above the extreme-value threshold set by competing outputs, providing mechanistic insight into how memory is stored.