Attention over noisy examples: generalization and memorization in the exponential Hopfield network

arXiv:2610.22191 · cond-mat.dis-nn, cs.LG, cs.NE · Submitted 2026-10-15 · Read on arXiv

cond-mat.dis-nn, cs.LG, cs.NE

Submitted: 2026-10-15

Updated: 2026-10-15

Comments: 15 pages, 9 figures. Code, data and Monte Carlo results at https://github.com/francescoalemanno/hebb-attention

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Memorization — 4× in this paper · explained in 2 episodes
• Accuracy — 1× in this paper · explained in 1 episode
• Attention Entropy — 1× in this paper · explained in 2 episodes
• Generalization — 1× in this paper · explained in 13 episodes

Related papers

• Probing critical phases in quasiperiodic systems via subsystem information capacity
• Few-Shot Neuromorphic Vision in a Nonlinear Photonic Network Laser
• Hyperbolic lattices with mass disorder: Phases and phase transitions
• Non-Markovian dephasing of disordered, quasi-one-dimensional fermion systems
• Adaptive Neural Quantum States: A Recurrent Neural Network Perspective
• Machine learning Majorana topology using unsupervised and supervised learning