On associative neural networks for sparse patterns with huge capacities

arXiv:2603.26217 · math.PR, cs.LG · Submitted 2026-03-27 · Read on arXiv

math.PR, cs.LG

Submitted: 2026-03-27

Updated: 2026-09-25

Comments: 26 pages

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Associative Memory — 20× in this paper · explained in 2 episodes
• Diffusion Model — 3× in this paper · explained in 8 episodes
• Diffusion Models — 3× in this paper · explained in 6 episodes
• Attention Mechanism — 1× in this paper · explained in 2 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• Generative AI — 1× in this paper · explained in 2 episodes
• Sparsity — 1× in this paper · explained in 4 episodes
• Transformer — 1× in this paper · explained in 2 episodes

Sources

• Memorization to Generalization: Emergence of Diffusion Models from Associative Memory
• Hopfield Networks is All You Need

Related papers

• Sharp Deviations Bounds for Dirichlet Weighted Sums with Application to analysis of Bayesian algorithms
• Subspace Uncertainty and Sharp Sampling Thresholds on the Boolean Cube
• Local Anticoncentration for Gaussian Boson Sampling via Conditional Wishart Geometry
• Beyond the Semicircle: Free Diffusion Models with Prescribed Equilibria
• A New Bound on the Cumulant Generating Function of Dirichlet Processes
• The Site Frequency Spectrum in an Exponentially Growing Population with Selection