On the Structure of Stationary Solutions to McKean-Vlasov Equations with Applications to Noisy Transformers
math.PR, cs.AI, cs.LG, math.AP, stat.ML
Submitted: 2025-10-23
Updated: 2026-11-02
Comments: 46 pages, 5 figures, Theorem 2.7 strengthened
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- A multiscale analysis of mean-field transformers in the moderate interaction regime
- A Unified Perspective on the Dynamics of Deep Transformers
- Quantitative Clustering in Mean-Field Transformer Models
- On the stability of the invariant probability measures of McKean-Vlasov equations
- Dynamic metastability in the self-attention model
- Solutions of stationary McKean-Vlasov equation on a high-dimensional sphere and other Riemannian manifolds
Related papers
- Rank-One HCIZ Integrals and Multiplicative Convolutions
- Repeated averaging on random d-regular graphs
- Precise cover times for branching random walks on Hamming graphs: (iterated) logarithmic corrections
- Markov Chain CLTs: Resolving Open Problems
- Marked stable L'evy processes in Brownian local time
- A Sharp Refinement of Samuels' Inequality via Cap Moves