Masked diffusion as random sequential adsorption: an exactly solvable model for parallel decoding
cond-mat.stat-mech, cs.AI, cs.CL, cs.LG
Submitted: 2026-11-05
Updated: 2026-11-05
Comments: 14 pages (incl. appendices), 3 figures
Code: https://github.com/karpathy/char-rnn
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- Structured Denoising Diffusion Models in Discrete State-Spaces
- Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution
- Simple and Effective Masked Diffusion Language Models
- Simplified and Generalized Masked Diffusion for Discrete Data
- Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data
- Large Language Diffusion Models
- Mercury: Ultra-Fast Language Models Based on Diffusion
- ParallelBench: Understanding the Trade-offs of Parallel Decoding in Diffusion LLMs
- Error Bounds and Optimal Schedules for Masked Diffusions with Factorized Approximations
- Optimal Inference Schedules for Masked Diffusion Models
- The data geometry of masking diffusion: Certified-optimal schedules via unmasking growth complexity
- Generation Order and Parallel Decoding in Masked Diffusion Models: An Information-Theoretic Perspective
- Breaking AR's Sampling Bottleneck: Provable Acceleration via Diffusion Language Models
- $\textit{Jump Your Steps}$: Optimizing Sampling Schedule of Discrete Diffusion Models
- Theoretical Benefit and Limitation of Diffusion Language Model
- Walk fast but be careful: Understanding Parallel Sampling in Masked Diffusion
- Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Sampling
- MaskGIT: Masked Generative Image Transformer
- Accelerated Sampling from Masked Diffusion Models via Entropy Bounded Unmasking
- DAPD: Dependency-Aware Parallel Decoding via Attention for Diffusion LLMs
Related papers
- Emergent long-tail dynamics in driven magnets with dynamical frustration
- Statistical Mechanics of Dynamical System Identification
- Second law of thermodynamics in closed quantum many-body systems
- Chemical potentials from structure factors: II. Charged multi-component mixtures
- Genuine quantum scars in Floquet chaotic many-body systems
- Stochastic Thermodynamics for Autoregressive Generative Models: A Non-Markovian Perspective