What Simple Readouts Miss in Continuous Language Diffusion
cs.CL, cs.LG
Submitted: 2026-06-07
Updated: 2026-11-09
Code: https://github.com/jax-ml/jax
Project page: https://skylion007.github.io/OpenWebTextCorpus
Terminology
Sources
- Consistent Diffusion Language Models
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
- CoBit: Language Modeling with Bitstream Diffusion
- Highly Compressed Tokenizer Can Generate Without Training
- LangFlow: Continuous Diffusion Rivals Discrete in Language Modeling
- DMax: Aggressive Parallel Decoding for dLLMs
- Scaling Categorical Flow Maps
- Generative Modeling via Drifting
- DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models
- Continuous Latent Diffusion Language Model
- Locally Coherent Parallel Decoding in Diffusion Language Models
- Classifier-Free Diffusion Guidance
- Denoising Diffusion Probabilistic Models
- ELF: Embedded Language Flows
- TextLDM: Language Modeling with Continuous Latent Diffusion
- Just on Time: Token-Level Early Stopping for Diffusion Language Models
- Where Should Diffusion Enter a Language Model? Geometry-Guided Hidden-State Replacement
- Learn from your own latents and not from tokens: A sample-complexity theory
- Similarity of Neural Network Representations Revisited
- Flow Map Language Models: One-step Language Modeling via Continuous Denoising
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data