Continued Training of Continuous Language Flows with Token Identity Squared Supervision
cs.CL, cs.AI
Submitted: 2026-11-05
Updated: 2026-11-17
Terminology
Sources
- Structured Denoising Diffusion Models in Discrete State-Spaces
- One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling
- LangFlow: Continuous Diffusion Rivals Discrete in Language Modeling
- Likelihood-Based Diffusion Language Models
- Mutual Information and Minimum Mean-square Error in Gaussian Channels
- ELF: Embedded Language Flows
- Variational Diffusion Models
- Flow Map Language Models: One-step Language Modeling via Continuous Denoising
- Diffusion-LM Improves Controllable Text Generation
- Flow Matching for Generative Modeling
- Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow
- Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution
- Improving Vector-Quantized Image Modeling with Latent Consistency-Matching Diffusion
- Noise Scheduling as Information-Guided Allocation in Diffusion Training
- Simple and Effective Masked Diffusion Language Models
- Continuous Autoregressive Language Models
- Generative Modeling by Estimating Gradients of the Data Distribution
- Score-Based Generative Modeling through Stochastic Differential Equations
- Self-conditioned Embedding Diffusion for Text Generation
- Attention Is All You Need
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data