FEROM: Frontier Endogenous Reveal-Order Marginal Policy Optimization for Masked Diffusion LMs
cs.CL, cs.AI
Submitted: 2026-11-07
Updated: 2026-11-07
Code: https://github.com/ziansu/ferom
Terminology
Sources
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
- Program Synthesis with Large Language Models
- LLaDA2.0: Scaling Up Diffusion Language Models to 100B
- Evaluating Large Language Models Trained on Code
- dUltra: Ultra-Fast Diffusion Language Models via Reinforcement Learning
- Optimizing Decoding Paths in Masked Diffusion Models by Quantifying Uncertainty
- SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generation
- Training Verifiers to Solve Math Word Problems
- Unifying Autoregressive and Diffusion-Based Sequence Generation
- DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models
- Edit Flows: Flow Matching with Edit Operations
- MDPO: Overcoming the Training-Inference Divide of Masked Diffusion Language Models
- Autoregressive Diffusion Models
- Learning Unmasking Policies for Diffusion Language Models
- Any-Order Flexible Length Masked Diffusion
- Stop Training for the Worst: Progressive Unmasking Accelerates Masked Diffusion Training
- Accelerating Diffusion LLM Inference via Local Determinism Propagation
- Lookahead Unmasking Elicits Accurate Decoding in Diffusion Language Models
- Sequential Diffusion Language Models
- The Flexibility Trap: Rethinking the Value of Arbitrary Order in Diffusion Language Models
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data