CD4LM: Consistency Distillation and aDaptive Decoding for Diffusion Language Models
cs.CL
Submitted: 2026-01-05
Updated: 2026-11-15
Code: https://github.com/yihao-liang/CDLM
Terminology
Sources
- GPT-4 Technical Report
- OpenCodeInstruct: A Large-scale Instruction Tuning Dataset for Code LLMs
- Program Synthesis with Large Language Models
- Qwen Technical Report
- Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads
- Evaluating Large Language Models Trained on Code
- DLM-One: Diffusion Language Models for One-Step Sequence Generation
- Training Verifiers to Solve Math Word Problems
- DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models
- DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generation
- The Llama 3 Herd of Models
- MDPO: Overcoming the Training-Inference Divide of Masked Diffusion Language Models
- Measuring Mathematical Problem Solving With the MATH Dataset
- Distilling the Knowledge in a Neural Network
- Reinforcing the Diffusion Chain of Lateral Thought with Diffusion Language Models
- Accelerating Diffusion LLMs via Adaptive Parallel Decoding
- Mercury: Ultra-Fast Language Models Based on Diffusion
- Beyond Fixed: Training-Free Variable-Length Denoising for Diffusion Large Language Models
- Diffusion-LM Improves Controllable Text Generation
- EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data