Free Draft-and-Verification: Toward Lossless Parallel Decoding for Diffusion Large Language Models
cs.LG, cs.AI
Submitted: 2025-09-30
Updated: 2026-11-03
Code: https://github.com/cychomatica/FreeDave
Terminology
Sources
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
- Program Synthesis with Large Language Models
- Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads
- Accelerating Large Language Model Decoding with Speculative Sampling
- Evaluating Large Language Models Trained on Code
- Training Verifiers to Solve Math Word Problems
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence
- Measuring Mathematical Problem Solving With the MATH Dataset
- Accelerating Diffusion LLMs via Adaptive Parallel Decoding
- A Survey on Large Language Models for Code Generation
- Mercury: Ultra-Fast Language Models Based on Diffusion
- DeepSeek-V3 Technical Report
- dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching
- Training Optimal Large Diffusion Language Models
- Large Language Diffusion Models
- Code Llama: Open Foundation Models for Code
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inference
- Revolutionizing Reinforcement Learning Framework for Diffusion Large Language Models
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis