EntropyCache: Decoded Token Entropy Guided KV Caching for Diffusion Language Models
cs.CL
Submitted: 2026-03-19
Updated: 2026-11-04
Code: https://github.com/mscheong01/EntropyCache
Terminology
Sources
- Program Synthesis with Large Language Models
- Evaluating Large Language Models Trained on Code
- Training Verifiers to Solve Math Word Problems
- Measuring Mathematical Problem Solving With the MATH Dataset
- FlashDLM: Accelerating Diffusion Language Model Inference via Efficient KV Caching and Guided Diffusion
- d$^2$Cache: Accelerating Diffusion-Based LLMs via Dual Adaptive Caching
- dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching
- dKV-Cache: The Cache for Diffusion Language Models
- Attention Is All You Need for KV Cache in Diffusion LLMs
- Large Language Diffusion Models
- LLaMA: Open and Efficient Foundation Language Models
- Fast-dLLM v2: Efficient Block-Diffusion LLM
- Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding
- GIFT: Guided Importance-Aware Fine-Tuning for Diffusion Language Models
- Dream 7B: Diffusion Large Language Models
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data