Which Tokens to Merge? Diffusion Dynamics for Efficient Image Generation
The authors propose Dynamics-aware Token Merging (DaTMe), a training-free method to decide which tokens to merge during diffusion model generation. DaTMe uses a map derived from denoising dynamics—combining temporal change and structural features—to identify critical tokens. This approach preserves structurally important regions, like background details, leading to better image quality and coherence compared to prompt-centric methods.