Demystifying MaskGIT Sampler and Beyond: Adaptive Order Selection in Masked Diffusion
This work analyzes MaskGIT, a diffusion sampler, revealing it implicitly uses temperature sampling. It introduces 'moment sampler,' a more interpretable alternative using a choose-then-sample strategy. Two innovations—partial caching and an exploration-exploitation hybrid approach—are proposed to improve the efficiency of these methods.