Consistency Deep Equilibrium Models
Deep Equilibrium Models (DEQs) are powerful but slow because they use iterative solvers. This work introduces Consistency Deep Equilibrium Model (C-DEQ), which speeds up DEQ inference by using consistency distillation along a fixed trajectory. By training the model to map intermediate states directly to the equilibrium, C-DEQ achieves 2-20x accuracy improvements over implicit DEQs with fewer computation steps.