Mutual Equilibrium: Multimodal Representation Learning through Reciprocal Feedback
The Mutual Equilibrium (MEQ) architecture refines two different data inputs by continuously exchanging information between them. It seeks a stable, mutually consistent representation—a fixed point—where each modality's embedding reflects the other. This iterative feedback process improves performance on tasks like VQA and shows robustness against noise compared to simple fusion methods.