ITO: Multi-View Alignment and Training-Time Fusion for Image-Text Pretraining
ITO addresses modality separation in image-text representations by combining multiple image-text alignments with a lightweight training-time fusion module. This synergy creates unified, stable embeddings that are more discriminative than standard methods while maintaining the efficiency of dual-encoder architectures at inference.