Syn-Omni: Structured Specialization and Progressive Collaboration for Omnimodal Embeddings
Syn-Omni is a framework for structured omnimodal adaptation that combines Orthogonal Modality-Expert LoRA with Progressive Synergy Routing. It separates shared and specialized model parameters using OME-LoRA and then gradually enables cross-modal collaboration via PSR, leading to balanced performance across image, video, audio, and audiovisual tasks.