From Fragmentation to Fusion: A Survey and Roadmap for Omnimodal Embeddings
cs.CL, cs.AI
Submitted: 2026-10-30
Updated: 2026-11-19
Code: https://github.com/codefuse-ai/Awesome-Omnimodal-Embeddings
Terminology
Sources
- GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluation
- MAEB: Massive Audio Embedding Benchmark
- MVEB: Massive Video Embedding Benchmark
- V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning
- The UEA multivariate time series classification archive, 2018
- Relational inductive biases, deep learning, and graph networks
- Billion-Scale Graph Foundation Models
- LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders
- Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
- Universal Sentence Encoder
- Douyin Multimodal Embedding Model Technical Report
- ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Prediction
- Learning Posterior Predictive Distributions for Node Classification from Synthetic Graph Priors
- Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks
- MTEB-French: Resources for French Sentence Embedding Evaluation and Analysis
- Moshi: a speech-text foundation model for real-time dialogue
- GLAP: General contrastive audio-text pretraining across domains and languages
- Improving zero-shot learning by mitigating the hubness problem
- LookBench: A Live and Holistic Open Benchmark for Fashion Image Retrieval
- Byte Pair Encoding for Efficient Time Series Forecasting
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data