Improving Large Audio-Language Model Embedding Baselines for Instruction-Aware Speech Retrieval
cs.SD, cs.CL, eess.AS
Submitted: 2026-11-06
Updated: 2026-11-06
Code: https://github.com/lca0503/IRIS
Terminology
Sources
- The Emotional Voices Database: Towards Controlling the Emotion Dimension in Voice Generation Systems
- MAEB: Massive Audio Embedding Benchmark
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- Qwen3-TTS Technical Report
- E5-V: Universal Embeddings with Multimodal Large Language Models
- Gemini Embedding: Generalizable Embeddings from Gemini
- Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Ranking
- ALM2Vec: Learning Audio Embeddings for Universal Audio Retrieval with Large Audio-Language Models
- VLM2Vec-V2: Advancing Multimodal Embedding for Videos, Images, and Visual Documents
- MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
- EMNS /Imz/ Corpus: An emotive single-speaker dataset for narrative storytelling in games, television and graphic novels
- Representation Learning with Contrastive Predictive Coding
- GPT-4o System Card
- Gemma 4 Technical Report
- Omni-Interactive Universal Embedder
- Qwen2.5-Omni Technical Report
- Qwen3-Omni Technical Report
- Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Models
- SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuning
Related papers
- Speech-DRAME: A Framework for Human-Aligned Benchmarks in Speech Role-Play
- MuLaCover: Flexible Cover Song Generation via Symbolic Tonal Control
- Optimising Neural Speech Codecs for 300bps Communication using Reinforcement Learning
- Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
- Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
- Remix the Timbre: Diffusion-Based Style Transfer Across Polyphonic Stems