Selective Listening: Mechanism-Guided Control of Audio Influence in Large Audio-Language Models

arXiv:2610.11196 · cs.SD, cs.CL, cs.LG · Submitted 2026-10-08 · Read on arXiv

cs.SD, cs.CL, cs.LG

Submitted: 2026-10-08

Updated: 2026-10-08

Comments: 24 pages, 5 figures, 20 tables

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Accuracy — 25× in this paper · explained in 1 episode
• Consistency — 22× in this paper · explained in 3 episodes
• Self-consistency — 22× in this paper · explained in 2 episodes
• Influence Rate — 11× in this paper
• Benchmark — 9× in this paper · explained in 2 episodes
• Trace — 6× in this paper · explained in 2 episodes
• Robustness — 5× in this paper · explained in 5 episodes
• Alignment — 4× in this paper · explained in 1 episode
• Interpretability — 3× in this paper · explained in 15 episodes
• Multimodal Reasoning — 3× in this paper · explained in 5 episodes
• Ablation — 2× in this paper · explained in 1 episode
• Abstention — 2× in this paper · explained in 1 episode
• Activation Patching — 2× in this paper · explained in 2 episodes
• Adam — 2× in this paper · explained in 2 episodes
• Calibration — 2× in this paper · explained in 7 episodes
• External Validation — 2× in this paper · explained in 2 episodes
• Word Error Rate — 2× in this paper
• Aggregation — 1× in this paper · explained in 1 episode
• Automatic Speech Recognition (ASR) — 1× in this paper · explained in 2 episodes
• Few-Shot Learning — 1× in this paper · explained in 4 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• Generative AI — 1× in this paper · explained in 2 episodes
• Hallucination — 1× in this paper · explained in 3 episodes
• Hallucination Mitigation — 1× in this paper · explained in 2 episodes
• Instruction Tuning — 1× in this paper · explained in 2 episodes
• Mixture of Experts — 1× in this paper · explained in 2 episodes
• Pairwise Comparisons — 1× in this paper · explained in 2 episodes
• Provenance — 1× in this paper · explained in 4 episodes
• Sparsity — 1× in this paper · explained in 4 episodes
• Transformer — 1× in this paper · explained in 2 episodes

Sources

• Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs
• Diagnosing and Mitigating Modality Interference in Multimodal Large Language Models
• Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Models
• Qwen2-Audio Technical Report
• Moshi: a speech-text foundation model for real-time dialogue
• Step-Audio: Unified Understanding and Generation in Intelligent Speech Interaction
• Baichuan-Omni-1.5 Technical Report
• Voxtral
• Insight Over Sight: Exploring the Vision-Knowledge Conflicts in Multimodal LLMs
• AudioPaLM: A Large Language Model That Can Speak and Listen
• Qwen2.5-Omni Technical Report

Related papers

• Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
• Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
• Remix the Timbre: Diffusion-Based Style Transfer Across Polyphonic Stems
• Harmonic Representations in Symbolic Music Transformers are Localized and Controllable
• AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
• SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving