MAESTRO: a Multimodal Auditory-attention Egocentric Speech-TRacking Open corpus

arXiv:2609.31898 · eess.AS, cs.HC, cs.LG, cs.SD, q-bio.NC · Submitted 2026-09-25 · Read on arXiv

eess.AS, cs.HC, cs.LG, cs.SD, q-bio.NC

Submitted: 2026-09-25

Updated: 2026-09-25

Code: https://github.com/ASPIRE-OSU/MAESTRO

Terminology

• Accuracy — 32× in this paper · explained in 1 episode
• Benchmark — 11× in this paper · explained in 2 episodes
• Embeddings — 6× in this paper · explained in 2 episodes
• Decode — 2× in this paper · explained in 2 episodes
• Generalization — 2× in this paper · explained in 13 episodes
• Multimodal Fusion — 2× in this paper · explained in 3 episodes
• AdamW Optimizer — 1× in this paper · explained in 1 episode
• Alignment — 1× in this paper · explained in 1 episode
• Consistency — 1× in this paper · explained in 3 episodes
• FOR THE WITHIN-SUBJECT AND LEAVE-ONE-SUBJECT-OUT — 1× in this paper
• Flow Matching — 1× in this paper · explained in 8 episodes
• Multimodal Inputs — 1× in this paper · explained in 2 episodes
• Multimodal Learning — 1× in this paper · explained in 2 episodes
• Optical Flow — 1× in this paper · explained in 2 episodes
• Positional Bias — 1× in this paper · explained in 2 episodes
• Signal-to-noise ratio (SNR) — 1× in this paper · explained in 2 episodes
• Sparsity — 1× in this paper · explained in 4 episodes
• alpha — 1× in this paper · explained in 1 episode

Sources

• GPT-4o System Card

Related papers

• Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMs
• X-VC: Zero-shot Streaming Voice Conversion in Codec Space
• Autoregressive Guidance of Deep Spatially Selective Filters using Bayesian Tracking for Efficient Extraction of Moving Speakers
• VM-ARRAYDPS: Virtual Microphone Augmented Diffusion Posterior Sampling for Unsupervised Blind Speech Separation
• Conditional Flow Matching for Visually-Guided Acoustic Highlighting
• Anonymization, Not Elimination: Utility-Preserved Speech Anonymization