Logbook: Extremely Long-form Audio Event Understanding
eess.AS, cs.AI, cs.CL, cs.LG, cs.SD
Submitted: 2026-10-05
Updated: 2026-10-05
Comments: Submitted to ICASSP 2027. Source code available at https://github.com/facebookresearch/logbook
Code: https://github.com/facebookresearch/logbook
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Audio benchmarks are built around short, pre-segmented clips, limiting model design to brief inputs or fixed vocabularies.
Abstract
Audio benchmarks are built around short, pre-segmented clips, limiting model design to brief inputs or fixed vocabularies. To close this gap, we introduce Logbook, a benchmark for hour-scale audio understanding, with recordings ranging from ten minutes to six days. Given a continuous audio recording and an event label vocabulary, a system must predict a gap-free segmentation with an event label and a description per segment. We compare 52 systems, end-to-end and cascaded, and ablate fine-tuning, context length, and reasoning budget. We find the task tractable, though the best systems remain below the human reference. Also, over-segmentation is pervasive, and fine-tuning partially mitigates it. Finally, end-to-end are often better than cascaded systems, but degrades with longer context.
Sources
- BLAB: Brutally Long Audio Bench
- ChronosAudio: A Comprehensive Long-Audio Benchmark for Evaluating Audio-Large Language Models
- Listening with Time: Precise Temporal Awareness for Long-Form Audio Understanding
- Qwen3-Omni Technical Report
- OpenFActScore: Open-Source Atomic Evaluation of Factuality in Text Generation
- No Language Left Behind: Scaling Human-Centered Machine Translation
- Scaling Laws for Neural Language Models
- Qwen2.5-Omni Technical Report
- Qwen2.5 Technical Report
- Olmo 3
- K2-V2: A 360-Open, Reasoning-Enhanced LLM
- The Llama 3 Herd of Models
- Qwen3 Technical Report
- Gemma 4 Technical Report
Related papers
- Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMs
- X-VC: Zero-shot Streaming Voice Conversion in Codec Space
- Autoregressive Guidance of Deep Spatially Selective Filters using Bayesian Tracking for Efficient Extraction of Moving Speakers
- VM-ARRAYDPS: Virtual Microphone Augmented Diffusion Posterior Sampling for Unsupervised Blind Speech Separation
- Conditional Flow Matching for Visually-Guided Acoustic Highlighting
- Anonymization, Not Elimination: Utility-Preserved Speech Anonymization