Probing Low Frame Rate Degradation in Neural Audio Codecs
Researchers investigated why neural audio codecs suffer quality drops at low frame rates. They found that a fixed clip duration during training is the main culprit, not fundamental issues like codebook saturation or phonemic collisions. By matching the sequence length across different frame rates, they significantly improved performance and showed that low frame rate codecs can maintain meaningful intelligibility.