When Music Needs Meaning: Semantic Communication as a Transformative Enabler for the Musical Metaverse
eess.SY, cs.AI, cs.SY
Submitted: 2026-11-02
Updated: 2026-11-02
Comments: 10 pages, 3 figures. Accepted and Presented at IEEE International Symposium on the Internet of Sounds (IS2) Conference 2026
Project page: https://ableton.github.io/link
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: The Musical Metaverse (MM) enables geographically distributed musicians, audiences, sound engineers, and AI agents to interact through synchronized audio, visual, kinematic…
Terminology
Abstract
The Musical Metaverse (MM) enables geographically distributed musicians, audiences, sound engineers, and AI agents to interact through synchronized audio, visual, kinematic, and haptic streams, imposing latency, synchronization, bandwidth, and scalability requirements that are difficult to satisfy with conventional bit-level communication. This paper argues that semantic communication, understood here as the transmission of musically meaningful information rather than raw audio-visual-haptic samples, provides a principled communication paradigm for the MM. We define the MM from a communication perspective and derive modality-specific require ments; propose a three-pillar framework for musical semantic communication comprising semantics extraction, semantic-aware orchestration, and cross-modal semantic synchronization; survey representative work across semantic communication, music AI and edge orchestration, identifying the gaps that prevent their integration; and propose a semantic-first reference architecture based on device-side semantic encoders, edge semantic routers, and cross-modal semantic synchronization. The resulting framework positions the MM as a concrete and demanding use case for 6G semantic communication.
Sources
- OmniCodec: Low Frame Rate Universal Audio Codec with Semantic-Acoustic Disentanglement
- On Network-Aware Semantic Communication and Edge-Cloud Collaborative Intelligence Systems
Related papers
- Industrial Load Modeling and Optimization for Market-Based Interaction with Power Systems
- Exact and Approximate Convex Reformulation of Linear Stochastic Optimal Control with Chance Constraints
- Certified Set Convergence for Piecewise Affine Systems
- Symbolic Control for Stochastic Systems via Finite Parity Games
- Multiobjective optimization-based design and dispatch of islanded, hybrid microgrids for remote, off-grid communities in sub-Saharan Africa
- Physiology-informed layered sensing for intelligent human-exoskeleton interaction