Cross-Modal Semantic Successive Refinement for Generative Image Communication over Underwater Acoustic Channels
cs.IT, cs.CV, math.IT
Submitted: 2026-11-04
Updated: 2026-11-04
License: http://creativecommons.org/licenses/by/4.0/
The gist: Underwater acoustic communication faces challenges such as limited available bandwidth and complex channel environments…
Terminology
Abstract
Underwater acoustic communication faces challenges such as limited available bandwidth and complex channel environments, which impose demanding requirements on efficient image transmission and reliable reconstruction. To address these challenges, this paper proposes a generative image communication framework based on cross-modal semantic successive refinement. At the transmitter, text descriptions, compact bottleneck features, and visual side information compressed by residual vector quantization are transmitted. At the receiver, text and bottleneck features are first fused to predict a base estimate of the intermediate visual representation. The received RVQ indices are then used to recover supplementary visual information and perform residual correction, followed by image reconstruction using a one-step Pixel Mean Flow model. During training, a CLIP-based text-image semantic consistency constraint is introduced to preserve the semantic correspondence between generated results and the original text descriptions. During transmission, protection resources are allocated according to the importance of different information branches and RVQ quantization stages. Simulations using COCO 2017 images and measured underwater acoustic channel records from Watermark show that text and bottleneck features provide complementary semantic and structural conditions, RVQ visual side information further improves reconstruction quality, and layered unequal error protection helps improve recovery at low SNRs. Code-rate allocation experiments reveal a tradeoff between the reliability of fundamental conditions and visual-detail reconstruction under a limited visual-feature coding budget, providing guidance for allocating protection resources in underwater acoustic image transmission.
Sources
- 6G Networks: Beyond Shannon Towards Semantic and Goal-Oriented Communications
- Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications
- Semantic Communications: Principles and Challenges
- Semantics-Empowered Communication for Networked Intelligent Systems
- SwinJSCC: Taming Swin Transformer for Deep Joint Source-Channel Coding
- CDDM: Channel Denoising Diffusion Models for Wireless Communications
- Latency-Aware Generative Semantic Communications with Pre-Trained Diffusion Models
- Semantics-Guided Diffusion for Deep Joint Source-Channel Coding in Wireless Image Transmission
- High-Resolution Image Synthesis with Latent Diffusion Models
- One-step Latent-free Image Generation with Pixel Mean Flows
- Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
- Autoregressive Image Generation using Residual Quantization
- Microsoft COCO: Common Objects in Context
Related papers
- The Gaussian Multiuser Channel Capacity Region
- The mathematical landscape of partial information decomposition: A comprehensive review of properties and measures
- Electromagnetic Signal and Information Theory: A Continuous-Aperture Array Perspective
- Analytically Characterized Optimal Power Control for Signal-Level-Integrated Sensing, Computing and Communication in Federated Learning
- Information Spectrum Methods for Multiple-Access Channels--Part I: epsilon-Capacity Regions in the Mixed Gaussian Case
- Seed Recycling: Explicit Codes for Mixed Synchronization Errors Matching the Leading Term of the Gilbert--Varshamov Bound