Dense Coverage, Sparse Refinement: Byte-Constrained Cooperative Perception
cs.CV
Submitted: 2026-09-24
Updated: 2026-09-24
Comments: Accepted at WACV 2027 (first-round acceptance)
License: http://creativecommons.org/licenses/by/4.0/
The gist: Collaborative perception improves autonomous perception by sharing intermediate Bird's-Eye-View (BEV) features across connected agents, but dense feature exchange is difficult to deploy under strict
Terminology
Abstract
Collaborative perception improves autonomous perception by sharing intermediate Bird's-Eye-View (BEV) features across connected agents, but dense feature exchange is difficult to deploy under strict Vehicle-to-Everything (V2X) bandwidth limits. Existing efficient methods typically either compress the full feature map uniformly, spending bits on low-value background, or sparsify communication, risking the loss of useful context. We propose a coverage-refinement design for byte-constrained cooperative perception: each agent transmits a highly compressed coarse layer over the full BEV map and allocates the remaining budget to selected high-resolution patches. A Task-Aware Benefit Selector ranks cells by estimated downstream utility, enabling deterministic budgeted refinement and zero-retraining adaptation to changing bandwidth. The receiver reconstructs a dense BEV tensor compatible with standard fusion modules. Experiments on DAIR-V2X and OPV2V show strong accuracy-payload trade-offs at kilobyte-scale budgets. On DAIR-V2X, our method reaches 0.60 AP@0.7 at only 1.87 KB per non-ego agent, compared with 0.52 at 4.61 KB for uniform SimVQ compression. Controlled diagnostics further show that the gain arises from coverage-refinement allocation rather than quantization alone. Code will be published.
Sources
- Pragmatic Communication in Multi-Agent Collaborative Perception
- Residual Vector Quantization For Communication-Efficient Multi-Agent Perception
- JigsawComm: Joint Semantic Feature Encoding and Transmission for Communication-Efficient Cooperative Perception
- InfoCom: Kilobyte-Scale Communication-Efficient Collaborative Perception with Information Bottleneck
- mmCooper: A Multi-agent Multi-stage Communication-efficient and Collaboration-robust Cooperative Perception Framework
- Rate-Distortion Optimized Communication for Collaborative Perception
- Finite Scalar Quantization: VQ-VAE Made Simple
- Theory and Experiments on Vector Quantized Autoencoders
- QuantV2X: A Fully Quantized Multi-Agent System for Cooperative Perception
- CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformers
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models