DVD: Dynamic Vector Decoding for Efficient MLLM-based Perception
The DVD method proposes dynamic vector decoding to unify 2D and 3D perception for efficient integration with Multimodal Large Language Models (MLLMs). It transforms diverse shapes like boxes and masks into a sequence of vectors, maps them to discrete tokens, and then decodes these tokens back into original representations. This achieves high localization accuracy while significantly reducing token overhead and inference latency.