SCMerge: Spatial-Consistency-Aware Token Pair Merging for Efficient Semantic Segmentation
SCMerge is a training-free method to reduce Vision Transformer sequence length by merging similar tokens while ensuring spatial consistency. It combines feature similarity with a spatial-consistency penalty based on local feature variation to improve the accuracy-efficiency trade-off in semantic segmentation tasks.