DDMS: Discriminative Distillation of Multi-view Foundational Features into Single-view Models
This work refines foundational visual features by fusing 2D semantic features with multi-view geometric data. It introduces a differentiable ranking objective to make these fused features more 3D consistent and locally distinctive. The resulting enhanced teacher model is then distilled into a single-view student, improving performance in tasks requiring accurate 3D understanding.