Heterogeneous Asymmetric Contrastive Distillation
cs.CV
Submitted: 2026-11-07
Updated: 2026-11-07
Code: https://github.com/BTAEYANG/HACD-Heterogeneous-Asymmetric-Contrastive-Distillation
Terminology
Sources
- Distilling the Knowledge in a Neural Network
- What Makes a "Good" Data Augmentation in Knowledge Distillation -- A Statistical Perspective
- FitNets: Hints for Thin Deep Nets
- Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer
- Representation Learning with Contrastive Predictive Coding
- Improved Baselines with Momentum Contrastive Learning
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs