EdgeCrafter: Compact ViTs for Edge Dense Prediction via Task-Specialized Distillation

arXiv:2603.18739 · cs.CV · Submitted 2026-03-19 · Read on arXiv

cs.CV

Submitted: 2026-03-19

Updated: 2026-10-22

Code: https://github.com/ultralytics/ultralytics

Project page: https://intellindust-ai-lab.github.io/projects/EdgeCrafter

Terminology

Distillation — 56× in this paper · explained in 2 episodes
DINOv3 — 34× in this paper · explained in 2 episodes
Instance Segmentation — 33× in this paper · explained in 3 episodes
Transformer — 26× in this paper · explained in 2 episodes
Decoder — 22× in this paper · explained in 2 episodes
Accuracy — 17× in this paper · explained in 1 episode
Ablation — 14× in this paper · explained in 1 episode
SAM2 — 12× in this paper · explained in 3 episodes
Transformers — 10× in this paper · explained in 2 episodes
Knowledge Distillation — 7× in this paper · explained in 15 episodes
Localization — 7× in this paper · explained in 2 episodes
Foundation Model — 5× in this paper · explained in 3 episodes
Weight Decay — 5× in this paper · explained in 2 episodes
Data Augmentation — 4× in this paper · explained in 10 episodes
Edge Deployment — 4× in this paper · explained in 2 episodes
Fine-Tuning — 4× in this paper · explained in 5 episodes
Foundation Models — 4× in this paper · explained in 7 episodes
Hyperparameters — 4× in this paper · explained in 2 episodes
Unified Framework — 4× in this paper · explained in 6 episodes
Absorb — 3× in this paper · explained in 1 episode
Adaptation — 3× in this paper · explained in 1 episode
Edge Devices — 3× in this paper · explained in 2 episodes
Representation Learning — 3× in this paper · explained in 3 episodes
Training Objective — 3× in this paper · explained in 3 episodes
Ablation Study — 2× in this paper · explained in 3 episodes
Embeddings — 2× in this paper · explained in 2 episodes
Evaluation Protocol — 2× in this paper · explained in 2 episodes
Regularization — 2× in this paper · explained in 3 episodes
AdamW Optimizer — 1× in this paper · explained in 1 episode
COCO Object Keypoint Similarity — 1× in this paper
Contrastive Learning — 1× in this paper · explained in 8 episodes
Convolutional Neural Network (CNN) — 1× in this paper · explained in 2 episodes
Core — 1× in this paper · explained in 2 episodes
Decoupled Distillation Focal — 1× in this paper
Downstream Tasks — 1× in this paper · explained in 2 episodes
Fine-Grained Localization — 1× in this paper
Knowledge Distillation (KD) — 1× in this paper · explained in 3 episodes
Quantization — 1× in this paper · explained in 15 episodes
Self-supervised Pretraining — 1× in this paper · explained in 3 episodes
Semantic Segmentation — 1× in this paper · explained in 3 episodes
Transferability — 1× in this paper · explained in 5 episodes
Transformer Model — 1× in this paper · explained in 2 episodes
Two-Stage Framework — 1× in this paper · explained in 2 episodes

Terminology

Related papers