EndoVLM: An Endoscopy Vision-Language Pre-training Model via Anatomy-Guided Sparsity and Progressive Alignment

arXiv:2608.04472 · cs.CV, cs.AI, cs.CL · Submitted 2026-08-05 · Read on arXiv

Zhenyu Yi, Jianwei Xu, Yue Hu, Zhongwei Qiu, Sijing Li, Liang Huang, Bin Lv, Ling Zhang, Yingda Xia

cs.CV, cs.AI, cs.CL

Submitted: 2026-08-05

Code: https://github.com/Scatteredrain/EndoVLM

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Foundation Model — 16× in this paper · explained in 3 episodes
AUC — 14× in this paper · explained in 2 episodes
Foundation Models — 8× in this paper · explained in 8 episodes
Generalization — 8× in this paper · explained in 14 episodes
Embeddings — 7× in this paper · explained in 2 episodes
Progressive Semantic-Aware Alignment — 5× in this paper
Anatomy-Guided Sparse Pooling — 4× in this paper
Redundancy — 4× in this paper · explained in 2 episodes
Representation Learning — 4× in this paper · explained in 3 episodes
Self-Supervised Learning — 4× in this paper · explained in 8 episodes
Sparse Attention — 4× in this paper · explained in 5 episodes
Transformer — 4× in this paper · explained in 2 episodes
Zero-Shot Generalization — 4× in this paper · explained in 5 episodes
Ablation — 3× in this paper · explained in 1 episode
DINOv3 — 3× in this paper · explained in 2 episodes
Downstream Tasks — 3× in this paper · explained in 2 episodes
Fine-Tuning — 3× in this paper · explained in 5 episodes
Foundation Models (FMs) — 3× in this paper · explained in 4 episodes
Semantic Alignment — 3× in this paper · explained in 6 episodes
Transformers — 3× in this paper · explained in 2 episodes
Ablation Study — 2× in this paper · explained in 3 episodes
Contrastive Learning — 2× in this paper · explained in 9 episodes
Core — 2× in this paper · explained in 2 episodes
Cross-modal Alignment — 2× in this paper · explained in 2 episodes
Decoder — 2× in this paper · explained in 2 episodes
Distillation — 2× in this paper · explained in 2 episodes
Generalization Capabilities — 2× in this paper · explained in 2 episodes
Interpretability — 2× in this paper · explained in 15 episodes
Modality Gap — 2× in this paper · explained in 6 episodes
Regularization — 2× in this paper · explained in 3 episodes
Semantic Gap — 2× in this paper · explained in 2 episodes
Sparsity — 2× in this paper · explained in 5 episodes
Zero-shot performance — 2× in this paper · explained in 2 episodes
Benchmark — 1× in this paper · explained in 2 episodes
Consistency — 1× in this paper · explained in 3 episodes
Cosine Similarity — 1× in this paper · explained in 3 episodes
EMMA — 1× in this paper · explained in 2 episodes
Evaluation Protocol — 1× in this paper · explained in 2 episodes
Feature Extraction — 1× in this paper · explained in 3 episodes
Generalizability — 1× in this paper · explained in 6 episodes
Monotonicity — 1× in this paper · explained in 2 episodes
Predictive Coding — 1× in this paper · explained in 3 episodes
Robustness — 1× in this paper · explained in 6 episodes
Self-Supervised Learning (SSL) — 1× in this paper · explained in 6 episodes
Training Objective — 1× in this paper · explained in 3 episodes
Transferability — 1× in this paper · explained in 5 episodes
Unified Framework — 1× in this paper · explained in 6 episodes

EndoVLM: An Endoscopy Vision-Language Pre-training Model via Anatomy-Guided Sparsity and Progressive Alignment

Terminology

Sources

Related papers