How to "train" a surgeon? Benchmarking generalist agents in surgical scene understanding
cs.CV, cs.AI
Submitted: 2026-11-08
Updated: 2026-11-19
Code: https://github.com/CAMMA-public/cholect50
Project page: https://vitagent.github.io/Abstract
Terminology
Sources
- SurgVLM: A Large Vision-Language Model and Systematic Evaluation Benchmark for Surgical Intelligence
- Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling
- Qwen2.5-VL Technical Report
- Qwen3-VL Technical Report
- Pixtral 12B
- Gemma 3 Technical Report
- Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning
- MIRAGE: Scaling Test-Time Inference with Parallel Graph-Retrieval-Augmented Reasoning Chains
- Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4V
- 2017 Robotic Instrument Segmentation Challenge
- LLaVA-Surg: Towards Multimodal Surgical Assistant via Structured Surgical Video Learning
- SurgBench: A Unified Large-Scale Benchmark for Surgical Video Analysis
- SUREON: A Benchmark and Vision-Language Model for Surgical Reasoning
- Surg$\Sigma$: A Spectrum of Large-Scale Multimodal Data and Foundation Models for Surgical Intelligence
- Leveraging Generic Foundation Models for Multimodal Surgical Data Analysis
- SurgMotion: A Video-Native Foundation Model for Universal Understanding of Surgical Videos
- A generalizable foundation model for intraoperative understanding across surgical procedures
- CARES: Collaborative Agentic Reasoning for Error Detection in Surgery
- MinerU: An Open-Source Solution for Precise Document Content Extraction
- Text Embeddings by Weakly-Supervised Contrastive Pre-training
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs