ThinkDrag: Semantic Drag-Based Image Editing with Visual Reasoning
cs.CV
Submitted: 2026-10-09
Updated: 2026-10-09
Comments: Project page: https://atfortes.github.io/projects/thinkdrag/
Project page: https://atfortes.github.io/projects/thinkdrag
License: http://creativecommons.org/licenses/by/4.0/
The gist: Drag-based image editing provides an intuitive interface for spatially controlled image manipulation by allowing users to specify handle and target points.
Abstract
Drag-based image editing provides an intuitive interface for spatially controlled image manipulation by allowing users to specify handle and target points. Existing methods have made substantial progress through optimization-based, one-step, and feed-forward formulations, but they often interpret drag instructions as geometric displacements. This limits their effectiveness when the desired edit depends on interpreting image content and inferring a plausible semantic transformation from sparse point constraints. We introduce ThinkDrag, a unified multimodal framework for drag-based image editing with visual reasoning. ThinkDrag is trained to associate point constraints with meaningful object- and scene-level transformations, and can optionally produce an explicit reasoning trace that interprets the intended edit before image generation. This reasoning trace improves interpretability, particularly for ambiguous drags. Drag Endpoint Markers, motivated by an analysis of cross-image attention, provide an explicit correspondence signal that grounds each drag in image space. To support this framework, we construct a supervised dataset of semantic drag transformations paired with reasoning traces and introduce DragBench++, a benchmark targeting challenging drag-based editing scenarios with reference edit solutions. Experiments show that ThinkDrag achieves state-of-the-art performance, improving generation quality and plausibility while maintaining competitive point-following precision.
Sources
- Qwen Technical Report
- Qwen3-VL Technical Report
- FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space
- Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformer
- Chameleon: Mixed-Modal Early-Fusion Foundation Models
- Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling
- Emerging Properties in Unified Multimodal Pretraining
- ContextDrag: Precise Drag-Based Image Editing via Context-Preserving Token Injection and Position-Aligned Attention
- Re-Align: Structured Reasoning-guided Alignment for In-Context Image Generation and Editing
- Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generation
- DINOv3
- Emu3: Next-Token Prediction is All You Need
- Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey
- Qwen-Image Technical Report
- Show-o2: Improved Native Unified Multimodal Models
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models