From Pixels to Policy: A Multi-Agent System for Intervention and Geo-Spatial Decision Support
cs.CV
Submitted: 2026-10-01
Updated: 2026-10-01
Code: https://github.com/HosamGen/VIDA-GEO
License: http://creativecommons.org/licenses/by/4.0/
The gist: Urban environments are shaped by design choices with long-term implications for health, safety, and quality of life, yet evaluating proposed interventions remains costly, time-consuming, and often
Terminology
Abstract
Urban environments are shaped by design choices with long-term implications for health, safety, and quality of life, yet evaluating proposed interventions remains costly, time-consuming, and often impractical. Existing geospatial vision methods largely focus on monitoring urban indicators from aerial and street-view imagery, rather than proposing interventions and estimating their effects on such indicators. Moving beyond recognition, we introduce the problem of discovering interventions that improve target indicators for a given aerial or street-view image. We argue that a black-box indicator model, combined with a generative editing model, can serve as an implicit digital twin for testing intervention hypotheses. We present VIDA-Geo , a multi-agent system that explores this intervention space by coordinating segmentation, diffusion-based inpainting, and indicator scoring models to produce interventions that are both perceptually realistic and aligned with real-world policies. We evaluate our system on 8 indicators across aerial and street-view imagery, measuring changes in factors such as perceived safety and greenery. Our approach outperforms existing baselines in many cases, achieving up to 2X higher perceptual quality and policy alignment scores. Finally, our model provides users with multiple candidate interventions, supporting an expert city-planner-in-the-loop workflow.
Sources
- Qwen3-VL Technical Report
- SAM 3: Segment Anything with Concepts
- Teaching Humans Subtle Differences with DIFFusion
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- Latent Diffusion Counterfactual Explanations
- The Urban Model Platform: A Public Backbone for Modeling and Simulation in Urban Digital Twins
- STEEX: Steering Counterfactual Explanations with Semantics
- Segment Anything
- LANCE: Stress-testing Visual Models by Generating Language-guided Counterfactual Images
- LISAT: Language-Instructed Segmentation Assistant for Satellite Imagery
- ThinkGeo: Evaluating Tool-Augmented Agents for Remote Sensing Tasks
- A Multimodal Automated Interpretability Agent
- OpenAI GPT-5 System Card
- RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent
- OCTET: Object-aware Counterfactual Explanations
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models