UI2App: Benchmarking Visual Interaction Inference in Executable Web Application Generation
UI2App is a benchmark testing how well AI models can infer application behavior from static screenshots without text prompts. It measures four aspects: executability, navigation reachability, visual fidelity, and interaction inference (IIS). The study shows that high visual quality does not guarantee the ability to understand complex interactions like cross-route state management.