Bottom-up Modeling of Repeated Elements via Single Image Analysis-by-Synthesis
cs.CV
Submitted: 2026-09-07
Updated: 2026-09-16
Comments: Accepted to ECCV 2026. Project page: https://vayvi.github.io/repeated-elements/
License: http://creativecommons.org/licenses/by/4.0/
The gist: We address the problem of discovering repeated elements from a single image.
Terminology
Abstract
We address the problem of discovering repeated elements from a single image. In contrast to existing approaches that depend on large annotated datasets, curated multi-image collections, or object segmentation masks, we show that a single image can suffice to learn a meaningful object model in a completely bottom-up fashion, without any prior knowledge beyond a coarse scale prior. Our method learns a tunable image-space prototype of the repeated elements through a reconstruction objective, enabling the model to identify and synthesize consistent object instances within the same image. Experiments on 116 real images from the FSC-147 dataset demonstrate that our method successfully learns coherent element models and captures intra-category variation on challenging images. Qualitative results reveal superior reconstructions and interpretable decompositions compared to classical decomposition, joint alignment, and 3D object modeling methods, while maintaining a simple 2D formulation. These results suggest that meaningful object discovery can emerge from single image learning alone.
Sources
- Open-world Text-specified Object Counting
- Invariant Slot Attention: Object Discovery with Slot-Centric Reference Frames
- MONet: Unsupervised Scene Decomposition and Representation
- Structure from Duplicates: Neural Inverse Graphics from a Pile of Objects
- FastJAM: a Fast Joint Alignment Model for Images
- ClevrTex: A Texture-Rich Benchmark for Unsupervised Multi-Object Segmentation
- SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decomposition
- CounTR: Transformer-based Generalised Visual Counting
- Bridging the Gap to Real-World Object-Centric Learning
- DINOv3
- Illiterate DALL-E Learns to Compose
- Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomy
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models