Pumpire: Unified Benchmark for Metric Distance Estimation
Pumpire introduces a unified benchmark to evaluate how well 3D foundation models estimate metric distances between point pairs in both images and videos, regardless of whether they use depth priors. It uses a large dataset with physically measured distances to test model accuracy across various tasks like estimation and completion, providing insights into the strengths and weaknesses of different model types.