SAM 3D Animal: Promptable Animal 3D Reconstruction from Images in the Wild

SAM 3D Animal introduces a promptable method for reconstructing multiple animals from a single image using keypoints or masks. It uses a set-prediction paradigm and bipartite matching to jointly recover all animal instances, overcoming challenges in crowded scenes. The model shows significant performance gains when provided with keypoint prompts.

Open the full episode

More from AI Radio