MonoPhysics: Estimating Geometry, Appearance, and Physical Parameters from Monocular Videos

MonoPhysics estimates a deformable object's geometry, appearance, and physical properties from a single camera view using physics simulation and 3D Gaussian Splatting. It solves scale ambiguity by introducing a global learnable scale factor. The method refines geometry using physics feedback and ensures accurate shape alignment through differentiable position maps, achieving multi-view performance with just one camera.

Open the full episode

More from AI Radio