LightCrafter: PBR-Conditioned Video Diffusion Refinement for Controllable and Consistent Relighting
LightCrafter is a hybrid pipeline that relights videos by first accurately estimating scene properties like geometry and materials, then rendering a Physically Based Rendering (PBR) video under the target light. A diffusion model then refines this PBR video into a photorealistic output. This method ensures temporal consistency by construction and uses realistic artifacts during training to correct errors in real-world scenes.