Embedding Physical Reasoning into Diffusion-Based Shadow Generation Under the Sun and Sky
This work introduces a framework to generate realistic shadows by grounding them in physics rather than just image space. It estimates scene geometry and light direction to create a physical shadow prior, which is then refined into a high-resolution mask. This physically-grounded estimate guides a frozen Stable Diffusion model through spatial and global conditioning, ensuring the generated shadows are geometrically consistent.