CoatFusion: Controllable Material Coating in Images

arXiv:2512.02143 · cs.GR, cs.CV, cs.LG · Submitted 2025-12-01 · Read on arXiv

cs.GR, cs.CV, cs.LG

Submitted: 2025-12-01

Updated: 2026-10-15

Comments: Accepted to ACM Transactions on Graphics (SIGGRAPH Asia 2026)

DOI: 10.1145/3842546

License: http://creativecommons.org/licenses/by-nc-nd/4.0/

The gist: We introduce Material Coating, a novel image editing task that simulates applying a thin material layer onto an object while preserving its underlying coarse and fine geometry.

Terminology

Abstract

We introduce Material Coating, a novel image editing task that simulates applying a thin material layer onto an object while preserving its underlying coarse and fine geometry. Material coating is fundamentally different from existing "material transfer" methods, which are designed to replace an object's intrinsic material, often overwriting fine details. To address this new task, we construct a large-scale synthetic dataset (110K images) of 3D objects with varied, physically-based coatings, named DataCoat110K. We then propose CoatFusion, a novel architecture that enables this task by conditioning a diffusion model on both a 2D albedo texture and granular, PBR-style parametric controls, including roughness, metalness, transmission, and a key thickness parameter. Experiments and user studies show CoatFusion produces realistic, controllable coatings and significantly outperforms existing material editing and transfer methods on this new task.

Related papers