Dynamic Thermal Gaussians: Multimodal 4D Gaussian Splatting
cs.CV
Submitted: 2026-09-21
Updated: 2026-09-21
Code: https://github.com/LinLif1869/DTG
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Thermography plays a vital role in military and broader thermal analysis applications.
Terminology
Abstract
Thermography plays a vital role in military and broader thermal analysis applications. Recent progress in 3D thermal reconstruction has extended temperature analysis from 2D to 3D space, yet most existing works assume static temperature distributions, neglecting the temporal dynamics of heat transfer in real-world environments. To address this limitation, we propose the first dynamic RGB-Thermal reconstruction framework for complex scenes. Our method jointly models RGB appearance, thermal observations, and scene geometry as they change over time. Specifically, we introduce a multimodal dynamic scene representation that anchors both the color and thermal modalities to a shared geometric substrate, ensuring their consistency under spatiotemporal deformations. We further design multimodal embeddings to enhance the motion expressiveness for each modality, and propose a multimodal routing mechanism that retains a unified set of shared multimodal Gaussians as the geometric backbone while adaptively spawning modality-specific Gaussians to strengthen the representational capacity in detail-rich regions of each individual modality. In addition, we contribute a novel benchmark dataset featuring high-frequency temperature variations to facilitate the evaluation of 4D reconstruction. Extensive experiments demonstrate that our method achieves high-fidelity spatiotemporal reconstruction of both appearance and temperature. Our code and dataset are available at: https://github.com/LinLif1869/DTG.
Sources
- ThermoNeRF: Joint RGB and Thermal Novel View Synthesis for Building Facades using Multimodal Neural Radiance Fields
- $\textit{S}^3$Gaussian: Self-Supervised Street Gaussians for Autonomous Driving
- ManipDreamer3D : Synthesizing Plausible Robotic Manipulation Video with Occupancy-aware 3D Trajectory
- HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields
- RoboArmGS: High-Quality Robotic Arm Splatting via B'ezier Curve Refinement
- ParkGaussian: Surround-view 3D Gaussian Splatting for Autonomous Parking
- Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models