3D-USE: From Image-Level to Scene-Level Underwater Enhancement
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: I'm Tom.
Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.
Tom: We're looking at the paper: "3D-USE: From Image-Level to Scene-Level Underwater Enhancement".
Jane: Here's the gist of the paper. Underwater 3D reconstruction faithfully reproduces the color shifts and visibility loss of captured views, while physical inversion may leave estimation errors in the recovered scene appearance The Core Problem Addressed Underwater 3D reconstruction faithfully reproduces the color shifts and visibility loss of captured views, while physical inversion may leave estimation errors in the recovered scene appearance.
Tom: Existing underwater 3DGS methods mainly obtain clear renderings through physical inversion by fitting a parametric underwater image-formation model and compensating for estimated scattering and attenuation.
Jane: However, scene radiance and medium parameters are jointly inferred from degraded observations, making their decomposition underdetermined.
Tom: Consequently, accurate reconstruction does not necessarily produce a reliable enhanced scene appearance.
Paper summary: Tom: So, wrapping up this discussion on "three dee-USE: From Image-Level to Scene-Level Underwater Enhancement <ref:2608.28020#pg1,3D-USE: From Image-Level to Scene-Level Underwater Enhancement>." This paper introduces a two-stage framework that first uses MediumRBF to build a medium-aware Gaussian scene and then employs Appearance Transition Consensus to define consistent enhancement targets. Jane The authors claim this allows for persistent, visibility-enhanced three dee scene representation from degraded multi-view underwater observations without needing paired enhanced three dee data <ref:2608.28020#pg1,persistent, visibility-enhanced 3D scene representation from degraded multi-view underwater observations>.
Meng: What this means practically is that if you have a set of underwater photos, you can use this method to get a consistent look across all views, even if the original photos were noisy or had bad visibility. Lalam It’s about making sure the enhancement isn't just an artifact of one specific view but something that stays the same whether you view it from angle one or angle twenty-six.
Lu: The method addresses two main challenges: getting a reliable scene representation that separates object appearance from water effects, and defining a consistent enhancement target when you don't have those perfect paired examples. Tom It’s about finding a way to get scene-level enhancement without relying on having perfectly enhanced three dee data for supervision <ref:2608.28020#pg1>.
Jane: The implication is that we can build three dee scenes that are inherently more robust to the visual degradation of underwater capture, which is a big step because currently, many methods struggle with view-to-view consistency in their enhancements <ref:2608.28020#pg1>. Tom So, it’s less about achieving one perfect image and more about achieving a consistent scene appearance across the whole set of views.
Meng: I think for deployment, this level of consistency is what matters most for applications where you need reliable three dee data from real-world underwater footage <ref:2608.28020#pg1>. Lalam The paper shows that combining global and local transition guidance leads to more uniform and natural results compared to using only one or the other type of supervision.
Conclusion: Tom: So, this paper is about something called three dee-USE, which is trying to take underwater photos and make them look better in three dee without having all that perfect paired data we usually need.
Jane: Right, so it’s moving beyond just fixing a single picture to making the whole scene look consistent across different views. The authors are focusing on this idea of learning a persistent, visibility-enhanced representation.
Lu: What they propose is a two-stage process where they first build this medium-aware Gaussian scene using something called MediumRBF to separate what the object looks like from how the water is messing with the image.
Meng: I’m wondering how much work that extra modeling does cost us in terms of training time and what breaks when we try to deploy it on, say, a real underwater drone feed.
Lalam: The core idea is that they use Appearance Transition Consensus, which learns from paired 2D images to create guidance for both the whole scene and the smaller Gaussian parts of the scene <ref:2608.28020#pg1>.
Tom: And then they realize this guidance is realized through this Underwater Bilateral Appearance Field, or U-BAF, which lets them modify both the color and the medium appearance for novel views without needing that extra 2D model during actual rendering <ref:2608.28020#pg1>.
Jane: It means they’re achieving consistency by learning how things *should* look across a set of photos rather than just correcting one photo at a time.
Tom: The optimization strategy involves minimizing a loss function that combines reconstruction error and depth accuracy in the first stage, and then matching those results to their learned targets in the second stage.
Lu: They found that explicit medium modeling really helps when you look at all these metrics, confirming that separating water effects from object appearance is genuinely beneficial for stability.
Meng: So they achieved better cross-view consistency, which is what we need for reliable underwater mapping or inspection data.
Lalam: They showed this method gets the lowest macro average on wLPIPS across a lot of real underwater scenes compared to other methods.
Jane: It seems like the main thing is that the enhanced appearance stays stable across different viewpoints rather than looking different every time you change your angle.
Tom: The big implication here for us is that we can get better three dee scenes from messy underwater data without needing perfect, expensive ground truth enhancement for every single view.
Jane: It shifts the focus from just restoration to building a representation that inherently knows how to handle the water distortion consistently.
Lu: And while they’re doing this scene-level enhancement, they also showed how combining global and local guidance helps balance things out—it avoids getting stuck either in a scene-wide color grade or just making small spatial fixes locally.
Meng: That's good because it means we don't have to choose between those two types of corrections; you get both at once.
Lalam: This work addresses the challenge of not having perfect paired data for supervision by using learned transition priors instead, which is a significant step forward in this area.
Jieyu Yuan, Yuanlin Zhang, Jihong Li, Chunle Guo, Huimin Lu, Chongyi Li
College of Computer Science, Nankai University · NKIARI, Shenzhen Futian · School of Automation, Southeast University · Advanced Ocean Institute of Southeast University, Nantong
cs.CV
Submitted: 2026-08-28
Updated: 2026-10-31
Comments: Project page: https://bilityniu.github.io/3D-USE/
Project page: https://bilityniu.github.io/3D-USE/Introduction
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Importance score: 90/100
The gist: Underwater 3D reconstruction faithfully reproduces the color shifts and visibility loss of captured views…
Key concepts
- Medium Radial Basis Anchor Representation (MediumRBF)
- This component creates a medium-aware Gaussian scene. It uses isotropic radial basis anchors to interpolate medium properties in observer space. This allows the method to explicitly separate the object's appearance from the observer-dependent water effects, leading to a more stable geometry and explicit decomposition of the scene's medium.
- Appearance Transition Consensus (ATC)
- ATC learns transition priors by using paired 2D Underwater Image Enhancement (UIE) data. It consolidates these calibrated view-wise proposals into two types of guidance: scene-global targets and Gaussian-local targets. This ensures that the enhancement learned from individual views is coherently applied across the entire 3D scene.
- Underwater Bilateral Appearance Field (U-BAF)
- U-BAF realizes the learned guidance by performing coordinated modifications on both the Gaussian radiance and medium appearance. This process happens before underwater compositing. It allows for consistent novel-view rendering of enhanced scenes without requiring a 2D UIE model to be used at inference time.
Terminology
Summary
Underwater 3D reconstruction faithfully reproduces the color shifts and visibility loss of captured views, while physical inversion may leave estimation errors in the recovered scene appearance
The Core Problem Addressed
Underwater 3D reconstruction faithfully reproduces the color shifts and visibility loss of captured views, while physical inversion may leave estimation errors in the recovered scene appearance. Existing underwater 3DGS methods mainly obtain clear renderings through physical inversion by fitting a parametric underwater image-formation model and compensating for estimated scattering and attenuation. p. 0 However, scene radiance and medium parameters are jointly inferred from degraded observations, making their decomposition underdetermined. p. 0 Consequently, accurate reconstruction does not necessarily produce a reliable enhanced scene appearance. p. 0
The Proposed Solution Framework
3D-USE is formulated as learning a persistent, visibility-enhanced 3D scene representation from degraded multi-view underwater observations, enabling consistent enhanced rendering. This two-stage framework first establishes a medium-aware Gaussian scene with MediumRBF to separate object appearance from observer-dependent water effects. p. 0 Second, it uses Appearance Transition Consensus (ATC) to transfer paired 2D UIE knowledge into scene-global and Gaussian-local targets. p. 1 Finally, an Underwater Bilateral Appearance Field (U-BAF) realizes these targets in Gaussian radiance and medium appearance for consistent novel-view rendering without a 2D UIE model at inference. p. 1
Key Architectural Components
The Medium Radial Basis Anchor Representation (MediumRBF) establishes a medium-aware Gaussian scene with stable geometry and explicit object-medium decomposition by using isotropic radial basis anchors to interpolate medium properties in observer space. Appearance Transition Consensus (ATC) learns transition priors from paired 2D UIE data and consolidates calibrated view-wise proposals into scene-global and Gaussian-local guidance. p. 1 The Underwater Bilateral Appearance Field (U-BAF) realizes this guidance through coordinated modifications of Gaussian radiance and medium appearance. p. 1
Optimization Strategy
Stage-1 jointly optimizes underwater appearance reconstruction and scene geometry by minimizing Lrec = Lrec + λdLdepth, where Lrec combines relative l1 and MS-SSIM terms. Stage-2 supervises the appearance transition realized after complete underwater compositing by matching the realized global parameters to the scene-global ATC target and centered local residuals to rasterized Gaussian-local targets. p. 3 The total objective is LS2 = λgLglobal + λlLlocal + λtvLTV, where LTV is the total-variation (TV) regularizer for the UBAF factors. p. 3
Experimental Validation
Experiments on real underwater scenes show improved visibility and cross-view consistency while preserving reconstruction quality. Table 7 shows that 3D-USE obtains the lowest wLPIPS macro-average over all 26 scenes, showing that the enhanced appearance remains stable across views rather than varying independently with each viewpoint. p. 5 Qualitative results in Figure 4 further reveal the limitations of reconstruction-oriented restoration, as 3D-USE produces cleaner scene appearance with fewer medium-induced inconsistencies. p. 5 The method achieves the best URanker and MUSIQ on SeaThru-4, and leads all three metrics on D3 and D5. p. 5
Ablation Insights
Table 3 shows that explicit medium modeling substantially improves Vanilla 3DGS across all metrics, confirming the benefit of separating water effects from Gaussian radiance. Table 4 and Figure 5 demonstrate the complementary roles of global and local transition guidance, showing that combining both components resolves the trade-off between scene-wide color grade and spatial corrections. p. 6 The full model produces more uniform and natural results compared to global-only or local-only supervision. p. 6
Conclusion
We presented 3D-USE for underwater scene-level enhancement, addressing the absence of paired enhanced 3D data and the inconsistency of view-wise 2D enhancement guidance. Our method first reconstructs a medium-aware Gaussian scene with MediumRBF, and then employs ATC to consolidate paired 2D UIE transitions into a scene-consistent enhancement objective. p. 6 U-BAF realizes this objective as spatially coherent transformations of Gaussian radiance and medium appearance before underwater compositing, enabling persistent enhanced novel-view rendering without applying a 2D UIE model at inference. p. 6 Experimental results demonstrate improved visibility and cross-view consistency while maintaining reconstruction quality across diverse realworld underwater scenes. p. 6
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Medium aware scene representation for geometry reconstruction separates object appearance from observer dependent water effects to improve reconstruction fidelity and provide a stable basis for scene level enhancement. This allows for more accurate object rendering by explicitly modeling medium properties rather than absorbing them into Gaussian appearance during reconstruction.
-
A transition based formulation using Appearance Transition Consensus learns
transition priors from paired 2D UIE data and consolidates calibrated view-wise proposals into scene-global and Gaussian-local guidance, rather than treating independently enhanced images as RGB targets.
This preventsview-inconsistent supervision
by consolidating image level enhancement knowledge into a single scene level target. -
A trainable 4D appearance field called Underwater Bilateral Appearance Field realizes the transition targets through
coordinated modifications of Gaussian radiance and medium appearance,
enablingpersistent enhancement under novel-view rendering without a 2D UIE model at inference.
This means the system can render enhanced novel views directly using the learned scene representation, eliminating the need for a separate 2D enhancement model during inference. -
The system maintains cross view consistency by yielding
the lowest wLPIPS macro-average over all 26 scenes,
showing thatthe enhanced appearance remains stable across views rather than varying independently with each viewpoint.
This stability is achieved because the method usesa shared, observer dependent medium representation as a stable basis for the subsequent enhancement stage.
-
The system can produce clearer foreground structures and more spatially coherent backgrounds across diverse scenes by jointly adjusting object radiance and medium appearance, as it
learn[s] a shared scene-level appearance transformation.
This is achieved by matching realized global parameters to thesceneglobal ATC target
and local residuals to therasterized Gaussian-local target.
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs