Exploring the Underwater World Segmentation without Extra Training
cs.CV, cs.AI
Submitted: 2025-11-11
Updated: 2026-10-10
Code: https://github.com/LiBingyu01/Earth2Ocean
License: http://creativecommons.org/licenses/by/4.0/
The gist: Accurate segmentation of marine organisms is vital for biodiversity monitoring and ecological assessment, yet existing datasets and models remain largely limited to terrestrial scenes.
Terminology
Abstract
Accurate segmentation of marine organisms is vital for biodiversity monitoring and ecological assessment, yet existing datasets and models remain largely limited to terrestrial scenes. To bridge this gap, we introduce AquaOV255, the first large-scale and fine-grained underwater segmentation dataset containing 255 categories and over 20K images, covering diverse categories for open-vocabulary (OV) evaluation. Furthermore, we establish the first underwater OV segmentation benchmark, UOVSBench, by integrating AquaOV255 with five additional underwater datasets to enable comprehensive evaluation. Alongside, we present Earth2Ocean, a training-free OV segmentation framework that transfers terrestrial vision--language models (VLMs) to underwater domains without any additional underwater training. Earth2Ocean consists of two core components: a Geometric-guided Visual Mask Generator (GMG) that refines visual features via self-similarity geometric priors for local structure perception, and a Category-visual Semantic Alignment (CSA) module that enhances text embeddings through multimodal large language model reasoning and scene-aware template construction. Extensive experiments on the UOVSBench benchmark demonstrate that Earth2Ocean achieves significant performance improvement on average while maintaining efficient inference.
Sources
- GPT-4 Technical Report
- Homoclinic Floer homology via direct limits
- Qwen Technical Report
- MarineDet: Towards Open-Marine Object Detection
- Active Deep Kernel Learning of Molecular Properties: Realizing Dynamic Structural Embeddings
- USIS16K: High-Quality Dataset for Underwater Salient Instance Segmentation
- GPT-4o System Card
- Segment Anything
- Exploring Efficient Open-Vocabulary Segmentation in the Remote Sensing
- MARIS: Marine Open-Vocabulary Instance Segmentation with Geometric Enhancement and Semantic Alignment
- Vision-Language Instruction Tuning: A Review and Analysis
- Advancing Marine Research: UWSAM Framework and UIIS10K Dataset for Precise Underwater Instance Segmentation
- Distributionally Robust Receive Combining
- Diving into Underwater: Segment Anything Model Guided Underwater Salient Instance Segmentation and A Large-scale Dataset
- DINOv2: Learning Robust Visual Features without Supervision
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models