Cross-Layer Refinement and Frequency-aware Fusion Network for Multi-Source Remote Sensing Image Classification

arXiv:2611.03078 · eess.IV, cs.CV · Submitted 2026-11-02 · Read on arXiv

eess.IV, cs.CV

Submitted: 2026-11-02

Updated: 2026-11-02

Comments: Under review at IEEE GRSL

Code: https://github.com/oucailab/CRFNet

License: http://creativecommons.org/licenses/by/4.0/

The gist: Multi-source remote sensing image classification benefits from complementary spectral and structural information.

Terminology

Abstract

Multi-source remote sensing image classification benefits from complementary spectral and structural information. However, identifying discriminative cross-modal features remains challenging. This letter proposes a Cross-Layer Refinement and Frequency-aware Fusion Network (CRFNet) within a lightweight dual-branch architecture. Specifically, a Cross-Layer Refinement Attention (CLRA) module propagates selected attention relationships across successive layers and employs top relation selection to progressively strengthen discriminative spatial dependencies while suppressing irrelevant responses. Furthermore, a Frequency-aware Complementary Fusion (FCF) module combines frequency-wise interactions with cross-modal channel attention in the Fourier domain. The resulting representations are then converted into spatial-domain gates to selectively modulate complementary features. Experiments on the Houston 2013 and Augsburg datasets demonstrate that the proposed CRFNet consistently outperforms several state-of-the-art methods. The codes are publicly available at https://github.com/oucailab/CRFNet

Related papers