RRNet : Relational Reasoning Network with Parallel Multiscale Attention for Salient Object Detection in Optical Remote Sensing Images

Runmin CONG, Yumo ZHANG, Leyuan FANG, Jun LI, Yao ZHAO, Sam KWONG

Research output: Journal PublicationsJournal Article (refereed)peer-review

118 Citations (Scopus)

Abstract

Salient object detection (SOD) for optical remote sensing images (RSIs) aims at locating and extracting visually distinctive objects/regions from the optical RSIs. Since some saliency models were proposed to solve the intrinsic problem of optical RSIs (such as complex background and scale-variant objects), the accuracy and completeness are still unsatisfactory. To this end, we propose a relational reasoning network (RRNet) with parallel multiscale attention (PMA) for SOD in optical RSIs in this article. The relational reasoning module that integrates the spatial and the channel dimensions is designed to infer the semantic relationship by utilizing high-level encoder features, thereby promoting the generation of more complete detection results. The PMA module is proposed to effectively restore the detailed information and address the scale variation of salient objects by using the low-level features refined by multiscale attention. Extensive experiments on two datasets demonstrate that our proposed RRNet outperforms the existing state-of-the-art SOD competitors both qualitatively and quantitatively ( https://rmcong.github.io/proj_RRNet.html ).
Original languageEnglish
Number of pages11
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume60
Early online date28 Oct 2021
DOIs
Publication statusPublished - 2022
Externally publishedYes

Funding

This work was supported in part by the Beijing Nova Program under Grant Z201100006820016; in part by the National Natural Science Foundation of China under Grant 62002014, Grant U1936212, and Grant 61922029; in part by the Young Elite Scientist Sponsorship Program by the China Association for Science and Technology (CAST) under Grant 2020QNRC001; in part by the Science and Technology Plan Project Fund of Hunan Province under Grant 2019RS2016; in part by the Hong Kong Scholars Program Grant XJ2020040; in part by the CAAI-Huawei MindSpore Open Fund; in part by the General Research Fund-Research Grants Council (GRF-RGC) under Grant 9042816 (CityU 11209819) and Grant 9042958 (CityU 11203820); and in part by the China Postdoctoral Science Foundation under Grant 2020T130050 and Grant 2019M660438.

Keywords

  • Optical remote sensing images
  • parallel multiscale attention
  • relational reasoning
  • salient object detection

Fingerprint

Dive into the research topics of 'RRNet : Relational Reasoning Network with Parallel Multiscale Attention for Salient Object Detection in Optical Remote Sensing Images'. Together they form a unique fingerprint.

Cite this