TRNet: Two-Tier Recursion Network for Co-Salient Object Detection

  • Runmin CONG
  • , Ning YANG
  • , Hongyu LIU*
  • , Dingwen ZHANG*
  • , Qingming HUANG
  • , Sam KWONG
  • , Wei ZHANG
  • *Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

6 Citations (Scopus)

Abstract

Co-salient object detection (CoSOD) is to find the salient and recurring objects from a series of relevant images, where modeling inter-image relationships plays a crucial role. Different from the commonly used direct learning structure that inputs all the intra-image features into some well-designed modules to represent the inter-image relationship, we resort to adopting a recursive structure for inter-image modeling, and propose a two-tier recursion network (TRNet) to achieve CoSOD in this paper. The two-tier recursive structure of the proposed TRNet is embodied in two stages of inter-image extraction and distribution. On the one hand, considering the task adaptability and inter-image correlation, we design an inter-image exploration with recursive reinforcement module to learn the local and global inter-image correspondences, guaranteeing the validity and discriminativeness of the information in the step-by-step propagation. On the other hand, we design a dynamic recursion distribution module to fully exploit the role of inter-image correspondences in a recursive structure, adaptively assigning common attributes to each individual image through an improved semi-dynamic convolution. Experimental results on five prevailing CoSOD benchmarks demonstrate that our TRNet outperforms other competitors in terms of various evaluation metrics. The code and results of our method are available at https://github.com/rmcong/TRNet_TCSVT2025.
Original languageEnglish
Pages (from-to)5844-5857
Number of pages14
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume35
Issue number6
Early online date27 Jan 2025
DOIs
Publication statusPublished - 2025

Bibliographical note

The authors would like to thank Tamerlan Aghayev for his invaluable assistance in polishing the language of this article. In addition, they appreciate the constructive feedback from the Editor-in-Chief, Associate Editor, and all the reviewers.

Publisher Copyright:
© 1991-2012 IEEE.

Funding

This work was supported in part by the National Natural Science Foundation of China under Grant 61991411, Grant 62471278, and Grant 62236008; in part by Taishan Scholar Project of Shandong Province under Grant tsqn202306079; and in part by Hong Kong General Research Fund – Research Grants Council (GRF–RGC) GRF under Grant 11203820.

Keywords

  • Co-salient object detection
  • Improved semi-dynamic convolution
  • Reinforcement gate
  • Two-tier recursion

Fingerprint

Dive into the research topics of 'TRNet: Two-Tier Recursion Network for Co-Salient Object Detection'. Together they form a unique fingerprint.

Cite this