TRNet: Two-Tier Recursion Network for Co-Salient Object Detection

Runmin CONG, Ning YANG, Hongyu LIU, Dingwen ZHANG, Qingming HUANG, Sam KWONG, Wei ZHANG

Research output: Journal PublicationsJournal Article (refereed)peer-review

Abstract

Co-salient object detection (CoSOD) is to find the salient and recurring objects from a series of relevant images, where modeling inter-image relationships plays a crucial role. Different from the commonly used direct learning structure that inputs all the intra-image features into some well-designed modules to represent the inter-image relationship, we resort to adopting a recursive structure for inter-image modeling, and propose a two-tier recursion network (TRNet) to achieve CoSOD in this paper. The two-tier recursive structure of the proposed TRNet is embodied in two stages of inter-image extraction and distribution. On the one hand, considering the task adaptability and inter-image correlation, we design an inter-image exploration with recursive reinforcement module to learn the local and global inter-image correspondences, guaranteeing the validity and discriminativeness of the information in the step-by-step propagation. On the other hand, we design a dynamic recursion distribution module to fully exploit the role of inter-image correspondences in a recursive structure, adaptively assigning common attributes to each individual image through an improved semi-dynamic convolution. Experimental results on five prevailing CoSOD benchmarks demonstrate that our TRNet outperforms other competitors in terms of various evaluation metrics. The code and results of our method are available at https://github.com/rmcong/TRNet_TCSVT2025.
Original languageEnglish
JournalIEEE Transactions on Circuits and Systems for Video Technology
Early online date27 Jan 2025
DOIs
Publication statusE-pub ahead of print - 27 Jan 2025

Bibliographical note

Publisher Copyright:
© 1991-2012 IEEE.

Keywords

  • Co-salient object detection
  • Improved semi-dynamic convolution
  • Reinforcement gate
  • Two-tier recursion

Fingerprint

Dive into the research topics of 'TRNet: Two-Tier Recursion Network for Co-Salient Object Detection'. Together they form a unique fingerprint.

Cite this