Distance-Guided Mask Propagation Model for Efficient Video Object Segmentation

Jiajia LIU, Hongning DAI, Bo LI, Gaozhong TANG

Research output: Book Chapters | Papers in Conference ProceedingsConference paper (refereed)Researchpeer-review

Abstract

Video object segmentation (VOS) is a significant yet challenging task in computer vision. In VOS, two challenging problems, including occlusions and distractions, are needed to be handled especially in multi-object videos. However, most existing methods have difficulty in efficiently tackling these two factors. To this end, a new semi-supervised VOS model, called Distance-Guided Mask Propagation Model (DGMPM), is proposed in this paper. Specifically, a novel embedding distance module, which is utilized to generate a soft cue for handling occlusions, is implemented by calculating distance difference between target features and the centers of foreground/background features. This non-parametric module that is based on global contrast between the target and reference features to detect object regions even if occlusions still exist, is less sensitive to the feature scale. The prior knowledge of the previous frame is applied as spatial guidance in the decoder to reduce the effect of distractions. In addition, spatial attention blocks are designed to strengthen the network to focus on the target object and rectify the prediction results. Extensive experiments demonstrate that the proposed DGMPM achieves competitive performance on accuracy and runtime in comparison with state-of-the-art methods.

Original languageEnglish
Title of host publication2020 International Joint Conference on Neural Networks, IJCNN 2020 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728169262
DOIs
Publication statusPublished - Jul 2020
Externally publishedYes
Event2020 International Joint Conference on Neural Networks, IJCNN 2020 - Virtual, Glasgow, United Kingdom
Duration: 19 Jul 202024 Jul 2020

Publication series

NameProceedings of the International Joint Conference on Neural Networks

Conference

Conference2020 International Joint Conference on Neural Networks, IJCNN 2020
Country/TerritoryUnited Kingdom
CityVirtual, Glasgow
Period19/07/2024/07/20

Bibliographical note

Funding Information:
This research was supported by National Key R&D Program of China (No. 2017YFC0806000), by National Natural Science Foundation of China (No. 11627802, 51678249), State Key Lab of Subtropical Building Science, South China University of Technology (2018ZB33), and the State Scholarship Fund of China Scholarship Council (201806155022).

Publisher Copyright:
© 2020 IEEE.

Keywords

  • Attention Mechanism
  • Fully Convolutional Neural Networks
  • Spatial Guidance
  • Video Object Segmentation

Fingerprint

Dive into the research topics of 'Distance-Guided Mask Propagation Model for Efficient Video Object Segmentation'. Together they form a unique fingerprint.

Cite this