GlassNet : Label Decoupling‐based Three‐stream Neural Network for Robust Image Glass Detection

Chengyu ZHENG, Ding SHI, Xuefeng YAN, Dong LIANG, Mingqiang WEI, Xin YANG, Yanwen GUO, Haoran XIE

Research output: Journal PublicationsJournal Article (refereed)peer-review

Abstract

Most of the existing object detection methods generate poor glass detection results, due to the fact that the transparent glass shares the same appearance with arbitrary objects behind it in an image. Different from traditional deep learning-based wisdoms that simply use the object boundary as an auxiliary supervision, we exploit label decoupling to decompose the original labelled ground-truth (GT) map into an interior-diffusion map and a boundary-diffusion map. The GT map in collaboration with the two newly generated maps breaks the imbalanced distribution of the object boundary, leading to improved glass detection quality. We have three key contributions to solve the transparent glass detection problem: (1) We propose a three-stream neural network (call GlassNet for short) to fully absorb beneficial features in the three maps. (2) We design a multi-scale interactive dilation module to explore a wider range of contextual information. (3) We develop an attention-based boundary-aware feature Mosaic module to integrate multi-modal information. Extensive experiments on the benchmark dataset exhibit clear improvements of our method over SOTAs, in terms of both the overall glass detection accuracy and boundary clearness.
Original languageEnglish
Pages (from-to)377-388
Number of pages12
JournalComputer Graphics Forum
Volume41
Issue number1
Early online date8 Jan 2022
DOIs
Publication statusPublished - Feb 2022

Bibliographical note

Funding Information:
This work was supported in part by the National Natural Science Foundation of China (Nos. 62032011, 62172218), in part by the Joint Fund of National Natural Science Foundation of China and Civil Aviation Administration of China (No. U2033202), in part by the Free Exploration of Basic Research Project, Local Science and Technology Development Fund Guided by the Central Government of China (No. 2021Szvup060) and in part by the Key Program of Jiangsu Provincial Department of Culture and Tourism (No. 20ZD06).

Publisher Copyright:
© 2022 Eurographics - The European Association for Computer Graphics and John Wiley & Sons Ltd

Keywords

  • image processing
  • image and video processing
  • image segmentation
  • computer vision-shape recognition
  • methods and applications

Fingerprint

Dive into the research topics of 'GlassNet : Label Decoupling‐based Three‐stream Neural Network for Robust Image Glass Detection'. Together they form a unique fingerprint.

Cite this