Contrastive Semantic‐Guided Image Smoothing Network

Jie WANG, Yongzhen WANG, Yidan FENG, Lina GONG, Xuefeng YAN, Haoran XIE*, Fu Lee WANG, Mingqiang WEI*

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

1 Citation (Scopus)

Abstract

Image smoothing is a fundamental low-level vision task that aims to preserve salient structures of an image while removing insignificant details. Deep learning has been explored in image smoothing to deal with the complex entanglement of semantic structures and trivial details. However, current methods neglect two important facts in smoothing: 1) naive pixel-level regression supervised by the limited number of high-quality smoothing ground-truth could lead to domain shift and cause generalization problems towards real-world images; 2) texture appearance is closely related to object semantics, so that image smoothing requires awareness of semantic difference to apply adaptive smoothing strengths. To address these issues, we propose a novel Contrastive Semantic-Guided Image Smoothing Network (CSGIS-Net) that combines both contrastive prior and semantic prior to facilitate robust image smoothing. The supervision signal is augmented by leveraging undesired smoothing effects as negative teachers, and by incorporating segmentation tasks to encourage semantic distinctiveness. To realize the proposed network, we also enrich the original VOC dataset with texture enhancement and smoothing labels, namely VOC-smooth, which first bridges image smoothing and semantic segmentation. Extensive experiments demonstrate that the proposed CSGIS-Net outperforms state-of-the-art algorithms by a large margin. Code and dataset are available at https://github.com/wangjie6866/CSGIS-Net.
Original languageEnglish
Pages (from-to)335-346
Number of pages12
JournalComputer Graphics Forum
Volume41
Issue number7
DOIs
Publication statusPublished - Oct 2022

Bibliographical note

Funding Information:
This work was supported by the National Natural Science Foundation of China (No. 62172218), the Free Exploration of Basic Research Project, Local Science and Technology Development Fund Guided by the Central Government of China (No. 2021Szvup060), the Natural Science Foundation of Guangdong Province (No. 2022A1515010170), the Direct Grant (No. DR22A2) and the Research Grant entitled “Self‐Supervised Learning for Medical Images” (No. 871228) of Lingnan University, Hong Kong.

Publisher Copyright:
© 2022 The Author(s) Computer Graphics Forum © 2022 The Eurographics Association and John Wiley & Sons Ltd. Published by John Wiley & Sons Ltd.

Keywords

  • CCS Concepts
  • • Computing methodologies → Image processing

Fingerprint

Dive into the research topics of 'Contrastive Semantic‐Guided Image Smoothing Network'. Together they form a unique fingerprint.

Cite this