SDDNet : Style-guided Dual-layer Disentanglement Network for Shadow Detection

Runmin CONG, Yuchen GUAN, Jinpeng CHEN*, Wei ZHANG, Yao ZHAO, Sam KWONG

*Corresponding author for this work

Research output: Book Chapters | Papers in Conference ProceedingsConference paper (refereed)Referred Conference Paperpeer-review

4 Citations (Scopus)

Abstract

Despite significant progress in shadow detection, current methods still struggle with the adverse impact of background color, which may lead to errors when shadows are present on complex backgrounds. Drawing inspiration from the human visual system, we treat the input shadow image as a composition of a background layer and a shadow layer, and design a Style-guided Dual-layer Disentanglement Network (SDDNet) to model these layers independently. To achieve this, we devise a Feature Separation and Recombination (FSR) module that decomposes multi-level features into shadow-related and background-related components by offering specialized supervision for each component, while preserving information integrity and avoiding redundancy through the reconstruction constraint. Moreover, we propose a Shadow Style Filter (SSF) module to guide the feature disentanglement by focusing on style differentiation and uniformization. With these two modules and our overall pipeline, our model effectively minimizes the detrimental effects of background color, yielding superior performance on three public datasets with a real-time inference speed of 32 FPS. Our code is publicly available at:https://github.com/rmcong/SDDNet-ACMMM23.

Original languageEnglish
Title of host publicationMM 2023 - Proceedings of the 31st ACM International Conference on Multimedia
PublisherAssociation for Computing Machinery (ACM)
Pages1202-1211
Number of pages10
ISBN (Electronic)9798400701085
ISBN (Print)9798400701085
DOIs
Publication statusPublished - 27 Oct 2023
EventThe 31st ACM International Conference on Multimedia - Ottawa, Canada
Duration: 29 Oct 20233 Nov 2023

Conference

ConferenceThe 31st ACM International Conference on Multimedia
Abbreviated titleMM '23
Country/TerritoryCanada
CityOttawa
Period29/10/233/11/23

Bibliographical note

Publisher Copyright:
© 2023 ACM.

Funding

This work was supported in part by the National Key R&D Program of China under Grant 2021ZD0112100, in part by the National Natural Science Foundation of China under Grant 62002014, Grant U1913204, Grant U1936212, Grant 62120106009, in part by the Taishan Scholar Project of Shandong Province under Grant tsqn202306079, in part by the Project for Self-Developed Innovation Team of Jinan City under Grant 2021GXRC038, in part by the Hong Kong Innovation and Technology Commission (InnoHK Project CIMDA), in part by the Hong Kong GRF-RGC General Research Fund under Grant 11203820 (9042598), in part by Young Elite Scientist Sponsorship Program by the China Association for Science and Technology under Grant 2020QNRC001, and in part by CAAI-Huawei MindSpore Open Fund.

Keywords

  • feature disentanglement
  • shadow detection
  • style constraint

Fingerprint

Dive into the research topics of 'SDDNet : Style-guided Dual-layer Disentanglement Network for Shadow Detection'. Together they form a unique fingerprint.

Cite this