Detail-recovery Image Deraining via Context Aggregation Networks

Sen DENG, Mingqiang WEI*, Jun WANG, Yidan FENG, Haoran XIE*, Luming LIANG, Fu Lee WANG, Meng WANG

*Corresponding author for this work

Research output: Book Chapters | Papers in Conference ProceedingsConference paper (refereed)Researchpeer-review

160 Citations (Scopus)

Abstract


This paper looks at this intriguing question: are single images with their details lost during deraining, reversible to their artifact-free status? We propose an end-to-end detail-recovery image deraining network (termed a DRDNet) to solve the problem. Unlike existing image deraining approaches that attempt to meet the conflicting goal of simultaneously deraining and preserving details in a unified framework, we propose to view rain removal and detail recovery as two seperate tasks, so that each part could specialize rather than trade-off between two conflicting goals. Specifically, we introduce two parallel sub-networks with a comprehensive loss function which synergize to derain and recover the lost details caused by deraining. For complete rain removal, we present a rain residual network with the squeeze-and-excitation (SE) operation to remove rain streaks from the rainy images. For detail recovery, we construct a specialized detail repair network consisting of welldesigned blocks, named structure detail context aggregation block (SDCAB), to encourage the lost details to return for eliminating image degradations. Moreover, the detail recovery branch of our proposed detail repair framework is detachable and can be incorporated into existing deraining methods to boost their performances. DRD-Net has been validated on several well-known benchmark datasets in terms of deraining robustness and detail accuracy. Comparisons show clear visual and numerical improvements of our method over the state-of-the-arts.
Original languageEnglish
Title of host publicationProceedings of the Conference on Computer Vision and Pattern Recognition 2020 (CVPR 2020)
Pages14560-14569
Number of pages10
DOIs
Publication statusPublished - 14 Jun 2020
EventThe IEEE/CVF Conference on Computer Vision and Pattern Recognition 2020 - Online
Duration: 14 Jun 202019 Jun 2020
http://cvpr2020.thecvf.com/

Public Lecture

Public LectureThe IEEE/CVF Conference on Computer Vision and Pattern Recognition 2020
Abbreviated titleCVPR2020
Period14/06/2019/06/20
Internet address

Funding

This work was supported by the National Natural Science Foundation of China (No. 61502137, No. 61772267), the HKIBS Research Seed Fund 2019/20 (No. 190-009), the Research Seed Fund (No. 102367) of Lingnan University, Hong Kong, the Fundamental Research Funds for the Central Universities (No. NE2016004), and the Natural Science Foundation of Jiangsu Province (No. BK20190016).

Fingerprint

Dive into the research topics of 'Detail-recovery Image Deraining via Context Aggregation Networks'. Together they form a unique fingerprint.

Cite this