Deep Pyramid Network for Low-Light Endoscopic Image Enhancement

Guanghui YUE, Jie GAO, Runmin CONG, Tianwei ZHOU*, Leida LI, Tianfu WANG

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

Abstract

Endoscopic images captured under low-light enclosed intestinal environment usually have poor visibility (manifested as uneven illumination and noise), affecting the work efficiency of physicians and the accuracy of lesion detection. To improve the image quality, the literature has reported many low-light image enhancement (LIE) methods. However, most methods do not perform well in handling the low-light endoscopic image enhancement (LEIE) task, usually bringing additional artifacts or amplifying noise. In this paper, we propose a novel deep pyramid enhancement network (DPENet) to enhance endoscopic images from both global and local perspectives. Specifically, considering the uneven illumination of endoscopic images, DPENet utilizes an image pyramid framework with three parallel branches to explore and integrate both global and local features at different scales. To suppress noise, DPENet sets multiple scale-space feature extraction blocks (SFEBs) in each branch. SFEB consists of a contextual feature extraction module (CFEM) and a spatial residual attention module (SRAM). CFEM mines contextual information to help the network understand semantic information while suppress the isolated noise. SRAM leverages the spatial attention mechanism to help the network adaptively focus on dim regions. Experimental results on a public dataset and our collected dataset show that DPENet is competent for the LEIE task with promising results, and outperforms 9 state-of-the-art LIE methods in both qualitative and quantitative aspects.

Original languageEnglish
Pages (from-to)3834-3845
Number of pages12
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume34
Issue number5
Early online date9 Oct 2023
DOIs
Publication statusPublished - May 2024
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 1991-2012 IEEE.

Keywords

  • deep pyramid network
  • endoscopic image
  • Image enhancement
  • image quality

Fingerprint

Dive into the research topics of 'Deep Pyramid Network for Low-Light Endoscopic Image Enhancement'. Together they form a unique fingerprint.

Cite this