Boundary Constraint Network With Cross Layer Feature Integration for Polyp Segmentation

Guanghui YUE, Wanwan HAN, Bin JIANG, Tianwei ZHOU*, Runmin CONG, Tianfu WANG

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

41 Citations (Scopus)


Clinically, proper polyp localization in endoscopy images plays a vital role in the follow-up treatment (e.g., surgical planning). Deep convolutional neural networks (CNNs) provide a favoured prospect for automatic polyp segmentation and evade the limitations of visual inspection, e.g., subjectivity and overwork. However, most existing CNNs-based methods often provide unsatisfactory segmentation performance. In this paper, we propose a novel boundary constraint network, namely BCNet, for accurate polyp segmentation. The success of BCNet benefits from integrating cross-level context information and leveraging edge information. Specifically, to avoid the drawbacks caused by simple feature addition or concentration, BCNet applies a cross-layer feature integration strategy (CFIS) in fusing the features of the top-three highest layers, yielding a better performance. CFIS consists of three attention-driven cross-layer feature interaction modules (ACFIMs) and two global feature integration modules (GFIMs). ACFIM adaptively fuses the context information of the top-three highest layers via the self-attention mechanism instead of direct addition or concentration. GFIM integrates the fused information across layers with the guidance from global attention. To obtain accurate boundaries, BCNet introduces a bilateral boundary extraction module that explores the polyp and non-polyp information of the shallow layer collaboratively based on the high-level location information and boundary supervision. Through joint supervision of the polyp area and boundary, BCNet is able to get more accurate polyp masks. Experimental results on three public datasets show that the proposed BCNet outperforms seven state-of-the-art competing methods in terms of both effectiveness and generalization.

Original languageEnglish
Pages (from-to)4090-4099
Number of pages10
JournalIEEE Journal of Biomedical and Health Informatics
Issue number8
Early online date10 May 2022
Publication statusPublished - Aug 2022
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2013 IEEE.


  • boundary constraint
  • cross-layer feature integration
  • deep network
  • endoscope
  • Polyp segmentation


Dive into the research topics of 'Boundary Constraint Network With Cross Layer Feature Integration for Polyp Segmentation'. Together they form a unique fingerprint.

Cite this