4D foetal cardiac ultrasound image detection based on deep learning with weakly supervised localisation for rapid diagnosis of evolving hypoplastic left heart syndrome

Gang WANG, Weisheng LI*, Mingliang ZHOU*, Haobo ZHU, Guang YANG, Choon Hwai YAP

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

Abstract

Hypoplastic left heart syndrome (HLHS) is a rare, complex, and incredibly foetal congenital heart disease. To decrease neonatal mortality, evolving HLHS (eHLHS) in pregnant women should be critically diagnosed as soon as possible. However, diagnosis is currently heavily dependent on skilled medical professionals using foetal cardiac ultrasound images, making it difficult to rapidly and easily examine for this disease. Herein, the authors propose a cost-effective deep learning framework for rapid diagnosis of eHLHS (RDeH), which we have named RDeH-Net. Briefly, the framework implements a coarse-to-fine two-stage detection approach, with a structure classification network for 4D human foetal cardiac ultrasound images from various spatial and temporal domains, and a fine detection module with weakly-supervised localisation for high-precision nidus localisation and physician assistance. The experiments extensively compare the authors’ network with other state-of-the-art methods on a 4D human foetal cardiac ultrasound image dataset and show two main benefits: (1) it achieved superior average accuracy of 99.37% on three categories of foetal ultrasound images from different cases; (2) it demonstrates visually fine detection performance with weakly supervised localisation. This framework could be used to accelerate the diagnosis of eHLHS, and hence significantly lessen reliance on experienced medical physicians.

Original languageEnglish
Number of pages14
JournalCAAI Transactions on Intelligence Technology
DOIs
Publication statusE-pub ahead of print - 7 Jun 2024
Externally publishedYes

Bibliographical note

ACKNOWLEDGEMENTS:
National Natural Science Foundation of China [Nos. 62331008, 62176027, 62027827, 62221005 and 62276040], Natural Science Foundation of Chongqing (Nos. 2023NSCQ-LZX0045, CSTB2022NSCQ-MSX0436 and cstc2020jcyjmsxmX0790), Ningbo Natural Science Foundation under Grant 2023J280, Ningbo Key R&D Program (No.2023Z231), Zhejiang Province Postdoctoral Research Funding Project (No. ZJ2023008), China Postdoctoral Science Foundation (No.2023M740741), Human Resources and Social Security Bureau Project of Chongqing (No. cx2020073); Guangdong Oppo Mobile Telecommunications Corporation Ltd (No. H20221694); UK Research and Innovation Future Leaders Fellowship (No. MR/V023799/1).

Keywords

  • deep learning
  • medical image processing

Fingerprint

Dive into the research topics of '4D foetal cardiac ultrasound image detection based on deep learning with weakly supervised localisation for rapid diagnosis of evolving hypoplastic left heart syndrome'. Together they form a unique fingerprint.

Cite this