Image Segmentation of the Ventricular Septum in Fetal Cardiac Ultrasound Videos Based on Deep Learning Using Time-Series Information
Open Access
- 7 November 2020
- journal article
- research article
- Published by MDPI AG in Biomolecules
- Vol. 10 (11), 1526
- https://doi.org/10.3390/biom10111526
Abstract
Image segmentation is the pixel-by-pixel detection of objects, which is the most challenging but informative in the fundamental tasks of machine learning including image classification and object detection. Pixel-by-pixel segmentation is required to apply machine learning to support fetal cardiac ultrasound screening; we have to detect cardiac substructures precisely which are small and change shapes dynamically with fetal heartbeats, such as the ventricular septum. This task is difficult for general segmentation methods such as DeepLab v3+, and U-net. Hence, here we proposed a novel segmentation method named Cropping-Segmentation-Calibration (CSC) that is specific to the ventricular septum in ultrasound videos in this study. CSC employs the time-series information of videos and specific section information to calibrate the output of U-net. The actual sections of the ventricular septum were annotated in 615 frames from 421 normal fetal cardiac ultrasound videos of 211 pregnant women who were screened. The dataset was assigned a ratio of 2:1, which corresponded to a ratio of the training to test data, and three-fold cross-validation was conducted. The segmentation results of DeepLab v3+, U-net, and CSC were evaluated using the values of the mean intersection over union (mIoU), which were 0.0224, 0.1519, and 0.5543, respectively. The results reveal the superior performance of CSC.This publication has 27 references indexed in Scilit:
- Retinal vessel segmentation via deep learning network and fully-connected conditional random fieldsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- Marginal Space Deep Learning: Efficient Architecture for Volumetric Image ParsingIEEE Transactions on Medical Imaging, 2016
- Brain Tumor Segmentation Using Convolutional Neural Networks in MRI ImagesIEEE Transactions on Medical Imaging, 2016
- U-Net: Convolutional Networks for Biomedical Image SegmentationPublished by Springer Science and Business Media LLC ,2015
- Diagnosis and Treatment of Fetal Cardiac DiseaseCirculation, 2014
- Congenital Heart Defects in EuropeCirculation, 2011
- Racial differences by gestational age in neonatal deaths attributable to congenital heart defects --- United States, 2003-2006.2010
- Twenty-year trends in diagnosis of life-threatening neonatal cardiovascular malformationsArchives of Disease in Childhood: Fetal & Neonatal, 2008
- The incidence of congenital heart diseaseJournal of the American College of Cardiology, 2002
- Infant mortality and congenital anomalies from 1950 to 1994: an international perspectiveJournal of Epidemiology and Community Health, 2000