Automatic Segmentation and Visualization of Choroid in OCT with Knowledge Infused Deep Learning
- 10 September 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 24 (12), 3408-3420
- https://doi.org/10.1109/jbhi.2020.3023144
Abstract
The choroid provides oxygen and nourishment to the outer retina thus is related to the pathology of various ocular diseases. Optical coherence tomography (OCT) is advantageous in visualizing and quantifying the choroid in vivo, because it does not suffer from the information contamination of the inner retina in fundus photography and scanning laser ophthalmoscopy, and the resolution deficiency in ocular ultrasound. However, its application in the study of the choroid is still limited for two reasons. (1) The lower boundary of the choroid (choroid-sclera interface) in OCT is fuzzy, which makes the automatic segmentation difficult and inaccurate. (2) The visualization of the choroid is hindered by the vessel shadows from the superficial layers of the inner retina. In this paper, we propose to incorporate medical and imaging prior knowledge with deep learning to address these two problems. We propose a biomarker infused global-to-local network, for the choroid segmentation. It leverages the thickness of the choroid layer, which is a primary biomarker in clinic, as a constraint to improve the segmentation accuracy. We also design a global-to-local strategy in the choroid segmentation: a global module is used to segment all the retinal and choroidal layers simultaneously for suppressing overfitting and providing global structure information, then a local module is used to refine the segmentation with the biomarker infusion. For eliminating the retinal vessel shadows, we propose a deep learning pipeline, which firstly use anatomical and OCT imaging knowledge to locate the shadows using their projection on the retinal pigment epthelium layer, then the contents of the choroidal vasculature at the shadow locations are predicted with an edge-to-texture two-stage generative adversarial inpainting network. The experiments shows the proposed method outperforms the existing methods on both the segmentation and shadow elimination tasks. We further apply the proposed method in a clinical prospective study for understanding the pathology of glaucoma, which demonstrates its capacity in detecting the structure and vascular changes of the choroid related to the elevation of intra-ocular pressure.Keywords
Funding Information
- Ningbo 2025 S&T Megaprojects (2019B10033)
- Natural Science Foundation of Zhejiang Province (LQ19H180001)
- Ningbo Public Welfare Science, and Technology (2018C50049)
This publication has 71 references indexed in Scilit:
- Enhancement of Lamina Cribrosa Visibility in Optical Coherence Tomography Images Using Adaptive CompensationInvestigative Ophthalmology & Visual Science, 2013
- Semiautomated Segmentation of the Choroid in Spectral-Domain Optical Coherence Tomography Volume ScansInvestigative Ophthalmology & Visual Science, 2013
- Automatic segmentation of the choroid in enhanced depth imaging optical coherence tomography imagesBiomedical Optics Express, 2013
- Quantitative OCT angiography of optic nerve head blood flowBiomedical Optics Express, 2012
- Automated Segmentation of the Choroid from Clinical SD-OCTInvestigative Ophthalmology & Visual Science, 2012
- CHOROIDAL THICKNESS IN PATIENTS WITH DIABETIC RETINOPATHY ANALYZED BY SPECTRAL-DOMAIN OPTICAL COHERENCE TOMOGRAPHYRetina, 2012
- Shadow Removal and Contrast Enhancement in Optical Coherence Tomography Images of the Human Optic Nerve HeadInvestigative Ophthalmology & Visual Science, 2011
- Fast Image Inpainting Based on Coherence TransportJournal of Mathematical Imaging and Vision, 2007
- Ethnic differences in primary angle-closure glaucomaCurrent Opinion in Opthalmology, 2006
- Region Filling and Object Removal by Exemplar-Based Image InpaintingIEEE Transactions on Image Processing, 2004