Weakly Supervised Deep Nuclei Segmentation Using Partial Points Annotation in Histopathology Images
Top Cited Papers
- 15 June 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 39 (11), 3655-3666
- https://doi.org/10.1109/tmi.2020.3002244
Abstract
Nuclei segmentation is a fundamental task in histopathology image analysis. Typically, such segmentation tasks require significant effort to manually generate accurate pixel-wise annotations for fully supervised training. To alleviate such tedious and manual effort, in this paper we propose a novel weakly supervised segmentation framework based on partial points annotation, i.e., only a small portion of nuclei locations in each image are labeled. The framework consists of two learning stages. In the first stage, we design a semi-supervised strategy to learn a detection model from partially labeled nuclei locations. Specifically, an extended Gaussian mask is designed to train an initial model with partially labeled data. Then, self-training with background propagation is proposed to make use of the unlabeled regions to boost nuclei detection and suppress false positives. In the second stage, a segmentation model is trained from the detected nuclei locations in a weakly-supervised fashion. Two types of coarse labels with complementary information are derived from the detected points and are then utilized to train a deep neural network. The fully-connected conditional random field loss is utilized in training to further refine the model without introducing extra computational complexity during inference. The proposed method is extensively evaluated on two nuclei segmentation datasets. The experimental results demonstrate that our method can achieve competitive performance compared to the fully supervised counterpart and the state-of-the-art methods while requiring significantly less annotation effort.Funding Information
- NSF (1763523, 1747778, 1733843, 1703883)
This publication has 41 references indexed in Scilit:
- High-throughput histopathological image analysis via robust cell segmentation and hashingMedical Image Analysis, 2015
- Robust Cell Detection and Segmentation in Histopathological Images Using Sparse Reconstruction and Stacked Denoising AutoencodersLecture Notes in Computer Science, 2015
- Beyond Classification: Structured Regression for Robust Cell Detection Using Convolutional Neural NetworkLecture Notes in Computer Science, 2015
- U-Net: Convolutional Networks for Biomedical Image SegmentationPublished by Springer Science and Business Media LLC ,2015
- Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology ImagesIEEE Transactions on Medical Imaging, 2015
- A Stochastic Polygons Model for Glandular Structures in Colon Histology ImagesIEEE Transactions on Medical Imaging, 2015
- Towards Large-Scale Histopathological Image Analysis: Hashing-Based Image RetrievalIEEE Transactions on Medical Imaging, 2014
- Automatic Nuclei Segmentation in H&E Stained Breast Cancer Histopathology ImagesPLOS ONE, 2013
- Fast High‐Dimensional Filtering Using the Permutohedral LatticeComputer Graphics Forum, 2010
- Color transfer between imagesIEEE Computer Graphics and Applications, 2001