Detection and segmentation of morphologically complex eukaryotic cells in fluorescence microscopy images via feature pyramid fusion
Open Access
- 8 September 2020
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLoS Computational Biology
- Vol. 16 (9), e1008179
- https://doi.org/10.1371/journal.pcbi.1008179
Abstract
Detection and segmentation of macrophage cells in fluorescence microscopy images is a challenging problem, mainly due to crowded cells, variation in shapes, and morphological complexity. We present a new deep learning approach for cell detection and segmentation that incorporates previously learned nucleus features. A novel fusion of feature pyramids for nucleus detection and segmentation with feature pyramids for cell detection and segmentation is used to improve performance on a microscopic image dataset created by us and provided for public use, containing both nucleus and cell signals. Our experimental results indicate that cell detection and segmentation performance significantly benefit from the fusion of previously learned nucleus features. The proposed feature pyramid fusion architecture clearly outperforms a state-of-the-art Mask R-CNN approach for cell detection and segmentation with relative mean average precision improvements of up to 23.88% and 23.17%, respectively. To analyze cell infection and changes in cell morphology in fluorescence microscopy images, proper cell detection and segmentation are required. In automated fluorescence microscopy image analysis, the separation of signals in close proximity is a challenging problem. High cell densities or cluster formations increase the probability of such situations on the cellular level. Another limitation is the detection of morphologically complex cells, such as macrophages or neurons. Their indefinite morphology causes identification issues when looking for slight variations of fixed shapes. Compared to merely segmenting cytoplasm, instance-based segmentation is a much harder task, since the assignment of a cell instance identity to every pixel of the image is required. We present a new deep learning approach for cell detection and segmentation that efficiently utilizes the nucleus channel for improving segmentation and detection performance of cells by incorporating previously learned nucleus features. This is achieved by a fusion of feature pyramids for nucleus detection and segmentation. The performance is evaluated on a microscopic image dataset, containing both nucleus and cell signals.Funding Information
- HMWK
- DFG (SFB/TR-84 TP C01)
- BMBF (e:Med CAPSYS, JPI-AMR, ERACoSysMed2 - 357 SysMed-COPD)
This publication has 36 references indexed in Scilit:
- U-Net: Convolutional Networks for Biomedical Image SegmentationPublished by Springer Science and Business Media LLC ,2015
- Fully convolutional networks for semantic segmentationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- High-Throughput Sequencing TechnologiesMolecular Cell, 2015
- Accurate segmentation of touching cells in multi-channel microscopy images with geodesic distance based clusteringNeurocomputing, 2015
- Accurate cell segmentation in microscopy images using membrane patternsBioinformatics, 2014
- Fast, accurate reconstruction of cell lineages from large-scale fluorescence microscopy dataNature Methods, 2014
- Fiji: an open-source platform for biological-image analysisNature Methods, 2012
- Measurement of TLR-Induced Macrophage Spreading by Automated Image Analysis: Differential Role of Myd88 and MAPK in Early and Late ResponsesFrontiers in Physiology, 2011
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- A high‐throughput system for segmenting nuclei using multiscale techniquesCytometry Part A, 2008