Unsupervised feature learning and clustering of particles imaged in raw holograms using an autoencoder
- 27 September 2021
- journal article
- research article
- Published by Optica Publishing Group in Journal of the Optical Society of America A
- Vol. 38 (10), 1570-1580
- https://doi.org/10.1364/josaa.424271
Abstract
Digital holography is a useful tool to image microscopic particles. Reconstructed holograms give high-resolution shape information that can be used to identify the types of particles. However, the process of reconstructing holograms is computationally intensive and cannot easily keep up with the rate of data acquisition on low-power sensor platforms. In this work, we explore the possibility of performing object clustering on holograms that have not been reconstructed, i.e., images of raw interference patterns, using the latent representations of a deep-learning autoencoder and a self-organizing mapping network in a fully unsupervised manner. We demonstrate this concept on synthetically generated holograms of different shapes, where clustering of raw holograms achieves an accuracy of 94.4%. This is comparable to the 97.4% accuracy achieved using the reconstructed holograms of the same targets. Directly clustering raw holograms takes less than 0.1 s per image using a low-power CPU board. This represents a three-order of magnitude reduction in processing time compared to clustering of reconstructed holograms and makes it possible to interpret targets in real time on low-power sensor platforms. Experiments on real holograms demonstrate significant gains in clustering accuracy through the use of synthetic holograms to train models. Clustering accuracy increased from 47.1% when the models were trained only on the real raw holograms, to 64.1% when the models were entirely trained on the synthetic raw holograms, and further increased to 75.9% when models were trained on the both synthetic and real datasets using transfer learning. These results are broadly comparable to those achieved when reconstructed holograms are used, where the highest accuracy of 70% achieved when clustering raw holograms outperforms the highest accuracy achieved when clustering reconstructed holograms by a significant margin for our datasets.Keywords
Funding Information
- Natural Environment Research Council
- Japan Science and Technology Agency (NE/R01227X/1)
This publication has 34 references indexed in Scilit:
- Stacked Denoise Autoencoder Based Feature Extraction and Classification for Hyperspectral ImagesJournal of Sensors, 2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Robust particle outline extraction and its application to digital in-line holograms of marine organismsOptical Engineering, 2014
- Essentials of the self-organizing mapNeural Networks, 2013
- Development and deployment of a point‐source digital inline holographic microscope for the study of plankton and particles to a depth of 6000 mLimnology and Oceanography: Methods, 2013
- The application of holography to the analysis of size and settling velocity of suspended cohesive sedimentsLimnology and Oceanography: Methods, 2010
- Underwater digital holography for studies of marine planktonPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2008
- Visualization of fast-moving cells in vivo using digital holographic video microscopyJournal of Biomedical Optics, 2008
- What is a support vector machine?Nature Biotechnology, 2006
- Comparing SOM neural network with Fuzzy c-means, K-means and traditional hierarchical clustering algorithmsEuropean Journal of Operational Research, 2006