Rapid image deconvolution and multiview fusion for optical microscopy
Open Access
- 29 June 2020
- journal article
- research article
- Published by Springer Science and Business Media LLC in Nature Biotechnology
- Vol. 38 (11), 1337-1346
- https://doi.org/10.1038/s41587-020-0560-x
Abstract
The contrast and resolution of images obtained with optical microscopes can be improved by deconvolution and computational fusion of multiple views of the same sample, but these methods are computationally expensive for large datasets. Here we describe theoretical and practical advances in algorithm and software design that result in image processing times that are tenfold to several thousand fold faster than with previous methods. First, we show that an ‘unmatched back projector’ accelerates deconvolution relative to the classic Richardson–Lucy algorithm by at least tenfold. Second, three-dimensional image-based registration with a graphics processing unit enhances processing speed 10- to 100-fold over CPU processing. Third, deep learning can provide further acceleration, particularly for deconvolution with spatially varying point spread functions. We illustrate our methods from the subcellular to millimeter spatial scale on diverse samples, including single cells, embryos and cleared tissue. Finally, we show performance enhancement on recently developed microscopes that have improved spatial resolution, including dual-view cleared-tissue light-sheet microscopes and reflective lattice light-sheet microscopes.Keywords
This publication has 60 references indexed in Scilit:
- ImgLib2—generic image processing in JavaBioinformatics, 2012
- Prickle1b mediates interpretation of migratory cues during zebrafish facial branchiomotor neuron migrationDevelopmental Dynamics, 2010
- A robust and high-throughput Cre reporting and characterization system for the whole mouse brainNature Neuroscience, 2009
- DEX-1 and DYF-7 Establish Sensory Dendrite Length by Anchoring Dendritic Tips during Cell MigrationCell, 2009
- Globally optimal stitching of tiled 3D microscopic image acquisitionsBioinformatics, 2009
- CNS-derived glia ensheath peripheral nerves and mediate motor root developmentNature Neuroscience, 2008
- Surpassing the lateral resolution limit by a factor of two using structured illumination microscopyJournal of Microscopy, 2000
- Stages of embryonic development of the zebrafishDevelopmental Dynamics, 1995
- An iterative technique for the rectification of observed distributionsThe Astronomical Journal, 1974
- Bayesian-Based Iterative Method of Image Restoration*Journal of the Optical Society of America, 1972