TEMImageNet training library and AtomSegNet deep-learning models for high-precision atom segmentation, localization, denoising, and deblurring of atomic-resolution images
Top Cited Papers
Open Access
- 8 March 2021
- journal article
- research article
- Published by Springer Science and Business Media LLC in Scientific Reports
- Vol. 11 (1), 1-15
- https://doi.org/10.1038/s41598-021-84499-w
Abstract
Atom segmentation and localization, noise reduction and deblurring of atomic-resolution scanning transmission electron microscopy (STEM) images with high precision and robustness is a challenging task. Although several conventional algorithms, such has thresholding, edge detection and clustering, can achieve reasonable performance in some predefined sceneries, they tend to fail when interferences from the background are strong and unpredictable. Particularly, for atomic-resolution STEM images, so far there is no well-established algorithm that is robust enough to segment or detect all atomic columns when there is large thickness variation in a recorded image. Herein, we report the development of a training library and a deep learning method that can perform robust and precise atom segmentation, localization, denoising, and super-resolution processing of experimental images. Despite using simulated images as training datasets, the deep-learning model can self-adapt to experimental STEM images and shows outstanding performance in atom detection and localization in challenging contrast conditions and the precision consistently outperforms the state-of-the-art two-dimensional Gaussian fit method. Taking a step further, we have deployed our deep-learning models to a desktop app with a graphical user interface and the app is free and open-source. We have also built a TEM ImageNet project website for easy browsing and downloading of the training data.Funding Information
- U.S. Department of Energy (DE-SC0012704, DE-SC0021204)
- University of California, Irvine (Startup)
This publication has 30 references indexed in Scilit:
- Picometre-precision analysis of scanning transmission electron microscopy images of platinum nanocatalystsNature Communications, 2014
- Robust level set image segmentation via a local correntropy-based K-means clusteringPattern Recognition, 2014
- Region-based image segmentation with local signed difference energyPattern Recognition Letters, 2013
- Machine learning in cell biology – teaching computers to recognize phenotypesJournal of Cell Science, 2013
- Channeling of a subangstrom electron beam in a crystal mapped to two-dimensional molecular orbitalsPhysical Review B, 2012
- A survey of graph theoretical approaches to image segmentationPattern Recognition, 2012
- STEM imaging of 47-pm-separated atomic columns by a spherical aberration-corrected electron microscope with a 300-kV cold field emission gunJournal of Electron Microscopy, 2009
- Atomic-Resolution Imaging with a Sub-50-pm Electron ProbePhysical Review Letters, 2009
- GPU implementation of neural networksPattern Recognition, 2004
- An edge detection technique using genetic algorithm-based optimizationPattern Recognition, 1994