UHR-DeepFMT: Ultra-High Spatial Resolution Reconstruction of Fluorescence Molecular Tomography Based on 3-D Fusion Dual-Sampling Deep Neural Network

Abstract

Fluorescence molecular tomography (FMT) is a promising and high sensitivity imaging modality that can reconstruct the three-dimensional (3D) distribution of interior fluorescent sources. However, the spatial resolution of FMT has encountered an insurmountable bottleneck and cannot be substantially improved, due to the simplified forward model and the severely ill-posed inverse problem. In this work, a 3D fusion dual-sampling convolutional neural network, namely UHR-DeepFMT, was proposed to achieve ultra-high spatial resolution reconstruction of FMT. Under this framework, the UHR-DeepFMT does not need to explicitly solve the FMT forward and inverse problems. Instead, it directly establishes an end-to-end mapping model to reconstruct the fluorescent sources, which can enormously eliminate the modeling errors. Besides, a novel fusion mechanism that integrates the dual-sampling strategy and the squeeze-and-excitation (SE) module is introduced into the skip connection of UHR-DeepFMT, which can significantly improve the spatial resolution by greatly alleviating the ill-posedness of the inverse problem. To evaluate the performance of UHR-DeepFMT network model, numerical simulations, physical phantom and in vivo experiments were conducted. The results demonstrated that the proposed UHR-DeepFMT can outperform the cutting-edge methods and achieve ultra-high spatial resolution reconstruction of FMT with the powerful ability to distinguish adjacent targets with a minimal edge-to-edge distance (EED) of 0.5 mm. It is assumed that this research is a significant improvement for FMT in terms of spatial resolution and overall imaging quality, which could promote the precise diagnosis and preclinical application of small animals in the future.