Synthesis of Mammogram From Digital Breast Tomosynthesis Using Deep Convolutional Neural Network With Gradient Guided cGANs
- 7 April 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 40 (8), 2080-2091
- https://doi.org/10.1109/tmi.2021.3071544
Abstract
Synthetic digital mammography (SDM), a 2D image generated from digital breast tomosynthesis (DBT), is used as a potential substitute for full-field digital mammography (FFDM) in clinic to reduce the radiation dose for breast cancer screening. Previous studies exploited projection geometry and fused projection data and DBT volume, with different post-processing techniques applied on re-projection data which may generate different image appearance compared to FFDM. To alleviate this issue, one possible solution to generate an SDM image is using a learning-based method to model the transformation from the DBT volume to the FFDM image using current DBT/FFDM combo images. In this study, we proposed to use a deep convolutional neural network (DCNN) to learn the transformation to generate SDM using current DBT/FFDM combo images. Gradient guided conditional generative adversarial networks (GGGAN) objective function was designed to preserve subtle MCs and the perceptual loss was exploited to improve the performance of the proposed DCNN on perceptual quality. We used various image quality criteria for evaluation, including preserving masses and MCs which are important in mammogram. Experiment results demonstrated progressive performance improvement of network using different objective functions in terms of those image quality criteria. The methodology we exploited in the SDM generation task to analyze and progressively improve image quality by designing objective functions may be helpful to other image generation tasks.Funding Information
- China Department of Science and Technology (2018YFC1704206, 2016YFB0200602)
- NSFC (81971691, 81801809, 81830052, 81827802, U1811461, 11401601)
- Science and Technology Program of Guangzhou (201804020053)
- Science and Technology Innovative Project of Guangdong Province (2016B030307003, 2015B010110003, 2015B020233008)
- Science and Technology Program of Guangzhou (201906010014)
- Department of Science and Technology of Jilin Province (20190302108GX)
- Guangdong Provincial Science and Technology (2017B020210001)
- Guangzhou Science and Technology Creative (201604020003)
- Guangdong Province Key Laboratory of Computational Science Open (2018009)
- Construction Project of Shanghai Key Laboratory of Molecular Imaging (18DZ2260400)
- US National Science Foundation (DMS-1912958)
- Guangdong Province Key Laboratory of Computational Science at Sun Yat-sen University (2020B1212060032)
This publication has 35 references indexed in Scilit:
- Accuracy of Digital Breast Tomosynthesis for Depicting Breast Cancer Subgroups in a UK Retrospective Reading Study (TOMMY Trial)Radiology, 2015
- Multiscale bilateral filtering for improving image quality in digital breast tomosynthesisMedical Physics, 2015
- Review of radiation dose estimates in digital breast tomosynthesis relative to those in two-view full-field digital mammographyThe Breast, 2014
- Two-View Digital Breast Tomosynthesis Screening with Synthetically Reconstructed Projection Images: Comparison with Digital Breast Tomosynthesis with Full-Field Digital Mammographic ImagesRadiology, 2014
- Mass detection in reconstructed digital breast tomosynthesis volumes with a computer‐aided detection system trained on 2D mammogramsMedical Physics, 2013
- Detection and Classification of Calcifications on Digital Breast Tomosynthesis and 2D Digital Mammography: A ComparisonAmerican Journal of Roentgenology, 2011
- Selective‐diffusion regularization for enhancement of microcalcifications in digital breast tomosynthesis reconstructionMedical Physics, 2010
- Thick Slices from Tomosynthesis Data Sets: Phantom Study for the Evaluation of Different AlgorithmsJournal of Digital Imaging, 2007
- Computer aided detection of clusters of microcalcifications on full field digital mammogramsMedical Physics, 2006
- Computer‐aided detection of mammographic microcalcifications: Pattern recognition with an artificial neural networkMedical Physics, 1995