Multitask 3D CBCT‐to‐CT translation and organs‐at‐risk segmentation using physics‐based data augmentation
- 9 August 2021
- journal article
- research article
- Published by Wiley in Medical Physics
- Vol. 48 (9), 5130-5141
- https://doi.org/10.1002/mp.15083
Abstract
Purpose In current clinical practice, noisy and artifact-ridden weekly cone-beam computed tomography (CBCT) images are only used for patient setup during radiotherapy. Treatment planning is done once at the beginning of the treatment using high-quality planning CT (pCT) images and manual contours for organs-at-risk (OARs) structures. If the quality of the weekly CBCT images can be improved while simultaneously segmenting OAR structures, this can provide critical information for adapting radiotherapy mid-treatment as well as for deriving biomarkers for treatment response. Methods Using a novel physics-based data augmentation strategy, we synthesize a large dataset of perfectly/inherently registered planning CT and synthetic-CBCT pairs for locally advanced lung cancer patient cohort, which are then used in a multitask 3D deep learning framework to simultaneously segment and translate real weekly CBCT images to high-quality planning CT-like images. Results We compared the synthetic CT and OAR segmentations generated by the model to real planning CT and manual OAR segmentations and showed promising results. The real week 1 (base-line) CBCT images which had an average MAE of 162.77 HU compared to pCT images are translated to synthetic CT images that exhibit a drastically improved average MAE of 29.31 HU and average structural similarity of 92% with the pCT images. The average DICE scores of the 3D organs-at-risk segmentations are: lungs 0.96, heart 0.88, spinal cord 0.83 and esophagus 0.66. Conclusions We demonstrate an approach to translate artifact-ridden CBCT images to high quality synthetic CT images while simultaneously generating good quality segmentation masks for different organs-at-risk. This approach could allow clinicians to adjust treatment plans using only the routine low-quality CBCT images, potentially improving patient outcomes. Our code, data, and pre-trained models will be made available via our physics-based data augmentation library, Physics-ArX, at https://github.com/nadeemlab/Physics-ArX.Keywords
This publication has 31 references indexed in Scilit:
- U-Net: Convolutional Networks for Biomedical Image SegmentationPublished by Springer Science and Business Media LLC ,2015
- A practical cone-beam CT scatter correction method with optimized Monte Carlo simulations for image-guided radiation therapyPhysics in Medicine & Biology, 2015
- Metal artifact correction for x‐ray computed tomography using kV and selective MV imagingMedical Physics, 2014
- Explicit B-spline regularization in diffeomorphic image registrationFrontiers in Neuroscience, 2013
- Consideration of Dose Limits for Organs at Risk of Thoracic Radiotherapy: Atlas for Lung, Proximal Bronchial Tree, Esophagus, Spinal Cord, Ribs, and Brachial PlexusEndocrine, 2011
- Beam hardening correction for a cone-beam CT system and its effect on spatial resolutionChinese Physics C, 2011
- Artefacts in CBCT: a reviewDento maxillo facial radiology, 2011
- kV Cone-Beam CT-Based IGRTStrahlentherapie und Onkologie, 2011
- Scatter correction for cone‐beam CT in radiation therapyMedical Physics, 2009
- Adaptive image contrast enhancement using generalizations of histogram equalizationIEEE Transactions on Image Processing, 2000