Deformation driven Seq2Seq longitudinal tumor and organs‐at‐risk prediction for radiotherapy
- 3 August 2021
- journal article
- research article
- Published by Wiley in Medical Physics
- Vol. 48 (9), 4784-4798
- https://doi.org/10.1002/mp.15075
Abstract
Purpose Radiotherapy presents unique challenges and clinical requirements for longitudinal tumor and organ-at-risk (OAR) prediction during treatment. The challenges include tumor inflammation/edema and radiation-induced changes in organ geometry, whereas the clinical requirements demand exibility in input/output sequence timepoints to update the predictions on rolling basis and the grounding of all predictions in relationship to the pre-treatment imaging information for response and toxicity assessment in adaptive radiotherapy. Methods To deal with the aforementioned challenges and to comply with the clinical requirements, we present a novel 3D sequence-to-sequence model based on Convolution Long Short Term Memory (ConvLSTM) that makes use of series of deformation vector fields (DVF) between individual timepoints and reference pre-treatment/planning CTs to predict future anatomical deformations and changes in gross tumor volume as well as critical OARs. High-quality DVF training data is created by employing hyper-parameter optimization on the subset of the training data with DICE coefficient and mutual information metric. We validated our model on two radiotherapy datasets: a publicly available head-and-neck dataset (28 patients with manually contoured pre-, mid-, and post-treatment CTs), and an internal non-small cell lung cancer dataset (63 patients with manually contoured planning CT and 6 weekly CBCTs). Results The use of DVF representation and skip connections overcomes the blurring issue of ConvL-STM prediction with the traditional image representation. The mean and standard deviation of DICE for predictions of lung GTV at week 4, 5, and 6 were 0.83±0.09, 0.82±0.08, and 0.81±0.10, respectively, and for post-treatment ipsilateral and contralateral parotids, were 0.81±0.06 and 0.85±0.02. Conclusion We presented a novel DVF based Seq2Seq model for medical images, leveraging the complete 3D imaging information of a relatively large longitudinal clinical dataset, to carry out longitudinal GTV/OAR predictions for anatomical changes in HN and lung radiotherapy patients, which has potential to improve RT outcomes.Keywords
Other Versions
Funding Information
- Varian Medical Systems
- Memorial Sloan-Kettering Cancer Center
This publication has 36 references indexed in Scilit:
- Identifying patients who may benefit from adaptive radiotherapy: Does the literature on anatomic and dosimetric changes in head and neck organs at risk during radiotherapy provide information to help?Radiotherapy and Oncology, 2015
- Morphometry-based measurements of the structural response to whole-brain radiationInternational Journal of Computer Assisted Radiology and Surgery, 2014
- Deformable Image Registration for Adaptive Radiation Therapy of Head and Neck Cancer: Accuracy and Precision in the Presence of Tumor ChangesEndocrine, 2014
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine TranslationPublished by Association for Computational Linguistics (ACL) ,2014
- Adaptive radiotherapy for head and neck cancer—Dosimetric results from a prospective clinical trialRadiotherapy and Oncology, 2013
- Image-guided radiotherapy: from current concept to future perspectivesNature Reviews Clinical Oncology, 2012
- A reproducible evaluation of ANTs similarity metric performance in brain image registrationNeuroImage, 2011
- Weight Loss During Radiotherapy for Head and Neck Malignancies: What Factors Impact It?Nutrition and Cancer, 2003
- A Unified Statistical Approach to Deformation-Based MorphometryNeuroImage, 2001
- Long Short-Term MemoryNeural Computation, 1997