Quantitative assessment of tumour extraction from dermoscopy images and evaluation of computer-based extraction methods for an automatic melanoma diagnostic system
- 1 April 2006
- journal article
- research article
- Published by Ovid Technologies (Wolters Kluwer Health) in Melanoma Research
- Vol. 16 (2), 183-190
- https://doi.org/10.1097/01.cmr.0000215041.76553.58
Abstract
The aims of this study were to provide a quantitative assessment of the tumour area extracted by dermatologists and to evaluate computer-based methods from dermoscopy images for refining a computer-based melanoma diagnostic system. Dermoscopic images of 188 Clark naevi, 56 Reed naevi and 75 melanomas were examined. Five dermatologists manually drew the border of each lesion with a tablet computer. The inter-observer variability was evaluated and the standard tumour area (STA) for each dermoscopy image was defined. Manual extractions by 10 non-medical individuals and by two computer-based methods were evaluated with STA-based assessment criteria: precision and recall. Our new computer-based method introduced the region-growing approach in order to yield results close to those obtained by dermatologists. The effectiveness of our extraction method with regard to diagnostic accuracy was evaluated. Two linear classifiers were built using the results of conventional and new computer-based tumour area extraction methods. The final diagnostic accuracy was evaluated by drawing the receiver operating curve (ROC) of each classifier, and the area under each ROC was evaluated. The standard deviations of the tumour area extracted by five dermatologists and 10 non-medical individuals were 8.9% and 10.7%, respectively. After assessment of the extraction results by dermatologists, the STA was defined as the area that was selected by more than two dermatologists. Dermatologists selected the melanoma area with statistically smaller divergence than that of Clark naevus or Reed naevus (P=0.05). By contrast, non-medical individuals did not show this difference. Our new computer-based extraction algorithm showed superior performance (precision, 94.1%; recall, 95.3%) to the conventional thresholding method (precision, 99.5%; recall, 87.6%). These results indicate that our new algorithm extracted a tumour area close to that obtained by dermatologists and, in particular, the border part of the tumour was adequately extracted. With this refinement, the area under the ROC increased from 0.795 to 0.875 and the diagnostic accuracy showed an increase of approximately 20% in specificity when the sensitivity was 80%. It can be concluded that our computer-based tumour extraction algorithm extracted almost the same area as that obtained by dermatologists and provided improved computer-based diagnostic accuracy.Keywords
This publication has 18 references indexed in Scilit:
- Automated diagnosis of pigmented skin lesionsInternational Journal of Cancer, 2002
- Digital Dermoscopy Analysis and Artificial Neural Network for the Differentiation of Clinically Atypical Pigmented Skin Lesions: A Retrospective StudyJournal of Investigative Dermatology, 2002
- Automatic differentiation of melanoma from melanocytic nevi with multispectral digital dermoscopy: A feasibility studyJournal of the American Academy of Dermatology, 2001
- Digital videomicroscopy improves diagnostic accuracy for melanomaJournal of the American Academy of Dermatology, 1998
- Primary cutaneous melanoma. Identification of prognostic groups and estimation of individual prognosis for 5093 patientsCancer, 1995
- Primary cutaneous melanoma. Optimized cutoff points of tumor thickness and importance of clark's level for prognostic classificationCancer, 1995
- Neural network diagnosis of malignant melanoma from color imagesIEEE Transactions on Biomedical Engineering, 1994
- Cutaneous malignant melanoma (arizona cancer center experience). I. Natural history and prognostic factors influencing survival in patients with stage i diseaseCancer, 1988
- EARLY DIAGNOSIS OF MALIGNANT MELANOMA BY SURFACE MICROSCOPYThe Lancet, 1987
- Tumor thickness as a guide to surgical management of clinical stage I melanoma patientsCancer, 1979