A Comparison of Evaluation Techniques for Building Extraction From Airborne Laser Scanning
- 4 March 2009
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 2 (1), 11-20
- https://doi.org/10.1109/jstars.2009.2012488
Abstract
In this paper, different methods for the evaluation of building detection algorithms are compared. Whereas pixel-based evaluation gives estimates of the area that is correctly classified, the results are distorted by errors at the building outlines. These distortions are potentially in an order of 30%. Object-based evaluation techniques are less affected by such errors. However, the performance metrics thus delivered are sometimes considered to be less objective, because the definition of a ldquocorrect detectionrdquo is not unique. Based on a critical review of existing performance metrics, selected methods for the evaluation of building detection results are presented. These methods are used to evaluate the results of two different building detection algorithms in two test sites. A comparison of the evaluation techniques shows that they highlight different properties of the building detection results. As a consequence, a comprehensive evaluation strategy involving quality metrics derived by different methods is proposed.Keywords
This publication has 10 references indexed in Scilit:
- Building detection by fusion of airborne laser scanner data and multi-spectral images: Performance evaluation and sensitivity analysisISPRS Journal of Photogrammetry and Remote Sensing, 2007
- Extraction of building footprints from airborne laser scanning: Comparison and validation techniquesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Automatic Construction of Building Footprints From Airborne LIDAR DataIEEE Transactions on Geoscience and Remote Sensing, 2006
- Quality assessment for geo‐spatial objects derived from remotely sensed dataInternational Journal of Remote Sensing, 2005
- Quality of Building Extraction from IKONOS ImageryJournal of Surveying Engineering, 2005
- Using the Dempster–Shafer method for the fusion of LIDAR data and multi-spectral images for building detectionInformation Fusion, 2004
- Class-Guided Building Extraction from Ikonos ImageryPhotogrammetric Engineering & Remote Sensing, 2003
- Status of land cover classification accuracy assessmentRemote Sensing of Environment, 2001
- Contributions to a quality description of areal objects in spatial data setsISPRS Journal of Photogrammetry and Remote Sensing, 2000
- Performance evaluation and analysis of monocular building extraction from aerial imageryIeee Transactions On Pattern Analysis and Machine Intelligence, 1999