Deep learning–based roadway crack classification with heterogeneous image data fusion
- 25 August 2020
- journal article
- research article
- Published by SAGE Publications in Structural Health Monitoring
- Vol. 20 (3), 1274-1293
- https://doi.org/10.1177/1475921720948434
Abstract
By providing accurate and efficient crack detection and localization, image-based crack detection methodologies can facilitate the decision-making and rehabilitation of the roadway infrastructure. Deep convolutional neural network, as one of the most prevailing image-based methodologies on object recognition, has been extensively adopted for crack classification tasks in the recent decade. For most of the current deep convolutional neural network–based techniques, either intensity or range image data are utilized to interpret the crack presence. However, the complexities in real-world data may impair the robustness of deep convolutional neural network architecture in its ability to analyze image data with various types of disturbances, such as low contrast in intensity images and shallow cracks in range images. The detection performance under these disturbances is important to protect the investment in infrastructure, as it can reveal the trend of crack evolution and provide information at an early stage to promote precautionary measures. This article proposes novel deep convolutional neural network–based roadway classification tools and investigates their performance from the perspective of using heterogeneous image fusion. A vehicle-mounted laser imaging system is adopted for data acquisition (DAQ) on concrete roadways with a depth resolution of 0.1 mm and an accuracy of 0.4 mm. In total, four types of image data including raw intensity, raw range, filtered range, and fused raw image data are utilized to train and test the deep convolutional neural network architectures proposed in this study. The experimental cases demonstrate that the proposed data fusion approach can reduce false detections and thus results in an improvement of 4.5%, 1.2%, and 0.7% in the F-measure value, respectively, compared to utilizing the raw intensity, raw range, and filtered range image data for analysis. Furthermore, in another experimental case, two novel deep convolutional neural network architectures proposed in this study are compared to exploit the fused raw image data, and the one leading to better classification performance is determined.Keywords
Funding Information
- Alabama Transportation Institute (Grant Number: 14560)
- Alabama Department of Transportation (Project Number 930-930, Grant Number: 25663)
This publication has 51 references indexed in Scilit:
- Crack detection of reinforced concrete bridge using video imageJournal of Central South University, 2013
- Road Crack Detection Using Visual Features Extracted by Gabor FiltersComputer-Aided Civil and Infrastructure Engineering, 2013
- Pavement cracking measurements using 3D laser-scan imagesMeasurement Science and Technology, 2013
- Critical Assessment of Detecting Asphalt Pavement Cracks under Different Lighting and Low Intensity Contrast Conditions Using Emerging 3D Laser TechnologyJournal of Transportation Engineering, 2012
- Concrete Crack Detection by Multiple Sequential Image FilteringComputer-Aided Civil and Infrastructure Engineering, 2011
- Dynamic Programming and Connected Component Analysis for an Enhanced Pavement Distress Segmentation AlgorithmTransportation Research Record: Journal of the Transportation Research Board, 2011
- PCA-Based algorithm for unsupervised bridge crack detectionAdvances in Engineering Software, 2006
- An introduction to ROC analysisPattern Recognition Letters, 2005
- Hyperspectral image data analysisIEEE Signal Processing Magazine, 2002
- An introduction to multisensor data fusionProceedings of the IEEE, 1997