InstaDam: Open-Source Platform for Rapid Semantic Segmentation of Structural Damage
Open Access
- 7 January 2021
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 11 (2), 520
- https://doi.org/10.3390/app11020520
Abstract
The tremendous success of automated methods for the detection of damage in images of civil infrastructure has been fueled by exponential advances in deep learning over the past decade. In particular, many efforts have taken place in academia and more recently in industry that demonstrate the success of supervised deep learning methods for semantic segmentation of damage (i.e., the pixel-wise identification of damage in images). However, in graduating from the detection of damage to applications such as inspection automation, efforts have been limited by the lack of large open datasets of real-world images with annotations for multiple types of damage, and other related information such as material and component types. Such datasets for structural inspections are difficult to develop because annotating the complex and amorphous shapes taken by damage patterns remains a tedious task (requiring too many clicks and careful selection of points), even with state-of-the art annotation software. In this work, InstaDam—an open source software platform for fast pixel-wise annotation of damage—is presented. By utilizing binary masks to aid user input, InstaDam greatly speeds up the annotation process and improves the consistency of annotations. The masks are generated by applying established image processing techniques (IPTs) to the images being annotated. Several different tunable IPTs are implemented to allow for rapid annotation of a wide variety of damage types. The paper first describes details of InstaDam’s software architecture and presents some of its key features. Then, the benefits of InstaDam are explored by comparing it to the Image Labeler app in Matlab. Experiments are conducted where two employed student annotators are given the task of annotating damage in a small dataset of images using Matlab, InstaDam without IPTs, and InstaDam. Comparisons are made, quantifying the improvements in annotation speed and annotation consistency across annotators. A description of the statistics of the different IPTs used for different annotated classes is presented. The gains in annotation consistency and efficiency from using InstaDam will facilitate the development of datasets that can help to advance research into automation of visual inspections.Funding Information
- U.S. Army Corps of Engineers (W912HZ-17-2-0024)
This publication has 22 references indexed in Scilit:
- Identification framework for cracks on a steel structure surface by a restricted Boltzmann machines algorithm based on consumer-grade camera imagesStructural Control and Health Monitoring, 2018
- NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data FusionIEEE Transactions on Industrial Electronics, 2017
- The SYNTHIA Dataset: A Large Collection of Synthetic Images for Semantic Segmentation of Urban ScenesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- The Cityscapes Dataset for Semantic Urban Scene UnderstandingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- Object scene flow for autonomous vehiclesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- An innovative methodology for detection and quantification of cracks through incorporation of depth perceptionMachine Vision and Applications, 2011
- On the Evaluation of Texture and Color Features for Nondestructive Corrosion DetectionEURASIP Journal on Advances in Signal Processing, 2010
- Ridge-Based Vessel Segmentation in Color Images of the RetinaIEEE Transactions on Medical Imaging, 2004
- Analysis of Edge-Detection Techniques for Crack Identification in BridgesJournal of Computing in Civil Engineering, 2003
- A Threshold Selection Method from Gray-Level HistogramsIEEE Transactions on Systems, Man, and Cybernetics, 1979