Deep Learning-Based Concrete Surface Damage Monitoring Method Using Structured Lights and Depth Camera

• Main Authors: Hyuntae Bang, Jiyoung Min, Haemin Jeon
• Format: Article
• Language: English
• Published: MDPI AG 2021-04-01
• Series: Sensors
• Subjects: damage detection; quantification; deep learning; structured light; depth camera
• Online Access: https://www.mdpi.com/1424-8220/21/8/2759

Due to the increase in aging structures and the decrease in construction workforce, there is an increasing interest in automating structural damage monitoring. Surface damage on concrete structures, such as cracks, delamination, and rebar exposure, is one of the important parameters that can be used to estimate the condition of the structure. In this paper, deep learning-based detection and quantification of structural damage using structured lights and a depth camera is proposed. The proposed monitoring system is composed of four lasers and a depth camera. The lasers are projected on the surface of the structures, and the camera captures images of the structures while measuring distance. By calculating an image homography, the captured images are calibrated when the structure and sensing system are not in parallel. The Faster RCNN (Region-based Convolutional Neural Network) with Inception Resnet v2 architecture is used to detect three types of surface damage: (i) cracks; (ii) delamination; and (iii) rebar exposure. The detected damage is quantified by calculating the positions of the projected laser beams with the measured distance. The experimental results show that structural damage was detected with an F1 score of 0.83 and a median value of the quantified relative error of less than 5%.