Crack Detection in Images of Masonry Using CNNs

While there is a significant body of research on crack detection by computer vision methods in concrete and asphalt, less attention has been given to masonry. We train a convolutional neural network (CNN) on images of brick walls built in a laboratory environment and test its ability to detect crack...

Full description

Bibliographic Details
Main Authors: Mitchell J. Hallee, Rebecca K. Napolitano, Wesley F. Reinhart, Branko Glisic
Format: Article
Language:English
Published: MDPI AG 2021-07-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/14/4929
id doaj-e6e9b34cf9484b28ab1ce2b0f584f61b
record_format Article
spelling doaj-e6e9b34cf9484b28ab1ce2b0f584f61b2021-07-23T14:06:15ZengMDPI AGSensors1424-82202021-07-01214929492910.3390/s21144929Crack Detection in Images of Masonry Using CNNsMitchell J. Hallee0Rebecca K. Napolitano1Wesley F. Reinhart2Branko Glisic3Department of Civil and Environmental Engineering, Princeton University, Princeton, NJ 08544, USADepartment of Architectural Engineering, Pennsylvania State University, University Park, PA 16802, USADepartment of Materials Science and Engineering, Pennsylvania State University, University Park, PA 16802, USADepartment of Civil and Environmental Engineering, Princeton University, Princeton, NJ 08544, USAWhile there is a significant body of research on crack detection by computer vision methods in concrete and asphalt, less attention has been given to masonry. We train a convolutional neural network (CNN) on images of brick walls built in a laboratory environment and test its ability to detect cracks in images of brick-and-mortar structures both in the laboratory and on real-world images taken from the internet. We also compare the performance of the CNN to a variety of simpler classifiers operating on handcrafted features. We find that the CNN performed better on the domain adaptation from laboratory to real-world images than these simple models. However, we also find that performance is significantly better in performing the reverse domain adaptation task, where the simple classifiers are trained on real-world images and tested on the laboratory images. This work demonstrates the ability to detect cracks in images of masonry using a variety of machine learning methods and provides guidance for improving the reliability of such models when performing domain adaptation for crack detection in masonry.https://www.mdpi.com/1424-8220/21/14/4929computer visioncrack detectionstructural health monitoringmasonrymachine learningconvolutional neural network
collection DOAJ
language English
format Article
sources DOAJ
author Mitchell J. Hallee
Rebecca K. Napolitano
Wesley F. Reinhart
Branko Glisic
spellingShingle Mitchell J. Hallee
Rebecca K. Napolitano
Wesley F. Reinhart
Branko Glisic
Crack Detection in Images of Masonry Using CNNs
Sensors
computer vision
crack detection
structural health monitoring
masonry
machine learning
convolutional neural network
author_facet Mitchell J. Hallee
Rebecca K. Napolitano
Wesley F. Reinhart
Branko Glisic
author_sort Mitchell J. Hallee
title Crack Detection in Images of Masonry Using CNNs
title_short Crack Detection in Images of Masonry Using CNNs
title_full Crack Detection in Images of Masonry Using CNNs
title_fullStr Crack Detection in Images of Masonry Using CNNs
title_full_unstemmed Crack Detection in Images of Masonry Using CNNs
title_sort crack detection in images of masonry using cnns
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2021-07-01
description While there is a significant body of research on crack detection by computer vision methods in concrete and asphalt, less attention has been given to masonry. We train a convolutional neural network (CNN) on images of brick walls built in a laboratory environment and test its ability to detect cracks in images of brick-and-mortar structures both in the laboratory and on real-world images taken from the internet. We also compare the performance of the CNN to a variety of simpler classifiers operating on handcrafted features. We find that the CNN performed better on the domain adaptation from laboratory to real-world images than these simple models. However, we also find that performance is significantly better in performing the reverse domain adaptation task, where the simple classifiers are trained on real-world images and tested on the laboratory images. This work demonstrates the ability to detect cracks in images of masonry using a variety of machine learning methods and provides guidance for improving the reliability of such models when performing domain adaptation for crack detection in masonry.
topic computer vision
crack detection
structural health monitoring
masonry
machine learning
convolutional neural network
url https://www.mdpi.com/1424-8220/21/14/4929
work_keys_str_mv AT mitchelljhallee crackdetectioninimagesofmasonryusingcnns
AT rebeccaknapolitano crackdetectioninimagesofmasonryusingcnns
AT wesleyfreinhart crackdetectioninimagesofmasonryusingcnns
AT brankoglisic crackdetectioninimagesofmasonryusingcnns
_version_ 1721285925399429120