Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model

In this study, we investigate a novel idea of using synthetic images of bolts which are generated from a graphical model to train a deep learning model for loosened bolt detection. Firstly, a framework for bolt-loosening detection using image-based deep learning and computer graphics is proposed. Ne...

Full description

Bibliographic Details
Main Authors: Hai Chien Pham, Quoc-Bao Ta, Jeong-Tae Kim, Duc-Duy Ho, Xuan-Linh Tran, Thanh-Canh Huynh
Format: Article
Language:English
Published: MDPI AG 2020-06-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/12/3382
id doaj-9a62518c1d274626963217cb6fbbf1f1
record_format Article
spelling doaj-9a62518c1d274626963217cb6fbbf1f12020-11-25T03:06:15ZengMDPI AGSensors1424-82202020-06-01203382338210.3390/s20123382Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical ModelHai Chien Pham0Quoc-Bao Ta1Jeong-Tae Kim2Duc-Duy Ho3Xuan-Linh Tran4Thanh-Canh Huynh5Applied Computational Civil and Structural Engineering Research Group, Faculty of Civil Engineering, Ton Duc Thang University, Ho Chi Minh City 700000, VietnamOcean Engineering Department, Pukyong National University, Busan 48513, KoreaOcean Engineering Department, Pukyong National University, Busan 48513, KoreaFaculty of Civil Engineering, Ho Chi Minh City University of Technology (HCMUT), Ho Chi Minh City 700000, VietnamFaculty of Civil Engineering, Duy Tan University, Danang 550000, VietnamFaculty of Civil Engineering, Duy Tan University, Danang 550000, VietnamIn this study, we investigate a novel idea of using synthetic images of bolts which are generated from a graphical model to train a deep learning model for loosened bolt detection. Firstly, a framework for bolt-loosening detection using image-based deep learning and computer graphics is proposed. Next, the feasibility of the proposed framework is demonstrated through the bolt-loosening monitoring of a lab-scaled bolted joint model. For practicality, the proposed idea is evaluated on the real-scale bolted connections of a historical truss bridge in Danang, Vietnam. The results show that the deep learning model trained by the synthesized images can achieve accurate bolt recognitions and looseness detections. The proposed methodology could help to reduce the time and cost associated with the collection of high-quality training data and further accelerate the applicability of vision-based deep learning models trained on synthetic data in practice.https://www.mdpi.com/1424-8220/20/12/3382structural health monitoringdamage detectionbolted connectionloosened boltsbolt looseninglooseness detection
collection DOAJ
language English
format Article
sources DOAJ
author Hai Chien Pham
Quoc-Bao Ta
Jeong-Tae Kim
Duc-Duy Ho
Xuan-Linh Tran
Thanh-Canh Huynh
spellingShingle Hai Chien Pham
Quoc-Bao Ta
Jeong-Tae Kim
Duc-Duy Ho
Xuan-Linh Tran
Thanh-Canh Huynh
Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model
Sensors
structural health monitoring
damage detection
bolted connection
loosened bolts
bolt loosening
looseness detection
author_facet Hai Chien Pham
Quoc-Bao Ta
Jeong-Tae Kim
Duc-Duy Ho
Xuan-Linh Tran
Thanh-Canh Huynh
author_sort Hai Chien Pham
title Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model
title_short Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model
title_full Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model
title_fullStr Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model
title_full_unstemmed Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model
title_sort bolt-loosening monitoring framework using an image-based deep learning and graphical model
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2020-06-01
description In this study, we investigate a novel idea of using synthetic images of bolts which are generated from a graphical model to train a deep learning model for loosened bolt detection. Firstly, a framework for bolt-loosening detection using image-based deep learning and computer graphics is proposed. Next, the feasibility of the proposed framework is demonstrated through the bolt-loosening monitoring of a lab-scaled bolted joint model. For practicality, the proposed idea is evaluated on the real-scale bolted connections of a historical truss bridge in Danang, Vietnam. The results show that the deep learning model trained by the synthesized images can achieve accurate bolt recognitions and looseness detections. The proposed methodology could help to reduce the time and cost associated with the collection of high-quality training data and further accelerate the applicability of vision-based deep learning models trained on synthetic data in practice.
topic structural health monitoring
damage detection
bolted connection
loosened bolts
bolt loosening
looseness detection
url https://www.mdpi.com/1424-8220/20/12/3382
work_keys_str_mv AT haichienpham boltlooseningmonitoringframeworkusinganimagebaseddeeplearningandgraphicalmodel
AT quocbaota boltlooseningmonitoringframeworkusinganimagebaseddeeplearningandgraphicalmodel
AT jeongtaekim boltlooseningmonitoringframeworkusinganimagebaseddeeplearningandgraphicalmodel
AT ducduyho boltlooseningmonitoringframeworkusinganimagebaseddeeplearningandgraphicalmodel
AT xuanlinhtran boltlooseningmonitoringframeworkusinganimagebaseddeeplearningandgraphicalmodel
AT thanhcanhhuynh boltlooseningmonitoringframeworkusinganimagebaseddeeplearningandgraphicalmodel
_version_ 1724674346428923904