Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model
In this study, we investigate a novel idea of using synthetic images of bolts which are generated from a graphical model to train a deep learning model for loosened bolt detection. Firstly, a framework for bolt-loosening detection using image-based deep learning and computer graphics is proposed. Ne...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2020-06-01
|
Series: | Sensors |
Subjects: | |
Online Access: | https://www.mdpi.com/1424-8220/20/12/3382 |
id |
doaj-9a62518c1d274626963217cb6fbbf1f1 |
---|---|
record_format |
Article |
spelling |
doaj-9a62518c1d274626963217cb6fbbf1f12020-11-25T03:06:15ZengMDPI AGSensors1424-82202020-06-01203382338210.3390/s20123382Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical ModelHai Chien Pham0Quoc-Bao Ta1Jeong-Tae Kim2Duc-Duy Ho3Xuan-Linh Tran4Thanh-Canh Huynh5Applied Computational Civil and Structural Engineering Research Group, Faculty of Civil Engineering, Ton Duc Thang University, Ho Chi Minh City 700000, VietnamOcean Engineering Department, Pukyong National University, Busan 48513, KoreaOcean Engineering Department, Pukyong National University, Busan 48513, KoreaFaculty of Civil Engineering, Ho Chi Minh City University of Technology (HCMUT), Ho Chi Minh City 700000, VietnamFaculty of Civil Engineering, Duy Tan University, Danang 550000, VietnamFaculty of Civil Engineering, Duy Tan University, Danang 550000, VietnamIn this study, we investigate a novel idea of using synthetic images of bolts which are generated from a graphical model to train a deep learning model for loosened bolt detection. Firstly, a framework for bolt-loosening detection using image-based deep learning and computer graphics is proposed. Next, the feasibility of the proposed framework is demonstrated through the bolt-loosening monitoring of a lab-scaled bolted joint model. For practicality, the proposed idea is evaluated on the real-scale bolted connections of a historical truss bridge in Danang, Vietnam. The results show that the deep learning model trained by the synthesized images can achieve accurate bolt recognitions and looseness detections. The proposed methodology could help to reduce the time and cost associated with the collection of high-quality training data and further accelerate the applicability of vision-based deep learning models trained on synthetic data in practice.https://www.mdpi.com/1424-8220/20/12/3382structural health monitoringdamage detectionbolted connectionloosened boltsbolt looseninglooseness detection |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Hai Chien Pham Quoc-Bao Ta Jeong-Tae Kim Duc-Duy Ho Xuan-Linh Tran Thanh-Canh Huynh |
spellingShingle |
Hai Chien Pham Quoc-Bao Ta Jeong-Tae Kim Duc-Duy Ho Xuan-Linh Tran Thanh-Canh Huynh Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model Sensors structural health monitoring damage detection bolted connection loosened bolts bolt loosening looseness detection |
author_facet |
Hai Chien Pham Quoc-Bao Ta Jeong-Tae Kim Duc-Duy Ho Xuan-Linh Tran Thanh-Canh Huynh |
author_sort |
Hai Chien Pham |
title |
Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model |
title_short |
Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model |
title_full |
Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model |
title_fullStr |
Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model |
title_full_unstemmed |
Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model |
title_sort |
bolt-loosening monitoring framework using an image-based deep learning and graphical model |
publisher |
MDPI AG |
series |
Sensors |
issn |
1424-8220 |
publishDate |
2020-06-01 |
description |
In this study, we investigate a novel idea of using synthetic images of bolts which are generated from a graphical model to train a deep learning model for loosened bolt detection. Firstly, a framework for bolt-loosening detection using image-based deep learning and computer graphics is proposed. Next, the feasibility of the proposed framework is demonstrated through the bolt-loosening monitoring of a lab-scaled bolted joint model. For practicality, the proposed idea is evaluated on the real-scale bolted connections of a historical truss bridge in Danang, Vietnam. The results show that the deep learning model trained by the synthesized images can achieve accurate bolt recognitions and looseness detections. The proposed methodology could help to reduce the time and cost associated with the collection of high-quality training data and further accelerate the applicability of vision-based deep learning models trained on synthetic data in practice. |
topic |
structural health monitoring damage detection bolted connection loosened bolts bolt loosening looseness detection |
url |
https://www.mdpi.com/1424-8220/20/12/3382 |
work_keys_str_mv |
AT haichienpham boltlooseningmonitoringframeworkusinganimagebaseddeeplearningandgraphicalmodel AT quocbaota boltlooseningmonitoringframeworkusinganimagebaseddeeplearningandgraphicalmodel AT jeongtaekim boltlooseningmonitoringframeworkusinganimagebaseddeeplearningandgraphicalmodel AT ducduyho boltlooseningmonitoringframeworkusinganimagebaseddeeplearningandgraphicalmodel AT xuanlinhtran boltlooseningmonitoringframeworkusinganimagebaseddeeplearningandgraphicalmodel AT thanhcanhhuynh boltlooseningmonitoringframeworkusinganimagebaseddeeplearningandgraphicalmodel |
_version_ |
1724674346428923904 |