Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation Network
Kinematic analysis of the hyoid bone in a videofluorosopic swallowing study (VFSS) is important for assessing dysphagia. However, calibrating the hyoid bone movement is time-consuming, and its reliability shows wide variation. Computer-assisted analysis has been studied to improve the efficiency and...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-06-01
|
Series: | Diagnostics |
Subjects: | |
Online Access: | https://www.mdpi.com/2075-4418/11/7/1147 |
id |
doaj-f4ac7bc93c3b4733bcaad2745fc5b9ef |
---|---|
record_format |
Article |
spelling |
doaj-f4ac7bc93c3b4733bcaad2745fc5b9ef2021-07-23T13:36:58ZengMDPI AGDiagnostics2075-44182021-06-01111147114710.3390/diagnostics11071147Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation NetworkHyun-Il Kim0Yuna Kim1Bomin Kim2Dae Youp Shin3Seong Jae Lee4Sang-Il Choi5Department of Computer Science and Engineering, Dankook University, Yongin 16890, KoreaDepartment of Rehabilitation Medicine, Dankook University Hospital, Cheonan 31116, KoreaDepartment of Computer Science and Engineering, Dankook University, Yongin 16890, KoreaDepartment of Rehabilitation Medicine, Dankook University Hospital, Cheonan 31116, KoreaDepartment of Rehabilitation Medicine, Dankook University Hospital, Cheonan 31116, KoreaDepartment of Computer Science and Engineering, Dankook University, Yongin 16890, KoreaKinematic analysis of the hyoid bone in a videofluorosopic swallowing study (VFSS) is important for assessing dysphagia. However, calibrating the hyoid bone movement is time-consuming, and its reliability shows wide variation. Computer-assisted analysis has been studied to improve the efficiency and accuracy of hyoid bone identification and tracking, but its performance is limited. In this study, we aimed to design a robust network that can track hyoid bone movement automatically without human intervention. Using 69,389 frames from 197 VFSS files as the data set, a deep learning model for detection and trajectory prediction was constructed and trained by the BiFPN-U-Net(T) network. The present model showed improved performance when compared with the previous models: an area under the curve (AUC) of 0.998 for pixelwise accuracy, an accuracy of object detection of 99.5%, and a Dice similarity of 90.9%. The bounding box detection performance for the hyoid bone and reference objects was superior to that of other models, with a mean average precision of 95.9%. The estimation of the distance of hyoid bone movement also showed higher accuracy. The deep learning model proposed in this study could be used to detect and track the hyoid bone more efficiently and accurately in VFSS analysis.https://www.mdpi.com/2075-4418/11/7/1147dysphagiahyoid bonevideofluoroscopydeep learning |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Hyun-Il Kim Yuna Kim Bomin Kim Dae Youp Shin Seong Jae Lee Sang-Il Choi |
spellingShingle |
Hyun-Il Kim Yuna Kim Bomin Kim Dae Youp Shin Seong Jae Lee Sang-Il Choi Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation Network Diagnostics dysphagia hyoid bone videofluoroscopy deep learning |
author_facet |
Hyun-Il Kim Yuna Kim Bomin Kim Dae Youp Shin Seong Jae Lee Sang-Il Choi |
author_sort |
Hyun-Il Kim |
title |
Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation Network |
title_short |
Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation Network |
title_full |
Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation Network |
title_fullStr |
Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation Network |
title_full_unstemmed |
Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation Network |
title_sort |
hyoid bone tracking in a videofluoroscopic swallowing study using a deep-learning-based segmentation network |
publisher |
MDPI AG |
series |
Diagnostics |
issn |
2075-4418 |
publishDate |
2021-06-01 |
description |
Kinematic analysis of the hyoid bone in a videofluorosopic swallowing study (VFSS) is important for assessing dysphagia. However, calibrating the hyoid bone movement is time-consuming, and its reliability shows wide variation. Computer-assisted analysis has been studied to improve the efficiency and accuracy of hyoid bone identification and tracking, but its performance is limited. In this study, we aimed to design a robust network that can track hyoid bone movement automatically without human intervention. Using 69,389 frames from 197 VFSS files as the data set, a deep learning model for detection and trajectory prediction was constructed and trained by the BiFPN-U-Net(T) network. The present model showed improved performance when compared with the previous models: an area under the curve (AUC) of 0.998 for pixelwise accuracy, an accuracy of object detection of 99.5%, and a Dice similarity of 90.9%. The bounding box detection performance for the hyoid bone and reference objects was superior to that of other models, with a mean average precision of 95.9%. The estimation of the distance of hyoid bone movement also showed higher accuracy. The deep learning model proposed in this study could be used to detect and track the hyoid bone more efficiently and accurately in VFSS analysis. |
topic |
dysphagia hyoid bone videofluoroscopy deep learning |
url |
https://www.mdpi.com/2075-4418/11/7/1147 |
work_keys_str_mv |
AT hyunilkim hyoidbonetrackinginavideofluoroscopicswallowingstudyusingadeeplearningbasedsegmentationnetwork AT yunakim hyoidbonetrackinginavideofluoroscopicswallowingstudyusingadeeplearningbasedsegmentationnetwork AT bominkim hyoidbonetrackinginavideofluoroscopicswallowingstudyusingadeeplearningbasedsegmentationnetwork AT daeyoupshin hyoidbonetrackinginavideofluoroscopicswallowingstudyusingadeeplearningbasedsegmentationnetwork AT seongjaelee hyoidbonetrackinginavideofluoroscopicswallowingstudyusingadeeplearningbasedsegmentationnetwork AT sangilchoi hyoidbonetrackinginavideofluoroscopicswallowingstudyusingadeeplearningbasedsegmentationnetwork |
_version_ |
1721288839045054464 |