Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation Network

Kinematic analysis of the hyoid bone in a videofluorosopic swallowing study (VFSS) is important for assessing dysphagia. However, calibrating the hyoid bone movement is time-consuming, and its reliability shows wide variation. Computer-assisted analysis has been studied to improve the efficiency and...

Full description

Bibliographic Details
Main Authors: Hyun-Il Kim, Yuna Kim, Bomin Kim, Dae Youp Shin, Seong Jae Lee, Sang-Il Choi
Format: Article
Language:English
Published: MDPI AG 2021-06-01
Series:Diagnostics
Subjects:
Online Access:https://www.mdpi.com/2075-4418/11/7/1147
id doaj-f4ac7bc93c3b4733bcaad2745fc5b9ef
record_format Article
spelling doaj-f4ac7bc93c3b4733bcaad2745fc5b9ef2021-07-23T13:36:58ZengMDPI AGDiagnostics2075-44182021-06-01111147114710.3390/diagnostics11071147Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation NetworkHyun-Il Kim0Yuna Kim1Bomin Kim2Dae Youp Shin3Seong Jae Lee4Sang-Il Choi5Department of Computer Science and Engineering, Dankook University, Yongin 16890, KoreaDepartment of Rehabilitation Medicine, Dankook University Hospital, Cheonan 31116, KoreaDepartment of Computer Science and Engineering, Dankook University, Yongin 16890, KoreaDepartment of Rehabilitation Medicine, Dankook University Hospital, Cheonan 31116, KoreaDepartment of Rehabilitation Medicine, Dankook University Hospital, Cheonan 31116, KoreaDepartment of Computer Science and Engineering, Dankook University, Yongin 16890, KoreaKinematic analysis of the hyoid bone in a videofluorosopic swallowing study (VFSS) is important for assessing dysphagia. However, calibrating the hyoid bone movement is time-consuming, and its reliability shows wide variation. Computer-assisted analysis has been studied to improve the efficiency and accuracy of hyoid bone identification and tracking, but its performance is limited. In this study, we aimed to design a robust network that can track hyoid bone movement automatically without human intervention. Using 69,389 frames from 197 VFSS files as the data set, a deep learning model for detection and trajectory prediction was constructed and trained by the BiFPN-U-Net(T) network. The present model showed improved performance when compared with the previous models: an area under the curve (AUC) of 0.998 for pixelwise accuracy, an accuracy of object detection of 99.5%, and a Dice similarity of 90.9%. The bounding box detection performance for the hyoid bone and reference objects was superior to that of other models, with a mean average precision of 95.9%. The estimation of the distance of hyoid bone movement also showed higher accuracy. The deep learning model proposed in this study could be used to detect and track the hyoid bone more efficiently and accurately in VFSS analysis.https://www.mdpi.com/2075-4418/11/7/1147dysphagiahyoid bonevideofluoroscopydeep learning
collection DOAJ
language English
format Article
sources DOAJ
author Hyun-Il Kim
Yuna Kim
Bomin Kim
Dae Youp Shin
Seong Jae Lee
Sang-Il Choi
spellingShingle Hyun-Il Kim
Yuna Kim
Bomin Kim
Dae Youp Shin
Seong Jae Lee
Sang-Il Choi
Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation Network
Diagnostics
dysphagia
hyoid bone
videofluoroscopy
deep learning
author_facet Hyun-Il Kim
Yuna Kim
Bomin Kim
Dae Youp Shin
Seong Jae Lee
Sang-Il Choi
author_sort Hyun-Il Kim
title Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation Network
title_short Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation Network
title_full Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation Network
title_fullStr Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation Network
title_full_unstemmed Hyoid Bone Tracking in a Videofluoroscopic Swallowing Study Using a Deep-Learning-Based Segmentation Network
title_sort hyoid bone tracking in a videofluoroscopic swallowing study using a deep-learning-based segmentation network
publisher MDPI AG
series Diagnostics
issn 2075-4418
publishDate 2021-06-01
description Kinematic analysis of the hyoid bone in a videofluorosopic swallowing study (VFSS) is important for assessing dysphagia. However, calibrating the hyoid bone movement is time-consuming, and its reliability shows wide variation. Computer-assisted analysis has been studied to improve the efficiency and accuracy of hyoid bone identification and tracking, but its performance is limited. In this study, we aimed to design a robust network that can track hyoid bone movement automatically without human intervention. Using 69,389 frames from 197 VFSS files as the data set, a deep learning model for detection and trajectory prediction was constructed and trained by the BiFPN-U-Net(T) network. The present model showed improved performance when compared with the previous models: an area under the curve (AUC) of 0.998 for pixelwise accuracy, an accuracy of object detection of 99.5%, and a Dice similarity of 90.9%. The bounding box detection performance for the hyoid bone and reference objects was superior to that of other models, with a mean average precision of 95.9%. The estimation of the distance of hyoid bone movement also showed higher accuracy. The deep learning model proposed in this study could be used to detect and track the hyoid bone more efficiently and accurately in VFSS analysis.
topic dysphagia
hyoid bone
videofluoroscopy
deep learning
url https://www.mdpi.com/2075-4418/11/7/1147
work_keys_str_mv AT hyunilkim hyoidbonetrackinginavideofluoroscopicswallowingstudyusingadeeplearningbasedsegmentationnetwork
AT yunakim hyoidbonetrackinginavideofluoroscopicswallowingstudyusingadeeplearningbasedsegmentationnetwork
AT bominkim hyoidbonetrackinginavideofluoroscopicswallowingstudyusingadeeplearningbasedsegmentationnetwork
AT daeyoupshin hyoidbonetrackinginavideofluoroscopicswallowingstudyusingadeeplearningbasedsegmentationnetwork
AT seongjaelee hyoidbonetrackinginavideofluoroscopicswallowingstudyusingadeeplearningbasedsegmentationnetwork
AT sangilchoi hyoidbonetrackinginavideofluoroscopicswallowingstudyusingadeeplearningbasedsegmentationnetwork
_version_ 1721288839045054464