Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs
Caries is a dental disease caused by bacterial infection. If the cause of the caries is detected early, the treatment will be relatively easy, which in turn prevents caries from spreading. The current common procedure of dentists is to first perform radiographic examination on the patient and mark t...
Main Authors: | , , , , , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-07-01
|
Series: | Sensors |
Subjects: | |
Online Access: | https://www.mdpi.com/1424-8220/21/13/4613 |
id |
doaj-0ba3d0a64a0d499d830c929f2ca7321e |
---|---|
record_format |
Article |
spelling |
doaj-0ba3d0a64a0d499d830c929f2ca7321e2021-07-15T15:46:06ZengMDPI AGSensors1424-82202021-07-01214613461310.3390/s21134613Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNsYi-Cheng Mao0Tsung-Yi Chen1He-Sheng Chou2Szu-Yin Lin3Sheng-Yu Liu4Yu-An Chen5Yu-Lin Liu6Chiung-An Chen7Yen-Cheng Huang8Shih-Lun Chen9Chun-Wei Li10Patricia Angela R. Abu11Wei-Yuan Chiang12Department of General Dentistry, Chang Gung Memorial Hospital, Taoyuan City 33305, TaiwanDepartment of Electronic Engineering, Chung Yuan Christian University, Taoyuan City 32023, TaiwanDepartment of Electronic Engineering, Chung Yuan Christian University, Taoyuan City 32023, TaiwanDepartment of Computer Science and Information Engineering, National Ilan University, Yilan City 26047, TaiwanDepartment of Electronic Engineering, Chung Yuan Christian University, Taoyuan City 32023, TaiwanDepartment of Electronic Engineering, Chung Yuan Christian University, Taoyuan City 32023, TaiwanDepartment of Electronic Engineering, Chung Yuan Christian University, Taoyuan City 32023, TaiwanDepartment of Electrical Engineering, Ming Chi University of Technology, New Taipei City 243303, TaiwanDepartment of General Dentistry, Chang Gung Memorial Hospital, Taoyuan City 33305, TaiwanDepartment of Electronic Engineering, Chung Yuan Christian University, Taoyuan City 32023, TaiwanDepartment of General Dentistry, Chang Gung Memorial Hospital, Taoyuan City 33305, TaiwanDepartment of Information Systems and Computer Science, Ateneo de Manila University, Quezon City 1108, PhilippinesNational Synchrotron Radiation Research Center, Hsinchu City 30076, TaiwanCaries is a dental disease caused by bacterial infection. If the cause of the caries is detected early, the treatment will be relatively easy, which in turn prevents caries from spreading. The current common procedure of dentists is to first perform radiographic examination on the patient and mark the lesions manually. However, the work of judging lesions and markings requires professional experience and is very time-consuming and repetitive. Taking advantage of the rapid development of artificial intelligence imaging research and technical methods will help dentists make accurate markings and improve medical treatments. It can also shorten the judgment time of professionals. In addition to the use of Gaussian high-pass filter and Otsu’s threshold image enhancement technology, this research solves the problem that the original cutting technology cannot extract certain single teeth, and it proposes a caries and lesions area analysis model based on convolutional neural networks (CNN), which can identify caries and restorations from the bitewing images. Moreover, it provides dentists with more accurate objective judgment data to achieve the purpose of automatic diagnosis and treatment planning as a technology for assisting precision medicine. A standardized database established following a defined set of steps is also proposed in this study. There are three main steps to generate the image of a single tooth from a bitewing image, which can increase the accuracy of the analysis model. The steps include (1) preprocessing of the dental image to obtain a high-quality binarization, (2) a dental image cropping procedure to obtain individually separated tooth samples, and (3) a dental image masking step which masks the fine broken teeth from the sample and enhances the quality of the training. Among the current four common neural networks, namely, AlexNet, GoogleNet, Vgg19, and ResNet50, experimental results show that the proposed AlexNet model in this study for restoration and caries judgments has an accuracy as high as 95.56% and 90.30%, respectively. These are promising results that lead to the possibility of developing an automatic judgment method of bitewing film.https://www.mdpi.com/1424-8220/21/13/4613biomedical imagebitewing filmGaussian high-pass filterOtsu’s thresholdingdeep learningCNN |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Yi-Cheng Mao Tsung-Yi Chen He-Sheng Chou Szu-Yin Lin Sheng-Yu Liu Yu-An Chen Yu-Lin Liu Chiung-An Chen Yen-Cheng Huang Shih-Lun Chen Chun-Wei Li Patricia Angela R. Abu Wei-Yuan Chiang |
spellingShingle |
Yi-Cheng Mao Tsung-Yi Chen He-Sheng Chou Szu-Yin Lin Sheng-Yu Liu Yu-An Chen Yu-Lin Liu Chiung-An Chen Yen-Cheng Huang Shih-Lun Chen Chun-Wei Li Patricia Angela R. Abu Wei-Yuan Chiang Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs Sensors biomedical image bitewing film Gaussian high-pass filter Otsu’s thresholding deep learning CNN |
author_facet |
Yi-Cheng Mao Tsung-Yi Chen He-Sheng Chou Szu-Yin Lin Sheng-Yu Liu Yu-An Chen Yu-Lin Liu Chiung-An Chen Yen-Cheng Huang Shih-Lun Chen Chun-Wei Li Patricia Angela R. Abu Wei-Yuan Chiang |
author_sort |
Yi-Cheng Mao |
title |
Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs |
title_short |
Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs |
title_full |
Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs |
title_fullStr |
Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs |
title_full_unstemmed |
Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs |
title_sort |
caries and restoration detection using bitewing film based on transfer learning with cnns |
publisher |
MDPI AG |
series |
Sensors |
issn |
1424-8220 |
publishDate |
2021-07-01 |
description |
Caries is a dental disease caused by bacterial infection. If the cause of the caries is detected early, the treatment will be relatively easy, which in turn prevents caries from spreading. The current common procedure of dentists is to first perform radiographic examination on the patient and mark the lesions manually. However, the work of judging lesions and markings requires professional experience and is very time-consuming and repetitive. Taking advantage of the rapid development of artificial intelligence imaging research and technical methods will help dentists make accurate markings and improve medical treatments. It can also shorten the judgment time of professionals. In addition to the use of Gaussian high-pass filter and Otsu’s threshold image enhancement technology, this research solves the problem that the original cutting technology cannot extract certain single teeth, and it proposes a caries and lesions area analysis model based on convolutional neural networks (CNN), which can identify caries and restorations from the bitewing images. Moreover, it provides dentists with more accurate objective judgment data to achieve the purpose of automatic diagnosis and treatment planning as a technology for assisting precision medicine. A standardized database established following a defined set of steps is also proposed in this study. There are three main steps to generate the image of a single tooth from a bitewing image, which can increase the accuracy of the analysis model. The steps include (1) preprocessing of the dental image to obtain a high-quality binarization, (2) a dental image cropping procedure to obtain individually separated tooth samples, and (3) a dental image masking step which masks the fine broken teeth from the sample and enhances the quality of the training. Among the current four common neural networks, namely, AlexNet, GoogleNet, Vgg19, and ResNet50, experimental results show that the proposed AlexNet model in this study for restoration and caries judgments has an accuracy as high as 95.56% and 90.30%, respectively. These are promising results that lead to the possibility of developing an automatic judgment method of bitewing film. |
topic |
biomedical image bitewing film Gaussian high-pass filter Otsu’s thresholding deep learning CNN |
url |
https://www.mdpi.com/1424-8220/21/13/4613 |
work_keys_str_mv |
AT yichengmao cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns AT tsungyichen cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns AT heshengchou cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns AT szuyinlin cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns AT shengyuliu cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns AT yuanchen cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns AT yulinliu cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns AT chiunganchen cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns AT yenchenghuang cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns AT shihlunchen cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns AT chunweili cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns AT patriciaangelarabu cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns AT weiyuanchiang cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns |
_version_ |
1721298368529956864 |