Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs

Caries is a dental disease caused by bacterial infection. If the cause of the caries is detected early, the treatment will be relatively easy, which in turn prevents caries from spreading. The current common procedure of dentists is to first perform radiographic examination on the patient and mark t...

Full description

Bibliographic Details
Main Authors: Yi-Cheng Mao, Tsung-Yi Chen, He-Sheng Chou, Szu-Yin Lin, Sheng-Yu Liu, Yu-An Chen, Yu-Lin Liu, Chiung-An Chen, Yen-Cheng Huang, Shih-Lun Chen, Chun-Wei Li, Patricia Angela R. Abu, Wei-Yuan Chiang
Format: Article
Language:English
Published: MDPI AG 2021-07-01
Series:Sensors
Subjects:
CNN
Online Access:https://www.mdpi.com/1424-8220/21/13/4613
id doaj-0ba3d0a64a0d499d830c929f2ca7321e
record_format Article
spelling doaj-0ba3d0a64a0d499d830c929f2ca7321e2021-07-15T15:46:06ZengMDPI AGSensors1424-82202021-07-01214613461310.3390/s21134613Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNsYi-Cheng Mao0Tsung-Yi Chen1He-Sheng Chou2Szu-Yin Lin3Sheng-Yu Liu4Yu-An Chen5Yu-Lin Liu6Chiung-An Chen7Yen-Cheng Huang8Shih-Lun Chen9Chun-Wei Li10Patricia Angela R. Abu11Wei-Yuan Chiang12Department of General Dentistry, Chang Gung Memorial Hospital, Taoyuan City 33305, TaiwanDepartment of Electronic Engineering, Chung Yuan Christian University, Taoyuan City 32023, TaiwanDepartment of Electronic Engineering, Chung Yuan Christian University, Taoyuan City 32023, TaiwanDepartment of Computer Science and Information Engineering, National Ilan University, Yilan City 26047, TaiwanDepartment of Electronic Engineering, Chung Yuan Christian University, Taoyuan City 32023, TaiwanDepartment of Electronic Engineering, Chung Yuan Christian University, Taoyuan City 32023, TaiwanDepartment of Electronic Engineering, Chung Yuan Christian University, Taoyuan City 32023, TaiwanDepartment of Electrical Engineering, Ming Chi University of Technology, New Taipei City 243303, TaiwanDepartment of General Dentistry, Chang Gung Memorial Hospital, Taoyuan City 33305, TaiwanDepartment of Electronic Engineering, Chung Yuan Christian University, Taoyuan City 32023, TaiwanDepartment of General Dentistry, Chang Gung Memorial Hospital, Taoyuan City 33305, TaiwanDepartment of Information Systems and Computer Science, Ateneo de Manila University, Quezon City 1108, PhilippinesNational Synchrotron Radiation Research Center, Hsinchu City 30076, TaiwanCaries is a dental disease caused by bacterial infection. If the cause of the caries is detected early, the treatment will be relatively easy, which in turn prevents caries from spreading. The current common procedure of dentists is to first perform radiographic examination on the patient and mark the lesions manually. However, the work of judging lesions and markings requires professional experience and is very time-consuming and repetitive. Taking advantage of the rapid development of artificial intelligence imaging research and technical methods will help dentists make accurate markings and improve medical treatments. It can also shorten the judgment time of professionals. In addition to the use of Gaussian high-pass filter and Otsu’s threshold image enhancement technology, this research solves the problem that the original cutting technology cannot extract certain single teeth, and it proposes a caries and lesions area analysis model based on convolutional neural networks (CNN), which can identify caries and restorations from the bitewing images. Moreover, it provides dentists with more accurate objective judgment data to achieve the purpose of automatic diagnosis and treatment planning as a technology for assisting precision medicine. A standardized database established following a defined set of steps is also proposed in this study. There are three main steps to generate the image of a single tooth from a bitewing image, which can increase the accuracy of the analysis model. The steps include (1) preprocessing of the dental image to obtain a high-quality binarization, (2) a dental image cropping procedure to obtain individually separated tooth samples, and (3) a dental image masking step which masks the fine broken teeth from the sample and enhances the quality of the training. Among the current four common neural networks, namely, AlexNet, GoogleNet, Vgg19, and ResNet50, experimental results show that the proposed AlexNet model in this study for restoration and caries judgments has an accuracy as high as 95.56% and 90.30%, respectively. These are promising results that lead to the possibility of developing an automatic judgment method of bitewing film.https://www.mdpi.com/1424-8220/21/13/4613biomedical imagebitewing filmGaussian high-pass filterOtsu’s thresholdingdeep learningCNN
collection DOAJ
language English
format Article
sources DOAJ
author Yi-Cheng Mao
Tsung-Yi Chen
He-Sheng Chou
Szu-Yin Lin
Sheng-Yu Liu
Yu-An Chen
Yu-Lin Liu
Chiung-An Chen
Yen-Cheng Huang
Shih-Lun Chen
Chun-Wei Li
Patricia Angela R. Abu
Wei-Yuan Chiang
spellingShingle Yi-Cheng Mao
Tsung-Yi Chen
He-Sheng Chou
Szu-Yin Lin
Sheng-Yu Liu
Yu-An Chen
Yu-Lin Liu
Chiung-An Chen
Yen-Cheng Huang
Shih-Lun Chen
Chun-Wei Li
Patricia Angela R. Abu
Wei-Yuan Chiang
Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs
Sensors
biomedical image
bitewing film
Gaussian high-pass filter
Otsu’s thresholding
deep learning
CNN
author_facet Yi-Cheng Mao
Tsung-Yi Chen
He-Sheng Chou
Szu-Yin Lin
Sheng-Yu Liu
Yu-An Chen
Yu-Lin Liu
Chiung-An Chen
Yen-Cheng Huang
Shih-Lun Chen
Chun-Wei Li
Patricia Angela R. Abu
Wei-Yuan Chiang
author_sort Yi-Cheng Mao
title Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs
title_short Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs
title_full Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs
title_fullStr Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs
title_full_unstemmed Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs
title_sort caries and restoration detection using bitewing film based on transfer learning with cnns
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2021-07-01
description Caries is a dental disease caused by bacterial infection. If the cause of the caries is detected early, the treatment will be relatively easy, which in turn prevents caries from spreading. The current common procedure of dentists is to first perform radiographic examination on the patient and mark the lesions manually. However, the work of judging lesions and markings requires professional experience and is very time-consuming and repetitive. Taking advantage of the rapid development of artificial intelligence imaging research and technical methods will help dentists make accurate markings and improve medical treatments. It can also shorten the judgment time of professionals. In addition to the use of Gaussian high-pass filter and Otsu’s threshold image enhancement technology, this research solves the problem that the original cutting technology cannot extract certain single teeth, and it proposes a caries and lesions area analysis model based on convolutional neural networks (CNN), which can identify caries and restorations from the bitewing images. Moreover, it provides dentists with more accurate objective judgment data to achieve the purpose of automatic diagnosis and treatment planning as a technology for assisting precision medicine. A standardized database established following a defined set of steps is also proposed in this study. There are three main steps to generate the image of a single tooth from a bitewing image, which can increase the accuracy of the analysis model. The steps include (1) preprocessing of the dental image to obtain a high-quality binarization, (2) a dental image cropping procedure to obtain individually separated tooth samples, and (3) a dental image masking step which masks the fine broken teeth from the sample and enhances the quality of the training. Among the current four common neural networks, namely, AlexNet, GoogleNet, Vgg19, and ResNet50, experimental results show that the proposed AlexNet model in this study for restoration and caries judgments has an accuracy as high as 95.56% and 90.30%, respectively. These are promising results that lead to the possibility of developing an automatic judgment method of bitewing film.
topic biomedical image
bitewing film
Gaussian high-pass filter
Otsu’s thresholding
deep learning
CNN
url https://www.mdpi.com/1424-8220/21/13/4613
work_keys_str_mv AT yichengmao cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns
AT tsungyichen cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns
AT heshengchou cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns
AT szuyinlin cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns
AT shengyuliu cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns
AT yuanchen cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns
AT yulinliu cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns
AT chiunganchen cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns
AT yenchenghuang cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns
AT shihlunchen cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns
AT chunweili cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns
AT patriciaangelarabu cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns
AT weiyuanchiang cariesandrestorationdetectionusingbitewingfilmbasedontransferlearningwithcnns
_version_ 1721298368529956864