Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network.
Slit-lamp images play an essential role for diagnosis of pediatric cataracts. We present a computer vision-based framework for the automatic localization and diagnosis of slit-lamp images by identifying the lens region of interest (ROI) and employing a deep learning convolutional neural network (CNN...
Main Authors: | , , , , , , , , , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Public Library of Science (PLoS)
2017-01-01
|
Series: | PLoS ONE |
Online Access: | http://europepmc.org/articles/PMC5356999?pdf=render |
id |
doaj-1a9c6f1f5dba4991bf4cc6337431ea78 |
---|---|
record_format |
Article |
spelling |
doaj-1a9c6f1f5dba4991bf4cc6337431ea782020-11-25T02:04:59ZengPublic Library of Science (PLoS)PLoS ONE1932-62032017-01-01123e016860610.1371/journal.pone.0168606Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network.Xiyang LiuJiewei JiangKai ZhangErping LongJiangtao CuiMingmin ZhuYingying AnJia ZhangZhenzhen LiuZhuoling LinXiaoyan LiJingjing ChenQianzhong CaoJing LiXiaohang WuDongni WangHaotian LinSlit-lamp images play an essential role for diagnosis of pediatric cataracts. We present a computer vision-based framework for the automatic localization and diagnosis of slit-lamp images by identifying the lens region of interest (ROI) and employing a deep learning convolutional neural network (CNN). First, three grading degrees for slit-lamp images are proposed in conjunction with three leading ophthalmologists. The lens ROI is located in an automated manner in the original image using two successive applications of Candy detection and the Hough transform, which are cropped, resized to a fixed size and used to form pediatric cataract datasets. These datasets are fed into the CNN to extract high-level features and implement automatic classification and grading. To demonstrate the performance and effectiveness of the deep features extracted in the CNN, we investigate the features combined with support vector machine (SVM) and softmax classifier and compare these with the traditional representative methods. The qualitative and quantitative experimental results demonstrate that our proposed method offers exceptional mean accuracy, sensitivity and specificity: classification (97.07%, 97.28%, and 96.83%) and a three-degree grading area (89.02%, 86.63%, and 90.75%), density (92.68%, 91.05%, and 93.94%) and location (89.28%, 82.70%, and 93.08%). Finally, we developed and deployed a potential automatic diagnostic software for ophthalmologists and patients in clinical applications to implement the validated model.http://europepmc.org/articles/PMC5356999?pdf=render |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Xiyang Liu Jiewei Jiang Kai Zhang Erping Long Jiangtao Cui Mingmin Zhu Yingying An Jia Zhang Zhenzhen Liu Zhuoling Lin Xiaoyan Li Jingjing Chen Qianzhong Cao Jing Li Xiaohang Wu Dongni Wang Haotian Lin |
spellingShingle |
Xiyang Liu Jiewei Jiang Kai Zhang Erping Long Jiangtao Cui Mingmin Zhu Yingying An Jia Zhang Zhenzhen Liu Zhuoling Lin Xiaoyan Li Jingjing Chen Qianzhong Cao Jing Li Xiaohang Wu Dongni Wang Haotian Lin Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network. PLoS ONE |
author_facet |
Xiyang Liu Jiewei Jiang Kai Zhang Erping Long Jiangtao Cui Mingmin Zhu Yingying An Jia Zhang Zhenzhen Liu Zhuoling Lin Xiaoyan Li Jingjing Chen Qianzhong Cao Jing Li Xiaohang Wu Dongni Wang Haotian Lin |
author_sort |
Xiyang Liu |
title |
Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network. |
title_short |
Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network. |
title_full |
Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network. |
title_fullStr |
Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network. |
title_full_unstemmed |
Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network. |
title_sort |
localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network. |
publisher |
Public Library of Science (PLoS) |
series |
PLoS ONE |
issn |
1932-6203 |
publishDate |
2017-01-01 |
description |
Slit-lamp images play an essential role for diagnosis of pediatric cataracts. We present a computer vision-based framework for the automatic localization and diagnosis of slit-lamp images by identifying the lens region of interest (ROI) and employing a deep learning convolutional neural network (CNN). First, three grading degrees for slit-lamp images are proposed in conjunction with three leading ophthalmologists. The lens ROI is located in an automated manner in the original image using two successive applications of Candy detection and the Hough transform, which are cropped, resized to a fixed size and used to form pediatric cataract datasets. These datasets are fed into the CNN to extract high-level features and implement automatic classification and grading. To demonstrate the performance and effectiveness of the deep features extracted in the CNN, we investigate the features combined with support vector machine (SVM) and softmax classifier and compare these with the traditional representative methods. The qualitative and quantitative experimental results demonstrate that our proposed method offers exceptional mean accuracy, sensitivity and specificity: classification (97.07%, 97.28%, and 96.83%) and a three-degree grading area (89.02%, 86.63%, and 90.75%), density (92.68%, 91.05%, and 93.94%) and location (89.28%, 82.70%, and 93.08%). Finally, we developed and deployed a potential automatic diagnostic software for ophthalmologists and patients in clinical applications to implement the validated model. |
url |
http://europepmc.org/articles/PMC5356999?pdf=render |
work_keys_str_mv |
AT xiyangliu localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT jieweijiang localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT kaizhang localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT erpinglong localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT jiangtaocui localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT mingminzhu localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT yingyingan localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT jiazhang localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT zhenzhenliu localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT zhuolinglin localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT xiaoyanli localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT jingjingchen localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT qianzhongcao localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT jingli localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT xiaohangwu localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT dongniwang localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork AT haotianlin localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork |
_version_ |
1724939773075783680 |