Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network.

Slit-lamp images play an essential role for diagnosis of pediatric cataracts. We present a computer vision-based framework for the automatic localization and diagnosis of slit-lamp images by identifying the lens region of interest (ROI) and employing a deep learning convolutional neural network (CNN...

Full description

Bibliographic Details
Main Authors: Xiyang Liu, Jiewei Jiang, Kai Zhang, Erping Long, Jiangtao Cui, Mingmin Zhu, Yingying An, Jia Zhang, Zhenzhen Liu, Zhuoling Lin, Xiaoyan Li, Jingjing Chen, Qianzhong Cao, Jing Li, Xiaohang Wu, Dongni Wang, Haotian Lin
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2017-01-01
Series:PLoS ONE
Online Access:http://europepmc.org/articles/PMC5356999?pdf=render
id doaj-1a9c6f1f5dba4991bf4cc6337431ea78
record_format Article
spelling doaj-1a9c6f1f5dba4991bf4cc6337431ea782020-11-25T02:04:59ZengPublic Library of Science (PLoS)PLoS ONE1932-62032017-01-01123e016860610.1371/journal.pone.0168606Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network.Xiyang LiuJiewei JiangKai ZhangErping LongJiangtao CuiMingmin ZhuYingying AnJia ZhangZhenzhen LiuZhuoling LinXiaoyan LiJingjing ChenQianzhong CaoJing LiXiaohang WuDongni WangHaotian LinSlit-lamp images play an essential role for diagnosis of pediatric cataracts. We present a computer vision-based framework for the automatic localization and diagnosis of slit-lamp images by identifying the lens region of interest (ROI) and employing a deep learning convolutional neural network (CNN). First, three grading degrees for slit-lamp images are proposed in conjunction with three leading ophthalmologists. The lens ROI is located in an automated manner in the original image using two successive applications of Candy detection and the Hough transform, which are cropped, resized to a fixed size and used to form pediatric cataract datasets. These datasets are fed into the CNN to extract high-level features and implement automatic classification and grading. To demonstrate the performance and effectiveness of the deep features extracted in the CNN, we investigate the features combined with support vector machine (SVM) and softmax classifier and compare these with the traditional representative methods. The qualitative and quantitative experimental results demonstrate that our proposed method offers exceptional mean accuracy, sensitivity and specificity: classification (97.07%, 97.28%, and 96.83%) and a three-degree grading area (89.02%, 86.63%, and 90.75%), density (92.68%, 91.05%, and 93.94%) and location (89.28%, 82.70%, and 93.08%). Finally, we developed and deployed a potential automatic diagnostic software for ophthalmologists and patients in clinical applications to implement the validated model.http://europepmc.org/articles/PMC5356999?pdf=render
collection DOAJ
language English
format Article
sources DOAJ
author Xiyang Liu
Jiewei Jiang
Kai Zhang
Erping Long
Jiangtao Cui
Mingmin Zhu
Yingying An
Jia Zhang
Zhenzhen Liu
Zhuoling Lin
Xiaoyan Li
Jingjing Chen
Qianzhong Cao
Jing Li
Xiaohang Wu
Dongni Wang
Haotian Lin
spellingShingle Xiyang Liu
Jiewei Jiang
Kai Zhang
Erping Long
Jiangtao Cui
Mingmin Zhu
Yingying An
Jia Zhang
Zhenzhen Liu
Zhuoling Lin
Xiaoyan Li
Jingjing Chen
Qianzhong Cao
Jing Li
Xiaohang Wu
Dongni Wang
Haotian Lin
Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network.
PLoS ONE
author_facet Xiyang Liu
Jiewei Jiang
Kai Zhang
Erping Long
Jiangtao Cui
Mingmin Zhu
Yingying An
Jia Zhang
Zhenzhen Liu
Zhuoling Lin
Xiaoyan Li
Jingjing Chen
Qianzhong Cao
Jing Li
Xiaohang Wu
Dongni Wang
Haotian Lin
author_sort Xiyang Liu
title Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network.
title_short Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network.
title_full Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network.
title_fullStr Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network.
title_full_unstemmed Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network.
title_sort localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network.
publisher Public Library of Science (PLoS)
series PLoS ONE
issn 1932-6203
publishDate 2017-01-01
description Slit-lamp images play an essential role for diagnosis of pediatric cataracts. We present a computer vision-based framework for the automatic localization and diagnosis of slit-lamp images by identifying the lens region of interest (ROI) and employing a deep learning convolutional neural network (CNN). First, three grading degrees for slit-lamp images are proposed in conjunction with three leading ophthalmologists. The lens ROI is located in an automated manner in the original image using two successive applications of Candy detection and the Hough transform, which are cropped, resized to a fixed size and used to form pediatric cataract datasets. These datasets are fed into the CNN to extract high-level features and implement automatic classification and grading. To demonstrate the performance and effectiveness of the deep features extracted in the CNN, we investigate the features combined with support vector machine (SVM) and softmax classifier and compare these with the traditional representative methods. The qualitative and quantitative experimental results demonstrate that our proposed method offers exceptional mean accuracy, sensitivity and specificity: classification (97.07%, 97.28%, and 96.83%) and a three-degree grading area (89.02%, 86.63%, and 90.75%), density (92.68%, 91.05%, and 93.94%) and location (89.28%, 82.70%, and 93.08%). Finally, we developed and deployed a potential automatic diagnostic software for ophthalmologists and patients in clinical applications to implement the validated model.
url http://europepmc.org/articles/PMC5356999?pdf=render
work_keys_str_mv AT xiyangliu localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT jieweijiang localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT kaizhang localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT erpinglong localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT jiangtaocui localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT mingminzhu localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT yingyingan localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT jiazhang localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT zhenzhenliu localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT zhuolinglin localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT xiaoyanli localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT jingjingchen localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT qianzhongcao localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT jingli localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT xiaohangwu localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT dongniwang localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
AT haotianlin localizationanddiagnosisframeworkforpediatriccataractsbasedonslitlampimagesusingdeepfeaturesofaconvolutionalneuralnetwork
_version_ 1724939773075783680