Intra-Scanner and Inter-Scanner Reproducibility of Automatic White Matter Hyperintensities Quantification

Objectives: To evaluate white matter hyperintensities (WMH) quantification reproducibility from multiple aspects of view and examine the effects of scan–rescan procedure, types of scanner, imaging protocols, scanner software upgrade, and automatic segmentation tools on WMH quantification results usi...

Full description

Bibliographic Details
Published in:Frontiers in Neuroscience
Main Authors: Chunjie Guo, Kai Niu, Yishan Luo, Lin Shi, Zhuo Wang, Meng Zhao, Defeng Wang, Wan’an Zhu, Huimao Zhang, Li Sun
Format: Article
Language:English
Published: Frontiers Media S.A. 2019-07-01
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fnins.2019.00679/full
_version_ 1852761735217283072
author Chunjie Guo
Kai Niu
Yishan Luo
Lin Shi
Lin Shi
Zhuo Wang
Meng Zhao
Defeng Wang
Defeng Wang
Wan’an Zhu
Huimao Zhang
Li Sun
author_facet Chunjie Guo
Kai Niu
Yishan Luo
Lin Shi
Lin Shi
Zhuo Wang
Meng Zhao
Defeng Wang
Defeng Wang
Wan’an Zhu
Huimao Zhang
Li Sun
author_sort Chunjie Guo
collection DOAJ
container_title Frontiers in Neuroscience
description Objectives: To evaluate white matter hyperintensities (WMH) quantification reproducibility from multiple aspects of view and examine the effects of scan–rescan procedure, types of scanner, imaging protocols, scanner software upgrade, and automatic segmentation tools on WMH quantification results using magnetic resonance imaging (MRI).Methods: Six post-stroke subjects (4 males; mean age = 62.8, range = 58–72 years) were scanned and rescanned with both 3D T1-weighted, 2D and 3D T2-weighted fluid-attenuated inversion recovery (T2-FLAIR) MRI across four different MRI scanners within 12 h. Two automated WMH segmentation and quantification tools were used to measure WMH volume based on each MR scan. Robustness was assessed using the coefficient of variation (CV), Dice similarity coefficient (DSC), and intra-class correlation (ICC).Results: Experimental results show that the best reproducibility was achieved by using 3D T2-FLAIR MRI under intra-scanner setting with CV ranging from 2.69 to 2.97%, while the largest variability resulted from comparing WMH volumes measured based on 2D T2-FLAIR MRI with those of 3D T2-FLAIR MRI, with CV values in the range of 15.62%–29.33%. The WMH quantification variability based on 2D MRIs is larger than 3D MRIs due to their large slice thickness. The DSC of WMH segmentation labels between intra-scanner MRIs ranges from 0.63 to 0.77, while that for inter-scanner MRIs is in the range of 0.63–0.65. In addition to image acquisition, the choice of automatic WMH segmentation tool also has a large impact on WMH quantification.Conclusion: WMH reproducibility is one of the primary issues to be considered in multicenter and longitudinal studies. The study provides solid guidance in assisting multicenter and longitudinal study design to achieve meaningful results with enough power.
format Article
id doaj-art-0fcf6ee675914fdca5cbdda3ad72b00a
institution Directory of Open Access Journals
issn 1662-453X
language English
publishDate 2019-07-01
publisher Frontiers Media S.A.
record_format Article
spelling doaj-art-0fcf6ee675914fdca5cbdda3ad72b00a2025-08-19T20:55:46ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2019-07-011310.3389/fnins.2019.00679447716Intra-Scanner and Inter-Scanner Reproducibility of Automatic White Matter Hyperintensities QuantificationChunjie Guo0Kai Niu1Yishan Luo2Lin Shi3Lin Shi4Zhuo Wang5Meng Zhao6Defeng Wang7Defeng Wang8Wan’an Zhu9Huimao Zhang10Li Sun11Department of Radiology, The First Hospital of Jilin University, Changchun, ChinaDepartment of Otorhinolaryngology Head and Neck Surgery, The First Hospital of Jilin University, Changchun, ChinaBrainNow Medical Technology Limited, Sha Tin, Hong KongBrainNow Medical Technology Limited, Sha Tin, Hong KongDepartment of Imaging and Interventional Radiology, The Chinese University of Hong Kong, Sha Tin, Hong KongDepartment of Radiology, The First Hospital of Jilin University, Changchun, ChinaDepartment of Neurology and Neuroscience Center, The First Hospital of Jilin University, Changchun, ChinaDepartment of Radiology, The First Hospital of Jilin University, Changchun, ChinaDepartment of Imaging and Interventional Radiology, The Chinese University of Hong Kong, Sha Tin, Hong KongDepartment of Radiology, The First Hospital of Jilin University, Changchun, ChinaDepartment of Radiology, The First Hospital of Jilin University, Changchun, ChinaDepartment of Neurology and Neuroscience Center, The First Hospital of Jilin University, Changchun, ChinaObjectives: To evaluate white matter hyperintensities (WMH) quantification reproducibility from multiple aspects of view and examine the effects of scan–rescan procedure, types of scanner, imaging protocols, scanner software upgrade, and automatic segmentation tools on WMH quantification results using magnetic resonance imaging (MRI).Methods: Six post-stroke subjects (4 males; mean age = 62.8, range = 58–72 years) were scanned and rescanned with both 3D T1-weighted, 2D and 3D T2-weighted fluid-attenuated inversion recovery (T2-FLAIR) MRI across four different MRI scanners within 12 h. Two automated WMH segmentation and quantification tools were used to measure WMH volume based on each MR scan. Robustness was assessed using the coefficient of variation (CV), Dice similarity coefficient (DSC), and intra-class correlation (ICC).Results: Experimental results show that the best reproducibility was achieved by using 3D T2-FLAIR MRI under intra-scanner setting with CV ranging from 2.69 to 2.97%, while the largest variability resulted from comparing WMH volumes measured based on 2D T2-FLAIR MRI with those of 3D T2-FLAIR MRI, with CV values in the range of 15.62%–29.33%. The WMH quantification variability based on 2D MRIs is larger than 3D MRIs due to their large slice thickness. The DSC of WMH segmentation labels between intra-scanner MRIs ranges from 0.63 to 0.77, while that for inter-scanner MRIs is in the range of 0.63–0.65. In addition to image acquisition, the choice of automatic WMH segmentation tool also has a large impact on WMH quantification.Conclusion: WMH reproducibility is one of the primary issues to be considered in multicenter and longitudinal studies. The study provides solid guidance in assisting multicenter and longitudinal study design to achieve meaningful results with enough power.https://www.frontiersin.org/article/10.3389/fnins.2019.00679/fullreproducibility of resultswhite mattermagnetic resonance imagingbrainimagingthree-dimensional
spellingShingle Chunjie Guo
Kai Niu
Yishan Luo
Lin Shi
Lin Shi
Zhuo Wang
Meng Zhao
Defeng Wang
Defeng Wang
Wan’an Zhu
Huimao Zhang
Li Sun
Intra-Scanner and Inter-Scanner Reproducibility of Automatic White Matter Hyperintensities Quantification
reproducibility of results
white matter
magnetic resonance imaging
brain
imaging
three-dimensional
title Intra-Scanner and Inter-Scanner Reproducibility of Automatic White Matter Hyperintensities Quantification
title_full Intra-Scanner and Inter-Scanner Reproducibility of Automatic White Matter Hyperintensities Quantification
title_fullStr Intra-Scanner and Inter-Scanner Reproducibility of Automatic White Matter Hyperintensities Quantification
title_full_unstemmed Intra-Scanner and Inter-Scanner Reproducibility of Automatic White Matter Hyperintensities Quantification
title_short Intra-Scanner and Inter-Scanner Reproducibility of Automatic White Matter Hyperintensities Quantification
title_sort intra scanner and inter scanner reproducibility of automatic white matter hyperintensities quantification
topic reproducibility of results
white matter
magnetic resonance imaging
brain
imaging
three-dimensional
url https://www.frontiersin.org/article/10.3389/fnins.2019.00679/full
work_keys_str_mv AT chunjieguo intrascannerandinterscannerreproducibilityofautomaticwhitematterhyperintensitiesquantification
AT kainiu intrascannerandinterscannerreproducibilityofautomaticwhitematterhyperintensitiesquantification
AT yishanluo intrascannerandinterscannerreproducibilityofautomaticwhitematterhyperintensitiesquantification
AT linshi intrascannerandinterscannerreproducibilityofautomaticwhitematterhyperintensitiesquantification
AT linshi intrascannerandinterscannerreproducibilityofautomaticwhitematterhyperintensitiesquantification
AT zhuowang intrascannerandinterscannerreproducibilityofautomaticwhitematterhyperintensitiesquantification
AT mengzhao intrascannerandinterscannerreproducibilityofautomaticwhitematterhyperintensitiesquantification
AT defengwang intrascannerandinterscannerreproducibilityofautomaticwhitematterhyperintensitiesquantification
AT defengwang intrascannerandinterscannerreproducibilityofautomaticwhitematterhyperintensitiesquantification
AT wananzhu intrascannerandinterscannerreproducibilityofautomaticwhitematterhyperintensitiesquantification
AT huimaozhang intrascannerandinterscannerreproducibilityofautomaticwhitematterhyperintensitiesquantification
AT lisun intrascannerandinterscannerreproducibilityofautomaticwhitematterhyperintensitiesquantification