A comparison of automated segmentation and manual tracing in estimating hippocampal volume in ischemic stroke and healthy control participants

Manual quantification of the hippocampal atrophy state and rate is time consuming and prone to poor reproducibility, even when performed by neuroanatomical experts. The automation of hippocampal segmentation has been investigated in normal aging, epilepsy, and in Alzheimer's disease. Our first...

Full description

Bibliographic Details
Published in:NeuroImage: Clinical
Main Authors: Mohamed Salah Khlif, Natalia Egorova, Emilio Werden, Alberto Redolfi, Marina Boccardi, Charles S. DeCarli, Evan Fletcher, Baljeet Singh, Qi Li, Laura Bird, Amy Brodtmann
Format: Article
Language:English
Published: Elsevier 2019-01-01
Online Access:http://www.sciencedirect.com/science/article/pii/S2213158218303292
_version_ 1852738212424843264
author Mohamed Salah Khlif
Natalia Egorova
Emilio Werden
Alberto Redolfi
Marina Boccardi
Charles S. DeCarli
Evan Fletcher
Baljeet Singh
Qi Li
Laura Bird
Amy Brodtmann
author_facet Mohamed Salah Khlif
Natalia Egorova
Emilio Werden
Alberto Redolfi
Marina Boccardi
Charles S. DeCarli
Evan Fletcher
Baljeet Singh
Qi Li
Laura Bird
Amy Brodtmann
author_sort Mohamed Salah Khlif
collection DOAJ
container_title NeuroImage: Clinical
description Manual quantification of the hippocampal atrophy state and rate is time consuming and prone to poor reproducibility, even when performed by neuroanatomical experts. The automation of hippocampal segmentation has been investigated in normal aging, epilepsy, and in Alzheimer's disease. Our first goal was to compare manual and automated hippocampal segmentation in ischemic stroke and to, secondly, study the impact of stroke lesion presence on hippocampal volume estimation. We used eight automated methods to segment T1-weighted MR images from 105 ischemic stroke patients and 39 age-matched controls sampled from the Cognition And Neocortical Volume After Stroke (CANVAS) study. The methods were: AdaBoost, Atlas-based Hippocampal Segmentation (ABHS) from the IDeALab, Computational Anatomy Toolbox (CAT) using 3 atlas variants (Hammers, LPBA40 and Neuromorphometics), FIRST, FreeSurfer v5.3, and FreeSurfer v6.0-Subfields. A number of these methods were employed to re-segment the T1 images for the stroke group after the stroke lesions were masked (i.e., removed). The automated methods were assessed on eight measures: process yield (i.e. segmentation success rate), correlation (Pearson's R and Shrout's ICC), concordance (Lin's RC and Kandall's W), slope ‘a’ of best-fit line from correlation plots, percentage of outliers from Bland-Altman plots, and significance of control−stroke difference. We eliminated the redundant measures after analysing between-measure correlations using Spearman's rank correlation. We ranked the automated methods based on the sum of the remaining non-redundant measures where each measure ranged between 0 and 1. Subfields attained an overall score of 96.3%, followed by AdaBoost (95.0%) and FIRST (94.7%). CAT using the LPBA40 atlas inflated hippocampal volumes the most, while the Hammers atlas returned the smallest volumes overall. FIRST (p = 0.014), FreeSurfer v5.3 (p = 0.007), manual tracing (p = 0.049), and CAT using the Neuromorphometics atlas (p = 0.017) all showed a significantly reduced hippocampal volume mean for the stroke group compared to control at three months. Moreover, masking of the stroke lesions prior to segmentation resulted in hippocampal volumes which agreed less with manual tracing. These findings recommend an automated segmentation without lesion masking as a more reliable procedure for the estimation of hippocampal volume in ischemic stroke. Keywords: Hippocampus, Magnetic resonance imaging, Automatic segmentation, Manual segmentation, Stroke
format Article
id doaj-art-e996edf564dc4ccfb146cae6b68fcbbd
institution Directory of Open Access Journals
issn 2213-1582
language English
publishDate 2019-01-01
publisher Elsevier
record_format Article
spelling doaj-art-e996edf564dc4ccfb146cae6b68fcbbd2025-08-19T21:05:51ZengElsevierNeuroImage: Clinical2213-15822019-01-012110.1016/j.nicl.2018.10.019A comparison of automated segmentation and manual tracing in estimating hippocampal volume in ischemic stroke and healthy control participantsMohamed Salah Khlif0Natalia Egorova1Emilio Werden2Alberto Redolfi3Marina Boccardi4Charles S. DeCarli5Evan Fletcher6Baljeet Singh7Qi Li8Laura Bird9Amy Brodtmann10The Florey Institute for Neuroscience and Mental Health, University of Melbourne, Melbourne, Australia; Corresponding author.The Florey Institute for Neuroscience and Mental Health, University of Melbourne, Melbourne, AustraliaThe Florey Institute for Neuroscience and Mental Health, University of Melbourne, Melbourne, AustraliaLaboratory of Alzheimer Neuroimaging and Epidemiology, IRCCS S.Giovanni di Dio Fatebenefratelli, Brescia, ItalyLaboratory of Neuroimaging of Aging, University of Geneva, Geneva, SwitzerlandIDeA Laboratory, Department of Neurology, UC Davis School of Medicine, Davis, CA, USAIDeA Laboratory, Department of Neurology, UC Davis School of Medicine, Davis, CA, USAIDeA Laboratory, Department of Neurology, UC Davis School of Medicine, Davis, CA, USAThe Florey Institute for Neuroscience and Mental Health, University of Melbourne, Melbourne, AustraliaThe Florey Institute for Neuroscience and Mental Health, University of Melbourne, Melbourne, AustraliaThe Florey Institute for Neuroscience and Mental Health, University of Melbourne, Melbourne, AustraliaManual quantification of the hippocampal atrophy state and rate is time consuming and prone to poor reproducibility, even when performed by neuroanatomical experts. The automation of hippocampal segmentation has been investigated in normal aging, epilepsy, and in Alzheimer's disease. Our first goal was to compare manual and automated hippocampal segmentation in ischemic stroke and to, secondly, study the impact of stroke lesion presence on hippocampal volume estimation. We used eight automated methods to segment T1-weighted MR images from 105 ischemic stroke patients and 39 age-matched controls sampled from the Cognition And Neocortical Volume After Stroke (CANVAS) study. The methods were: AdaBoost, Atlas-based Hippocampal Segmentation (ABHS) from the IDeALab, Computational Anatomy Toolbox (CAT) using 3 atlas variants (Hammers, LPBA40 and Neuromorphometics), FIRST, FreeSurfer v5.3, and FreeSurfer v6.0-Subfields. A number of these methods were employed to re-segment the T1 images for the stroke group after the stroke lesions were masked (i.e., removed). The automated methods were assessed on eight measures: process yield (i.e. segmentation success rate), correlation (Pearson's R and Shrout's ICC), concordance (Lin's RC and Kandall's W), slope ‘a’ of best-fit line from correlation plots, percentage of outliers from Bland-Altman plots, and significance of control−stroke difference. We eliminated the redundant measures after analysing between-measure correlations using Spearman's rank correlation. We ranked the automated methods based on the sum of the remaining non-redundant measures where each measure ranged between 0 and 1. Subfields attained an overall score of 96.3%, followed by AdaBoost (95.0%) and FIRST (94.7%). CAT using the LPBA40 atlas inflated hippocampal volumes the most, while the Hammers atlas returned the smallest volumes overall. FIRST (p = 0.014), FreeSurfer v5.3 (p = 0.007), manual tracing (p = 0.049), and CAT using the Neuromorphometics atlas (p = 0.017) all showed a significantly reduced hippocampal volume mean for the stroke group compared to control at three months. Moreover, masking of the stroke lesions prior to segmentation resulted in hippocampal volumes which agreed less with manual tracing. These findings recommend an automated segmentation without lesion masking as a more reliable procedure for the estimation of hippocampal volume in ischemic stroke. Keywords: Hippocampus, Magnetic resonance imaging, Automatic segmentation, Manual segmentation, Strokehttp://www.sciencedirect.com/science/article/pii/S2213158218303292
spellingShingle Mohamed Salah Khlif
Natalia Egorova
Emilio Werden
Alberto Redolfi
Marina Boccardi
Charles S. DeCarli
Evan Fletcher
Baljeet Singh
Qi Li
Laura Bird
Amy Brodtmann
A comparison of automated segmentation and manual tracing in estimating hippocampal volume in ischemic stroke and healthy control participants
title A comparison of automated segmentation and manual tracing in estimating hippocampal volume in ischemic stroke and healthy control participants
title_full A comparison of automated segmentation and manual tracing in estimating hippocampal volume in ischemic stroke and healthy control participants
title_fullStr A comparison of automated segmentation and manual tracing in estimating hippocampal volume in ischemic stroke and healthy control participants
title_full_unstemmed A comparison of automated segmentation and manual tracing in estimating hippocampal volume in ischemic stroke and healthy control participants
title_short A comparison of automated segmentation and manual tracing in estimating hippocampal volume in ischemic stroke and healthy control participants
title_sort comparison of automated segmentation and manual tracing in estimating hippocampal volume in ischemic stroke and healthy control participants
url http://www.sciencedirect.com/science/article/pii/S2213158218303292
work_keys_str_mv AT mohamedsalahkhlif acomparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT nataliaegorova acomparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT emiliowerden acomparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT albertoredolfi acomparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT marinaboccardi acomparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT charlessdecarli acomparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT evanfletcher acomparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT baljeetsingh acomparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT qili acomparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT laurabird acomparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT amybrodtmann acomparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT mohamedsalahkhlif comparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT nataliaegorova comparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT emiliowerden comparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT albertoredolfi comparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT marinaboccardi comparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT charlessdecarli comparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT evanfletcher comparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT baljeetsingh comparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT qili comparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT laurabird comparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants
AT amybrodtmann comparisonofautomatedsegmentationandmanualtracinginestimatinghippocampalvolumeinischemicstrokeandhealthycontrolparticipants