Joint super-resolution and synthesis of 1 mm isotropic MP-RAGE volumes from clinical MRI exams with scans of different orientation, resolution and contrast
Most existing algorithms for automatic 3D morphometry of human brain MRI scans are designed for data with near-isotropic voxels at approximately 1 mm resolution, and frequently have contrast constraints as well-typically requiring T1-weighted images (e.g., MP-RAGE scans). This limitation prevents th...
Main Authors: | , , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Elsevier
2021-08-01
|
Series: | NeuroImage |
Subjects: | |
Online Access: | http://www.sciencedirect.com/science/article/pii/S1053811921004833 |
id |
doaj-b4c5b586bd5e49b4ac557f0b07fce56e |
---|---|
record_format |
Article |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Juan Eugenio Iglesias Benjamin Billot Yaël Balbastre Azadeh Tabari John Conklin R. Gilberto González Daniel C. Alexander Polina Golland Brian L. Edlow Bruce Fischl |
spellingShingle |
Juan Eugenio Iglesias Benjamin Billot Yaël Balbastre Azadeh Tabari John Conklin R. Gilberto González Daniel C. Alexander Polina Golland Brian L. Edlow Bruce Fischl Joint super-resolution and synthesis of 1 mm isotropic MP-RAGE volumes from clinical MRI exams with scans of different orientation, resolution and contrast NeuroImage Super-resolution Clinical scans Convolutional neural network Public software |
author_facet |
Juan Eugenio Iglesias Benjamin Billot Yaël Balbastre Azadeh Tabari John Conklin R. Gilberto González Daniel C. Alexander Polina Golland Brian L. Edlow Bruce Fischl |
author_sort |
Juan Eugenio Iglesias |
title |
Joint super-resolution and synthesis of 1 mm isotropic MP-RAGE volumes from clinical MRI exams with scans of different orientation, resolution and contrast |
title_short |
Joint super-resolution and synthesis of 1 mm isotropic MP-RAGE volumes from clinical MRI exams with scans of different orientation, resolution and contrast |
title_full |
Joint super-resolution and synthesis of 1 mm isotropic MP-RAGE volumes from clinical MRI exams with scans of different orientation, resolution and contrast |
title_fullStr |
Joint super-resolution and synthesis of 1 mm isotropic MP-RAGE volumes from clinical MRI exams with scans of different orientation, resolution and contrast |
title_full_unstemmed |
Joint super-resolution and synthesis of 1 mm isotropic MP-RAGE volumes from clinical MRI exams with scans of different orientation, resolution and contrast |
title_sort |
joint super-resolution and synthesis of 1 mm isotropic mp-rage volumes from clinical mri exams with scans of different orientation, resolution and contrast |
publisher |
Elsevier |
series |
NeuroImage |
issn |
1095-9572 |
publishDate |
2021-08-01 |
description |
Most existing algorithms for automatic 3D morphometry of human brain MRI scans are designed for data with near-isotropic voxels at approximately 1 mm resolution, and frequently have contrast constraints as well-typically requiring T1-weighted images (e.g., MP-RAGE scans). This limitation prevents the analysis of millions of MRI scans acquired with large inter-slice spacing in clinical settings every year. In turn, the inability to quantitatively analyze these scans hinders the adoption of quantitative neuro imaging in healthcare, and also precludes research studies that could attain huge sample sizes and hence greatly improve our understanding of the human brain. Recent advances in convolutional neural networks (CNNs) are producing outstanding results in super-resolution and contrast synthesis of MRI. However, these approaches are very sensitive to the specific combination of contrast, resolution and orientation of the input images, and thus do not generalize to diverse clinical acquisition protocols – even within sites. In this article, we present SynthSR, a method to train a CNN that receives one or more scans with spaced slices, acquired with different contrast, resolution and orientation, and produces an isotropic scan of canonical contrast (typically a 1 mm MP-RAGE). The presented method does not require any preprocessing, beyond rigid coregistration of the input scans. Crucially, SynthSR trains on synthetic input images generated from 3D segmentations, and can thus be used to train CNNs for any combination of contrasts, resolutions and orientations without high-resolution real images of the input contrasts. We test the images generated with SynthSR in an array of common downstream analyses, and show that they can be reliably used for subcortical segmentation and volumetry, image registration (e.g., for tensor-based morphometry), and, if some image quality requirements are met, even cortical thickness morphometry. The source code is publicly available at https://github.com/BBillot/SynthSR. |
topic |
Super-resolution Clinical scans Convolutional neural network Public software |
url |
http://www.sciencedirect.com/science/article/pii/S1053811921004833 |
work_keys_str_mv |
AT juaneugenioiglesias jointsuperresolutionandsynthesisof1mmisotropicmpragevolumesfromclinicalmriexamswithscansofdifferentorientationresolutionandcontrast AT benjaminbillot jointsuperresolutionandsynthesisof1mmisotropicmpragevolumesfromclinicalmriexamswithscansofdifferentorientationresolutionandcontrast AT yaelbalbastre jointsuperresolutionandsynthesisof1mmisotropicmpragevolumesfromclinicalmriexamswithscansofdifferentorientationresolutionandcontrast AT azadehtabari jointsuperresolutionandsynthesisof1mmisotropicmpragevolumesfromclinicalmriexamswithscansofdifferentorientationresolutionandcontrast AT johnconklin jointsuperresolutionandsynthesisof1mmisotropicmpragevolumesfromclinicalmriexamswithscansofdifferentorientationresolutionandcontrast AT rgilbertogonzalez jointsuperresolutionandsynthesisof1mmisotropicmpragevolumesfromclinicalmriexamswithscansofdifferentorientationresolutionandcontrast AT danielcalexander jointsuperresolutionandsynthesisof1mmisotropicmpragevolumesfromclinicalmriexamswithscansofdifferentorientationresolutionandcontrast AT polinagolland jointsuperresolutionandsynthesisof1mmisotropicmpragevolumesfromclinicalmriexamswithscansofdifferentorientationresolutionandcontrast AT brianledlow jointsuperresolutionandsynthesisof1mmisotropicmpragevolumesfromclinicalmriexamswithscansofdifferentorientationresolutionandcontrast AT brucefischl jointsuperresolutionandsynthesisof1mmisotropicmpragevolumesfromclinicalmriexamswithscansofdifferentorientationresolutionandcontrast |
_version_ |
1721321320502788096 |
spelling |
doaj-b4c5b586bd5e49b4ac557f0b07fce56e2021-07-03T04:44:29ZengElsevierNeuroImage1095-95722021-08-01237118206Joint super-resolution and synthesis of 1 mm isotropic MP-RAGE volumes from clinical MRI exams with scans of different orientation, resolution and contrastJuan Eugenio Iglesias0Benjamin Billot1Yaël Balbastre2Azadeh Tabari3John Conklin4R. Gilberto González5Daniel C. Alexander6Polina Golland7Brian L. Edlow8Bruce Fischl9Corresponding author at: Centre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, London, UK.; Centre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, UK; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Boston, USA; Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Boston, USACentre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, UKCentre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, UKAthinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Boston, USA; Department of Radiology, Massachusetts General Hospital, Boston, USAAthinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Boston, USA; Department of Radiology, Massachusetts General Hospital, Boston, USAAthinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Boston, USA; Neuroradiology Division, Massachusetts General Hospital, Boston, USACentre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, UKComputer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Boston, USAAthinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Boston, USA; Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital, Boston, USAAthinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Boston, USAMost existing algorithms for automatic 3D morphometry of human brain MRI scans are designed for data with near-isotropic voxels at approximately 1 mm resolution, and frequently have contrast constraints as well-typically requiring T1-weighted images (e.g., MP-RAGE scans). This limitation prevents the analysis of millions of MRI scans acquired with large inter-slice spacing in clinical settings every year. In turn, the inability to quantitatively analyze these scans hinders the adoption of quantitative neuro imaging in healthcare, and also precludes research studies that could attain huge sample sizes and hence greatly improve our understanding of the human brain. Recent advances in convolutional neural networks (CNNs) are producing outstanding results in super-resolution and contrast synthesis of MRI. However, these approaches are very sensitive to the specific combination of contrast, resolution and orientation of the input images, and thus do not generalize to diverse clinical acquisition protocols – even within sites. In this article, we present SynthSR, a method to train a CNN that receives one or more scans with spaced slices, acquired with different contrast, resolution and orientation, and produces an isotropic scan of canonical contrast (typically a 1 mm MP-RAGE). The presented method does not require any preprocessing, beyond rigid coregistration of the input scans. Crucially, SynthSR trains on synthetic input images generated from 3D segmentations, and can thus be used to train CNNs for any combination of contrasts, resolutions and orientations without high-resolution real images of the input contrasts. We test the images generated with SynthSR in an array of common downstream analyses, and show that they can be reliably used for subcortical segmentation and volumetry, image registration (e.g., for tensor-based morphometry), and, if some image quality requirements are met, even cortical thickness morphometry. The source code is publicly available at https://github.com/BBillot/SynthSR.http://www.sciencedirect.com/science/article/pii/S1053811921004833Super-resolutionClinical scansConvolutional neural networkPublic software |