Multiuser virtual reality environment for visualising neuroimaging data
The recent advent of high-performance consumer virtual reality (VR) systems has opened new possibilities for immersive visualisation of numerous types of data. Medical imaging has long made use of advanced visualisation techniques, and VR offers exciting new opportunities for data exploration. The a...
Main Author: | |
---|---|
Format: | Article |
Language: | English |
Published: |
Wiley
2018-10-01
|
Series: | Healthcare Technology Letters |
Subjects: | |
Online Access: | https://digital-library.theiet.org/content/journals/10.1049/htl.2018.5077 |
id |
doaj-2556b38588f04260b410038e11881be0 |
---|---|
record_format |
Article |
spelling |
doaj-2556b38588f04260b410038e11881be02021-04-02T11:40:36ZengWileyHealthcare Technology Letters2053-37132018-10-0110.1049/htl.2018.5077HTL.2018.5077Multiuser virtual reality environment for visualising neuroimaging dataDavid W. Shattuck0Ahmanson-Lovelace Brain Mapping Center, Department of Neurology, David Geffen School of Medicine at UCLAThe recent advent of high-performance consumer virtual reality (VR) systems has opened new possibilities for immersive visualisation of numerous types of data. Medical imaging has long made use of advanced visualisation techniques, and VR offers exciting new opportunities for data exploration. The author presents a new framework for interacting with neuroimaging data, including MRI volumes, neuroanatomical surface models, diffusion tensors, and streamline tractography, as well as text-based annotations. The system was developed for the HTC Vive using C++, OpenGL, and the OpenVR software development kit. The author developed custom GLSL shaders for each type of data to provide high-performance real-time rendering suitable for use in a VR environment. These are integrated with an interface that enables the user to manipulate the scene through the Vive controllers and perform operations such as volume slicing, fibre track selection, and structural queries. The software can read data generated by existing automated brain MRI analysis packages, enabling the rapid development of subject-specific visualisations of multimodal data or annotated atlases. The system can also support multiple simultaneous users, placing them in the same virtual space to interact with each other while visualising the same datasets, opening new possibilities for teaching and for collaborative exploration of neuroimaging data.https://digital-library.theiet.org/content/journals/10.1049/htl.2018.5077brainbiomedical MRImedical image processingvirtual realityrendering (computer graphics)neurophysiologydata visualisationneuroimaging datahigh-performance consumer virtual reality systemsMRI volumesneuroanatomical surface modelstext-based annotationsOpenVR software development kitvirtual spacemultiuser virtual reality environmentmedical imagingdiffusion tensorsstreamline tractographyHTC ViveOpenGLfibre track selectionautomated brain MRI analysis packagesVive controllers |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
David W. Shattuck |
spellingShingle |
David W. Shattuck Multiuser virtual reality environment for visualising neuroimaging data Healthcare Technology Letters brain biomedical MRI medical image processing virtual reality rendering (computer graphics) neurophysiology data visualisation neuroimaging data high-performance consumer virtual reality systems MRI volumes neuroanatomical surface models text-based annotations OpenVR software development kit virtual space multiuser virtual reality environment medical imaging diffusion tensors streamline tractography HTC Vive OpenGL fibre track selection automated brain MRI analysis packages Vive controllers |
author_facet |
David W. Shattuck |
author_sort |
David W. Shattuck |
title |
Multiuser virtual reality environment for visualising neuroimaging data |
title_short |
Multiuser virtual reality environment for visualising neuroimaging data |
title_full |
Multiuser virtual reality environment for visualising neuroimaging data |
title_fullStr |
Multiuser virtual reality environment for visualising neuroimaging data |
title_full_unstemmed |
Multiuser virtual reality environment for visualising neuroimaging data |
title_sort |
multiuser virtual reality environment for visualising neuroimaging data |
publisher |
Wiley |
series |
Healthcare Technology Letters |
issn |
2053-3713 |
publishDate |
2018-10-01 |
description |
The recent advent of high-performance consumer virtual reality (VR) systems has opened new possibilities for immersive visualisation of numerous types of data. Medical imaging has long made use of advanced visualisation techniques, and VR offers exciting new opportunities for data exploration. The author presents a new framework for interacting with neuroimaging data, including MRI volumes, neuroanatomical surface models, diffusion tensors, and streamline tractography, as well as text-based annotations. The system was developed for the HTC Vive using C++, OpenGL, and the OpenVR software development kit. The author developed custom GLSL shaders for each type of data to provide high-performance real-time rendering suitable for use in a VR environment. These are integrated with an interface that enables the user to manipulate the scene through the Vive controllers and perform operations such as volume slicing, fibre track selection, and structural queries. The software can read data generated by existing automated brain MRI analysis packages, enabling the rapid development of subject-specific visualisations of multimodal data or annotated atlases. The system can also support multiple simultaneous users, placing them in the same virtual space to interact with each other while visualising the same datasets, opening new possibilities for teaching and for collaborative exploration of neuroimaging data. |
topic |
brain biomedical MRI medical image processing virtual reality rendering (computer graphics) neurophysiology data visualisation neuroimaging data high-performance consumer virtual reality systems MRI volumes neuroanatomical surface models text-based annotations OpenVR software development kit virtual space multiuser virtual reality environment medical imaging diffusion tensors streamline tractography HTC Vive OpenGL fibre track selection automated brain MRI analysis packages Vive controllers |
url |
https://digital-library.theiet.org/content/journals/10.1049/htl.2018.5077 |
work_keys_str_mv |
AT davidwshattuck multiuservirtualrealityenvironmentforvisualisingneuroimagingdata |
_version_ |
1721571667469139968 |