Embodiment Is Related to Better Performance on a Brain–Computer Interface in Immersive Virtual Reality: A Pilot Study

Electroencephalography (EEG)-based brain−computer interfaces (BCIs) for motor rehabilitation aim to “close the loop” between attempted motor commands and sensory feedback by providing supplemental information when individuals successfully achieve specific brain patterns...

Full description

Bibliographic Details
Main Authors: Julia M. Juliano, Ryan P. Spicer, Athanasios Vourvopoulos, Stephanie Lefebvre, Kay Jann, Tyler Ard, Emiliano Santarnecchi, David M. Krum, Sook-Lei Liew
Format: Article
Language:English
Published: MDPI AG 2020-02-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/4/1204
id doaj-1b7bc966e1294dc29b119e428eb159f3
record_format Article
spelling doaj-1b7bc966e1294dc29b119e428eb159f32020-11-25T03:32:29ZengMDPI AGSensors1424-82202020-02-01204120410.3390/s20041204s20041204Embodiment Is Related to Better Performance on a Brain–Computer Interface in Immersive Virtual Reality: A Pilot StudyJulia M. Juliano0Ryan P. Spicer1Athanasios Vourvopoulos2Stephanie Lefebvre3Kay Jann4Tyler Ard5Emiliano Santarnecchi6David M. Krum7Sook-Lei Liew8Neural Plasticity and Neurorehabilitation Laboratory, Neuroscience Graduate Program, University of Southern California, Los Angeles, CA 90089, USAInstitute for Creative Technologies, University of Southern California, Playa Vista, CA 90094, USANeural Plasticity and Neurorehabilitation Laboratory, Division of Occupational Science and Occupational Therapy, University of Southern California, Los Angeles, CA 90089, USANeural Plasticity and Neurorehabilitation Laboratory, Division of Occupational Science and Occupational Therapy, University of Southern California, Los Angeles, CA 90089, USAUSC Stevens Neuroimaging and Informatics Institute, Department of Neurology, University of Southern California, Los Angeles, CA 90033, USAUSC Stevens Neuroimaging and Informatics Institute, Department of Neurology, University of Southern California, Los Angeles, CA 90033, USABerenson-Allen Center for Non-Invasive Brain Stimulation and Division of Cognitive Neurology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA 02215, USAInstitute for Creative Technologies, University of Southern California, Playa Vista, CA 90094, USANeural Plasticity and Neurorehabilitation Laboratory, Division of Occupational Science and Occupational Therapy, University of Southern California, Los Angeles, CA 90089, USAElectroencephalography (EEG)-based brain−computer interfaces (BCIs) for motor rehabilitation aim to “close the loop” between attempted motor commands and sensory feedback by providing supplemental information when individuals successfully achieve specific brain patterns. Existing EEG-based BCIs use various displays to provide feedback, ranging from displays considered more immersive (e.g., head-mounted display virtual reality (HMD-VR)) to displays considered less immersive (e.g., computer screens). However, it is not clear whether more immersive displays improve neurofeedback performance and whether there are individual performance differences in HMD-VR versus screen-based neurofeedback. In this pilot study, we compared neurofeedback performance in HMD-VR versus a computer screen in 12 healthy individuals and examined whether individual differences on two measures (i.e., presence, embodiment) were related to neurofeedback performance in either environment. We found that, while participants’ performance on the BCI was similar between display conditions, the participants’ reported levels of embodiment were significantly different. Specifically, participants experienced higher levels of embodiment in HMD-VR compared to a computer screen. We further found that reported levels of embodiment positively correlated with neurofeedback performance only in HMD-VR. Overall, these preliminary results suggest that embodiment may relate to better performance on EEG-based BCIs and that HMD-VR may increase embodiment compared to computer screens.https://www.mdpi.com/1424-8220/20/4/1204brain–computer interfaceneurofeedbackimmersive virtual realityhead-mounted displayelectroencephalographypresenceembodiment
collection DOAJ
language English
format Article
sources DOAJ
author Julia M. Juliano
Ryan P. Spicer
Athanasios Vourvopoulos
Stephanie Lefebvre
Kay Jann
Tyler Ard
Emiliano Santarnecchi
David M. Krum
Sook-Lei Liew
spellingShingle Julia M. Juliano
Ryan P. Spicer
Athanasios Vourvopoulos
Stephanie Lefebvre
Kay Jann
Tyler Ard
Emiliano Santarnecchi
David M. Krum
Sook-Lei Liew
Embodiment Is Related to Better Performance on a Brain–Computer Interface in Immersive Virtual Reality: A Pilot Study
Sensors
brain–computer interface
neurofeedback
immersive virtual reality
head-mounted display
electroencephalography
presence
embodiment
author_facet Julia M. Juliano
Ryan P. Spicer
Athanasios Vourvopoulos
Stephanie Lefebvre
Kay Jann
Tyler Ard
Emiliano Santarnecchi
David M. Krum
Sook-Lei Liew
author_sort Julia M. Juliano
title Embodiment Is Related to Better Performance on a Brain–Computer Interface in Immersive Virtual Reality: A Pilot Study
title_short Embodiment Is Related to Better Performance on a Brain–Computer Interface in Immersive Virtual Reality: A Pilot Study
title_full Embodiment Is Related to Better Performance on a Brain–Computer Interface in Immersive Virtual Reality: A Pilot Study
title_fullStr Embodiment Is Related to Better Performance on a Brain–Computer Interface in Immersive Virtual Reality: A Pilot Study
title_full_unstemmed Embodiment Is Related to Better Performance on a Brain–Computer Interface in Immersive Virtual Reality: A Pilot Study
title_sort embodiment is related to better performance on a brain–computer interface in immersive virtual reality: a pilot study
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2020-02-01
description Electroencephalography (EEG)-based brain−computer interfaces (BCIs) for motor rehabilitation aim to “close the loop” between attempted motor commands and sensory feedback by providing supplemental information when individuals successfully achieve specific brain patterns. Existing EEG-based BCIs use various displays to provide feedback, ranging from displays considered more immersive (e.g., head-mounted display virtual reality (HMD-VR)) to displays considered less immersive (e.g., computer screens). However, it is not clear whether more immersive displays improve neurofeedback performance and whether there are individual performance differences in HMD-VR versus screen-based neurofeedback. In this pilot study, we compared neurofeedback performance in HMD-VR versus a computer screen in 12 healthy individuals and examined whether individual differences on two measures (i.e., presence, embodiment) were related to neurofeedback performance in either environment. We found that, while participants’ performance on the BCI was similar between display conditions, the participants’ reported levels of embodiment were significantly different. Specifically, participants experienced higher levels of embodiment in HMD-VR compared to a computer screen. We further found that reported levels of embodiment positively correlated with neurofeedback performance only in HMD-VR. Overall, these preliminary results suggest that embodiment may relate to better performance on EEG-based BCIs and that HMD-VR may increase embodiment compared to computer screens.
topic brain–computer interface
neurofeedback
immersive virtual reality
head-mounted display
electroencephalography
presence
embodiment
url https://www.mdpi.com/1424-8220/20/4/1204
work_keys_str_mv AT juliamjuliano embodimentisrelatedtobetterperformanceonabraincomputerinterfaceinimmersivevirtualrealityapilotstudy
AT ryanpspicer embodimentisrelatedtobetterperformanceonabraincomputerinterfaceinimmersivevirtualrealityapilotstudy
AT athanasiosvourvopoulos embodimentisrelatedtobetterperformanceonabraincomputerinterfaceinimmersivevirtualrealityapilotstudy
AT stephanielefebvre embodimentisrelatedtobetterperformanceonabraincomputerinterfaceinimmersivevirtualrealityapilotstudy
AT kayjann embodimentisrelatedtobetterperformanceonabraincomputerinterfaceinimmersivevirtualrealityapilotstudy
AT tylerard embodimentisrelatedtobetterperformanceonabraincomputerinterfaceinimmersivevirtualrealityapilotstudy
AT emilianosantarnecchi embodimentisrelatedtobetterperformanceonabraincomputerinterfaceinimmersivevirtualrealityapilotstudy
AT davidmkrum embodimentisrelatedtobetterperformanceonabraincomputerinterfaceinimmersivevirtualrealityapilotstudy
AT sookleiliew embodimentisrelatedtobetterperformanceonabraincomputerinterfaceinimmersivevirtualrealityapilotstudy
_version_ 1724567954567200768