Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention Shifts
Regaining communication abilities in patients who are unable to speak or move is one of the main goals in decoding brain waves for brain-computer interface (BCI) control. Many BCI approaches designed for communication rely on attention to visual stimuli, commonly applying an oddball paradigm, and re...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2020-12-01
|
Series: | Frontiers in Neuroscience |
Subjects: | |
Online Access: | https://www.frontiersin.org/articles/10.3389/fnins.2020.591777/full |
id |
doaj-c285160e13cf4370a8aa36ece6c82e8a |
---|---|
record_format |
Article |
spelling |
doaj-c285160e13cf4370a8aa36ece6c82e8a2020-12-08T08:38:12ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2020-12-011410.3389/fnins.2020.591777591777Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention ShiftsChristoph Reichert0Christoph Reichert1Christoph Reichert2Igor Fabian Tellez Ceja3Catherine M. Sweeney-Reed4Catherine M. Sweeney-Reed5Hans-Jochen Heinze6Hans-Jochen Heinze7Hans-Jochen Heinze8Hermann Hinrichs9Hermann Hinrichs10Hermann Hinrichs11Hermann Hinrichs12Stefan Dürschmid13Stefan Dürschmid14Department of Behavioral Neurology, Leibniz Institute for Neurobiology, Magdeburg, GermanyCenter for Behavioral Brain Sciences, Magdeburg, GermanyResearch Campus STIMULATE, Magdeburg, GermanyInstitute for Medical Engineering, Otto-von-Guericke University, Magdeburg, GermanyCenter for Behavioral Brain Sciences, Magdeburg, GermanyDepartment of Neurology, Otto-von-Guericke University, Magdeburg, GermanyDepartment of Behavioral Neurology, Leibniz Institute for Neurobiology, Magdeburg, GermanyCenter for Behavioral Brain Sciences, Magdeburg, GermanyDepartment of Neurology, Otto-von-Guericke University, Magdeburg, GermanyDepartment of Behavioral Neurology, Leibniz Institute for Neurobiology, Magdeburg, GermanyCenter for Behavioral Brain Sciences, Magdeburg, GermanyResearch Campus STIMULATE, Magdeburg, GermanyDepartment of Neurology, Otto-von-Guericke University, Magdeburg, GermanyDepartment of Behavioral Neurology, Leibniz Institute for Neurobiology, Magdeburg, GermanyDepartment of Neurology, Otto-von-Guericke University, Magdeburg, GermanyRegaining communication abilities in patients who are unable to speak or move is one of the main goals in decoding brain waves for brain-computer interface (BCI) control. Many BCI approaches designed for communication rely on attention to visual stimuli, commonly applying an oddball paradigm, and require both eye movements and adequate visual acuity. These abilities may, however, be absent in patients who depend on BCI communication. We have therefore developed a response-based communication BCI, which is independent of gaze shifts but utilizes covert shifts of attention to the left or right visual field. We recorded the electroencephalogram (EEG) from 29 channels and coregistered the vertical and horizontal electrooculogram. Data-driven decoding of small attention-based differences between the hemispheres, also known as N2pc, was performed using 14 posterior channels, which are expected to reflect correlates of visual spatial attention. Eighteen healthy participants responded to 120 statements by covertly directing attention to one of two colored symbols (green and red crosses for “yes” and “no,” respectively), presented in the user’s left and right visual field, respectively, while maintaining central gaze fixation. On average across participants, 88.5% (std: 7.8%) of responses were correctly decoded online. In order to investigate the potential influence of stimulus features on accuracy, we presented the symbols with different visual angles, by altering symbol size and eccentricity. The offline analysis revealed that stimulus features have a minimal impact on the controllability of the BCI. Hence, we show with our novel approach that spatial attention to a colored symbol is a robust method with which to control a BCI, which has the potential to support severely paralyzed people with impaired eye movements and low visual acuity in communicating with their environment.https://www.frontiersin.org/articles/10.3389/fnins.2020.591777/fullvisual spatial attentionbrain-computer interfacestimulus featuresN2pccanonical correlation analysisgaze-independent |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Christoph Reichert Christoph Reichert Christoph Reichert Igor Fabian Tellez Ceja Catherine M. Sweeney-Reed Catherine M. Sweeney-Reed Hans-Jochen Heinze Hans-Jochen Heinze Hans-Jochen Heinze Hermann Hinrichs Hermann Hinrichs Hermann Hinrichs Hermann Hinrichs Stefan Dürschmid Stefan Dürschmid |
spellingShingle |
Christoph Reichert Christoph Reichert Christoph Reichert Igor Fabian Tellez Ceja Catherine M. Sweeney-Reed Catherine M. Sweeney-Reed Hans-Jochen Heinze Hans-Jochen Heinze Hans-Jochen Heinze Hermann Hinrichs Hermann Hinrichs Hermann Hinrichs Hermann Hinrichs Stefan Dürschmid Stefan Dürschmid Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention Shifts Frontiers in Neuroscience visual spatial attention brain-computer interface stimulus features N2pc canonical correlation analysis gaze-independent |
author_facet |
Christoph Reichert Christoph Reichert Christoph Reichert Igor Fabian Tellez Ceja Catherine M. Sweeney-Reed Catherine M. Sweeney-Reed Hans-Jochen Heinze Hans-Jochen Heinze Hans-Jochen Heinze Hermann Hinrichs Hermann Hinrichs Hermann Hinrichs Hermann Hinrichs Stefan Dürschmid Stefan Dürschmid |
author_sort |
Christoph Reichert |
title |
Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention Shifts |
title_short |
Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention Shifts |
title_full |
Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention Shifts |
title_fullStr |
Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention Shifts |
title_full_unstemmed |
Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention Shifts |
title_sort |
impact of stimulus features on the performance of a gaze-independent brain-computer interface based on covert spatial attention shifts |
publisher |
Frontiers Media S.A. |
series |
Frontiers in Neuroscience |
issn |
1662-453X |
publishDate |
2020-12-01 |
description |
Regaining communication abilities in patients who are unable to speak or move is one of the main goals in decoding brain waves for brain-computer interface (BCI) control. Many BCI approaches designed for communication rely on attention to visual stimuli, commonly applying an oddball paradigm, and require both eye movements and adequate visual acuity. These abilities may, however, be absent in patients who depend on BCI communication. We have therefore developed a response-based communication BCI, which is independent of gaze shifts but utilizes covert shifts of attention to the left or right visual field. We recorded the electroencephalogram (EEG) from 29 channels and coregistered the vertical and horizontal electrooculogram. Data-driven decoding of small attention-based differences between the hemispheres, also known as N2pc, was performed using 14 posterior channels, which are expected to reflect correlates of visual spatial attention. Eighteen healthy participants responded to 120 statements by covertly directing attention to one of two colored symbols (green and red crosses for “yes” and “no,” respectively), presented in the user’s left and right visual field, respectively, while maintaining central gaze fixation. On average across participants, 88.5% (std: 7.8%) of responses were correctly decoded online. In order to investigate the potential influence of stimulus features on accuracy, we presented the symbols with different visual angles, by altering symbol size and eccentricity. The offline analysis revealed that stimulus features have a minimal impact on the controllability of the BCI. Hence, we show with our novel approach that spatial attention to a colored symbol is a robust method with which to control a BCI, which has the potential to support severely paralyzed people with impaired eye movements and low visual acuity in communicating with their environment. |
topic |
visual spatial attention brain-computer interface stimulus features N2pc canonical correlation analysis gaze-independent |
url |
https://www.frontiersin.org/articles/10.3389/fnins.2020.591777/full |
work_keys_str_mv |
AT christophreichert impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts AT christophreichert impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts AT christophreichert impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts AT igorfabiantellezceja impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts AT catherinemsweeneyreed impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts AT catherinemsweeneyreed impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts AT hansjochenheinze impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts AT hansjochenheinze impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts AT hansjochenheinze impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts AT hermannhinrichs impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts AT hermannhinrichs impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts AT hermannhinrichs impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts AT hermannhinrichs impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts AT stefandurschmid impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts AT stefandurschmid impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts |
_version_ |
1724390669525450752 |