Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention Shifts

Regaining communication abilities in patients who are unable to speak or move is one of the main goals in decoding brain waves for brain-computer interface (BCI) control. Many BCI approaches designed for communication rely on attention to visual stimuli, commonly applying an oddball paradigm, and re...

Full description

Bibliographic Details
Main Authors: Christoph Reichert, Igor Fabian Tellez Ceja, Catherine M. Sweeney-Reed, Hans-Jochen Heinze, Hermann Hinrichs, Stefan Dürschmid
Format: Article
Language:English
Published: Frontiers Media S.A. 2020-12-01
Series:Frontiers in Neuroscience
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fnins.2020.591777/full
id doaj-c285160e13cf4370a8aa36ece6c82e8a
record_format Article
spelling doaj-c285160e13cf4370a8aa36ece6c82e8a2020-12-08T08:38:12ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2020-12-011410.3389/fnins.2020.591777591777Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention ShiftsChristoph Reichert0Christoph Reichert1Christoph Reichert2Igor Fabian Tellez Ceja3Catherine M. Sweeney-Reed4Catherine M. Sweeney-Reed5Hans-Jochen Heinze6Hans-Jochen Heinze7Hans-Jochen Heinze8Hermann Hinrichs9Hermann Hinrichs10Hermann Hinrichs11Hermann Hinrichs12Stefan Dürschmid13Stefan Dürschmid14Department of Behavioral Neurology, Leibniz Institute for Neurobiology, Magdeburg, GermanyCenter for Behavioral Brain Sciences, Magdeburg, GermanyResearch Campus STIMULATE, Magdeburg, GermanyInstitute for Medical Engineering, Otto-von-Guericke University, Magdeburg, GermanyCenter for Behavioral Brain Sciences, Magdeburg, GermanyDepartment of Neurology, Otto-von-Guericke University, Magdeburg, GermanyDepartment of Behavioral Neurology, Leibniz Institute for Neurobiology, Magdeburg, GermanyCenter for Behavioral Brain Sciences, Magdeburg, GermanyDepartment of Neurology, Otto-von-Guericke University, Magdeburg, GermanyDepartment of Behavioral Neurology, Leibniz Institute for Neurobiology, Magdeburg, GermanyCenter for Behavioral Brain Sciences, Magdeburg, GermanyResearch Campus STIMULATE, Magdeburg, GermanyDepartment of Neurology, Otto-von-Guericke University, Magdeburg, GermanyDepartment of Behavioral Neurology, Leibniz Institute for Neurobiology, Magdeburg, GermanyDepartment of Neurology, Otto-von-Guericke University, Magdeburg, GermanyRegaining communication abilities in patients who are unable to speak or move is one of the main goals in decoding brain waves for brain-computer interface (BCI) control. Many BCI approaches designed for communication rely on attention to visual stimuli, commonly applying an oddball paradigm, and require both eye movements and adequate visual acuity. These abilities may, however, be absent in patients who depend on BCI communication. We have therefore developed a response-based communication BCI, which is independent of gaze shifts but utilizes covert shifts of attention to the left or right visual field. We recorded the electroencephalogram (EEG) from 29 channels and coregistered the vertical and horizontal electrooculogram. Data-driven decoding of small attention-based differences between the hemispheres, also known as N2pc, was performed using 14 posterior channels, which are expected to reflect correlates of visual spatial attention. Eighteen healthy participants responded to 120 statements by covertly directing attention to one of two colored symbols (green and red crosses for “yes” and “no,” respectively), presented in the user’s left and right visual field, respectively, while maintaining central gaze fixation. On average across participants, 88.5% (std: 7.8%) of responses were correctly decoded online. In order to investigate the potential influence of stimulus features on accuracy, we presented the symbols with different visual angles, by altering symbol size and eccentricity. The offline analysis revealed that stimulus features have a minimal impact on the controllability of the BCI. Hence, we show with our novel approach that spatial attention to a colored symbol is a robust method with which to control a BCI, which has the potential to support severely paralyzed people with impaired eye movements and low visual acuity in communicating with their environment.https://www.frontiersin.org/articles/10.3389/fnins.2020.591777/fullvisual spatial attentionbrain-computer interfacestimulus featuresN2pccanonical correlation analysisgaze-independent
collection DOAJ
language English
format Article
sources DOAJ
author Christoph Reichert
Christoph Reichert
Christoph Reichert
Igor Fabian Tellez Ceja
Catherine M. Sweeney-Reed
Catherine M. Sweeney-Reed
Hans-Jochen Heinze
Hans-Jochen Heinze
Hans-Jochen Heinze
Hermann Hinrichs
Hermann Hinrichs
Hermann Hinrichs
Hermann Hinrichs
Stefan Dürschmid
Stefan Dürschmid
spellingShingle Christoph Reichert
Christoph Reichert
Christoph Reichert
Igor Fabian Tellez Ceja
Catherine M. Sweeney-Reed
Catherine M. Sweeney-Reed
Hans-Jochen Heinze
Hans-Jochen Heinze
Hans-Jochen Heinze
Hermann Hinrichs
Hermann Hinrichs
Hermann Hinrichs
Hermann Hinrichs
Stefan Dürschmid
Stefan Dürschmid
Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention Shifts
Frontiers in Neuroscience
visual spatial attention
brain-computer interface
stimulus features
N2pc
canonical correlation analysis
gaze-independent
author_facet Christoph Reichert
Christoph Reichert
Christoph Reichert
Igor Fabian Tellez Ceja
Catherine M. Sweeney-Reed
Catherine M. Sweeney-Reed
Hans-Jochen Heinze
Hans-Jochen Heinze
Hans-Jochen Heinze
Hermann Hinrichs
Hermann Hinrichs
Hermann Hinrichs
Hermann Hinrichs
Stefan Dürschmid
Stefan Dürschmid
author_sort Christoph Reichert
title Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention Shifts
title_short Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention Shifts
title_full Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention Shifts
title_fullStr Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention Shifts
title_full_unstemmed Impact of Stimulus Features on the Performance of a Gaze-Independent Brain-Computer Interface Based on Covert Spatial Attention Shifts
title_sort impact of stimulus features on the performance of a gaze-independent brain-computer interface based on covert spatial attention shifts
publisher Frontiers Media S.A.
series Frontiers in Neuroscience
issn 1662-453X
publishDate 2020-12-01
description Regaining communication abilities in patients who are unable to speak or move is one of the main goals in decoding brain waves for brain-computer interface (BCI) control. Many BCI approaches designed for communication rely on attention to visual stimuli, commonly applying an oddball paradigm, and require both eye movements and adequate visual acuity. These abilities may, however, be absent in patients who depend on BCI communication. We have therefore developed a response-based communication BCI, which is independent of gaze shifts but utilizes covert shifts of attention to the left or right visual field. We recorded the electroencephalogram (EEG) from 29 channels and coregistered the vertical and horizontal electrooculogram. Data-driven decoding of small attention-based differences between the hemispheres, also known as N2pc, was performed using 14 posterior channels, which are expected to reflect correlates of visual spatial attention. Eighteen healthy participants responded to 120 statements by covertly directing attention to one of two colored symbols (green and red crosses for “yes” and “no,” respectively), presented in the user’s left and right visual field, respectively, while maintaining central gaze fixation. On average across participants, 88.5% (std: 7.8%) of responses were correctly decoded online. In order to investigate the potential influence of stimulus features on accuracy, we presented the symbols with different visual angles, by altering symbol size and eccentricity. The offline analysis revealed that stimulus features have a minimal impact on the controllability of the BCI. Hence, we show with our novel approach that spatial attention to a colored symbol is a robust method with which to control a BCI, which has the potential to support severely paralyzed people with impaired eye movements and low visual acuity in communicating with their environment.
topic visual spatial attention
brain-computer interface
stimulus features
N2pc
canonical correlation analysis
gaze-independent
url https://www.frontiersin.org/articles/10.3389/fnins.2020.591777/full
work_keys_str_mv AT christophreichert impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
AT christophreichert impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
AT christophreichert impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
AT igorfabiantellezceja impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
AT catherinemsweeneyreed impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
AT catherinemsweeneyreed impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
AT hansjochenheinze impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
AT hansjochenheinze impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
AT hansjochenheinze impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
AT hermannhinrichs impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
AT hermannhinrichs impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
AT hermannhinrichs impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
AT hermannhinrichs impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
AT stefandurschmid impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
AT stefandurschmid impactofstimulusfeaturesontheperformanceofagazeindependentbraincomputerinterfacebasedoncovertspatialattentionshifts
_version_ 1724390669525450752