Neural Signature and Decoding of Unmanned Aerial Vehicle Operators in Emergency Scenarios Using Electroencephalography

Brain–computer interface (BCI) offers a novel means of communication and control for individuals with disabilities and can also enhance the interactions between humans and machines for the broader population. This paper explores the brain neural signatures of unmanned aerial vehicle (UAV) operators...

Full description

Bibliographic Details
Published in:Sensors
Main Authors: Manyu Liu, Ying Liu, Aberham Genetu Feleke, Weijie Fei, Luzheng Bi
Format: Article
Language:English
Published: MDPI AG 2024-09-01
Subjects:
Online Access:https://www.mdpi.com/1424-8220/24/19/6304
_version_ 1849739315324649472
author Manyu Liu
Ying Liu
Aberham Genetu Feleke
Weijie Fei
Luzheng Bi
author_facet Manyu Liu
Ying Liu
Aberham Genetu Feleke
Weijie Fei
Luzheng Bi
author_sort Manyu Liu
collection DOAJ
container_title Sensors
description Brain–computer interface (BCI) offers a novel means of communication and control for individuals with disabilities and can also enhance the interactions between humans and machines for the broader population. This paper explores the brain neural signatures of unmanned aerial vehicle (UAV) operators in emergencies and develops an operator’s electroencephalography (EEG) signals-based detection method for UAV emergencies. We found regularity characteristics similar to classic event-related potential (ERP) components like visual mismatch negativity (vMMN) and contingent negative variation (CNV). Source analysis revealed a sequential activation of the occipital, temporal, and frontal lobes following the onset of emergencies, corresponding to the processing of attention, emotion, and motor intention triggered by visual stimuli. Furthermore, an online detection system was implemented and tested. Experimental results showed that the system achieved an average accuracy of over 88% in detecting emergencies with a detection latency of 431.95 ms from the emergency onset. This work lays a foundation for understanding the brain activities of operators in emergencies and developing an EEG-based detection method for emergencies to assist UAV operations.
format Article
id doaj-art-0b5ecdabc1df4bd2af5d0db66ce8d077
institution Directory of Open Access Journals
issn 1424-8220
language English
publishDate 2024-09-01
publisher MDPI AG
record_format Article
spelling doaj-art-0b5ecdabc1df4bd2af5d0db66ce8d0772025-08-20T01:47:38ZengMDPI AGSensors1424-82202024-09-012419630410.3390/s24196304Neural Signature and Decoding of Unmanned Aerial Vehicle Operators in Emergency Scenarios Using ElectroencephalographyManyu Liu0Ying Liu1Aberham Genetu Feleke2Weijie Fei3Luzheng Bi4School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, ChinaSchool of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, ChinaSchool of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, ChinaSchool of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, ChinaSchool of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, ChinaBrain–computer interface (BCI) offers a novel means of communication and control for individuals with disabilities and can also enhance the interactions between humans and machines for the broader population. This paper explores the brain neural signatures of unmanned aerial vehicle (UAV) operators in emergencies and develops an operator’s electroencephalography (EEG) signals-based detection method for UAV emergencies. We found regularity characteristics similar to classic event-related potential (ERP) components like visual mismatch negativity (vMMN) and contingent negative variation (CNV). Source analysis revealed a sequential activation of the occipital, temporal, and frontal lobes following the onset of emergencies, corresponding to the processing of attention, emotion, and motor intention triggered by visual stimuli. Furthermore, an online detection system was implemented and tested. Experimental results showed that the system achieved an average accuracy of over 88% in detecting emergencies with a detection latency of 431.95 ms from the emergency onset. This work lays a foundation for understanding the brain activities of operators in emergencies and developing an EEG-based detection method for emergencies to assist UAV operations.https://www.mdpi.com/1424-8220/24/19/6304electroencephalogrambrain–computer interfaceemergency detectionbrain neural signature
spellingShingle Manyu Liu
Ying Liu
Aberham Genetu Feleke
Weijie Fei
Luzheng Bi
Neural Signature and Decoding of Unmanned Aerial Vehicle Operators in Emergency Scenarios Using Electroencephalography
electroencephalogram
brain–computer interface
emergency detection
brain neural signature
title Neural Signature and Decoding of Unmanned Aerial Vehicle Operators in Emergency Scenarios Using Electroencephalography
title_full Neural Signature and Decoding of Unmanned Aerial Vehicle Operators in Emergency Scenarios Using Electroencephalography
title_fullStr Neural Signature and Decoding of Unmanned Aerial Vehicle Operators in Emergency Scenarios Using Electroencephalography
title_full_unstemmed Neural Signature and Decoding of Unmanned Aerial Vehicle Operators in Emergency Scenarios Using Electroencephalography
title_short Neural Signature and Decoding of Unmanned Aerial Vehicle Operators in Emergency Scenarios Using Electroencephalography
title_sort neural signature and decoding of unmanned aerial vehicle operators in emergency scenarios using electroencephalography
topic electroencephalogram
brain–computer interface
emergency detection
brain neural signature
url https://www.mdpi.com/1424-8220/24/19/6304
work_keys_str_mv AT manyuliu neuralsignatureanddecodingofunmannedaerialvehicleoperatorsinemergencyscenariosusingelectroencephalography
AT yingliu neuralsignatureanddecodingofunmannedaerialvehicleoperatorsinemergencyscenariosusingelectroencephalography
AT aberhamgenetufeleke neuralsignatureanddecodingofunmannedaerialvehicleoperatorsinemergencyscenariosusingelectroencephalography
AT weijiefei neuralsignatureanddecodingofunmannedaerialvehicleoperatorsinemergencyscenariosusingelectroencephalography
AT luzhengbi neuralsignatureanddecodingofunmannedaerialvehicleoperatorsinemergencyscenariosusingelectroencephalography