A novel Surface Electromyographic Signal-Based Hand Gesture Prediction Using a Recurrent Neural Network

Surface electromyographic signal (sEMG) is a kind of bioelectrical signal, which records the data of muscle activity intensity. Most sEMG-based hand gesture recognition, which uses machine learning as the classifier, depends on feature extraction of sEMG data. Recently, a deep leaning-based approach...

Full description

Bibliographic Details
Main Authors: Zhen Zhang, Changxin He, Kuo Yang
Format: Article
Language:English
Published: MDPI AG 2020-07-01
Series:Sensors
Subjects:
RNN
Online Access:https://www.mdpi.com/1424-8220/20/14/3994
id doaj-385d458653334da6bb4e083e82995806
record_format Article
spelling doaj-385d458653334da6bb4e083e829958062020-11-25T03:20:51ZengMDPI AGSensors1424-82202020-07-01203994399410.3390/s20143994A novel Surface Electromyographic Signal-Based Hand Gesture Prediction Using a Recurrent Neural NetworkZhen Zhang0Changxin He1Kuo Yang2School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, ChinaSchool of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, ChinaSchool of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, ChinaSurface electromyographic signal (sEMG) is a kind of bioelectrical signal, which records the data of muscle activity intensity. Most sEMG-based hand gesture recognition, which uses machine learning as the classifier, depends on feature extraction of sEMG data. Recently, a deep leaning-based approach such as recurrent neural network (RNN) has provided a choice to automatically learn features from raw data. This paper presents a novel hand gesture prediction method by using an RNN model to learn from raw sEMG data and predict gestures. The sEMG signals of 21 short-term hand gestures of 13 subjects were recorded with a Myo armband, which is a non-intrusive, low cost, commercial portable device. At the start of the gesture, the trained model outputs an instantaneous prediction for the sEMG data. Experimental results showed that the more time steps of data that were known, the higher instantaneous prediction accuracy the proposed model gave. The predicted accuracy reached about 89.6% when the data of 40-time steps (200 ms) were used to predict hand gesture. This means that the gesture could be predicted with a delay of 200 ms after the hand starts to perform the gesture, instead of waiting for the end of the gesture.https://www.mdpi.com/1424-8220/20/14/3994sEMGhand gesture predictionRNNmyo armband
collection DOAJ
language English
format Article
sources DOAJ
author Zhen Zhang
Changxin He
Kuo Yang
spellingShingle Zhen Zhang
Changxin He
Kuo Yang
A novel Surface Electromyographic Signal-Based Hand Gesture Prediction Using a Recurrent Neural Network
Sensors
sEMG
hand gesture prediction
RNN
myo armband
author_facet Zhen Zhang
Changxin He
Kuo Yang
author_sort Zhen Zhang
title A novel Surface Electromyographic Signal-Based Hand Gesture Prediction Using a Recurrent Neural Network
title_short A novel Surface Electromyographic Signal-Based Hand Gesture Prediction Using a Recurrent Neural Network
title_full A novel Surface Electromyographic Signal-Based Hand Gesture Prediction Using a Recurrent Neural Network
title_fullStr A novel Surface Electromyographic Signal-Based Hand Gesture Prediction Using a Recurrent Neural Network
title_full_unstemmed A novel Surface Electromyographic Signal-Based Hand Gesture Prediction Using a Recurrent Neural Network
title_sort novel surface electromyographic signal-based hand gesture prediction using a recurrent neural network
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2020-07-01
description Surface electromyographic signal (sEMG) is a kind of bioelectrical signal, which records the data of muscle activity intensity. Most sEMG-based hand gesture recognition, which uses machine learning as the classifier, depends on feature extraction of sEMG data. Recently, a deep leaning-based approach such as recurrent neural network (RNN) has provided a choice to automatically learn features from raw data. This paper presents a novel hand gesture prediction method by using an RNN model to learn from raw sEMG data and predict gestures. The sEMG signals of 21 short-term hand gestures of 13 subjects were recorded with a Myo armband, which is a non-intrusive, low cost, commercial portable device. At the start of the gesture, the trained model outputs an instantaneous prediction for the sEMG data. Experimental results showed that the more time steps of data that were known, the higher instantaneous prediction accuracy the proposed model gave. The predicted accuracy reached about 89.6% when the data of 40-time steps (200 ms) were used to predict hand gesture. This means that the gesture could be predicted with a delay of 200 ms after the hand starts to perform the gesture, instead of waiting for the end of the gesture.
topic sEMG
hand gesture prediction
RNN
myo armband
url https://www.mdpi.com/1424-8220/20/14/3994
work_keys_str_mv AT zhenzhang anovelsurfaceelectromyographicsignalbasedhandgesturepredictionusingarecurrentneuralnetwork
AT changxinhe anovelsurfaceelectromyographicsignalbasedhandgesturepredictionusingarecurrentneuralnetwork
AT kuoyang anovelsurfaceelectromyographicsignalbasedhandgesturepredictionusingarecurrentneuralnetwork
AT zhenzhang novelsurfaceelectromyographicsignalbasedhandgesturepredictionusingarecurrentneuralnetwork
AT changxinhe novelsurfaceelectromyographicsignalbasedhandgesturepredictionusingarecurrentneuralnetwork
AT kuoyang novelsurfaceelectromyographicsignalbasedhandgesturepredictionusingarecurrentneuralnetwork
_version_ 1724616195072589824