From Kinect skeleton data to hand gesture recognition with radar

In an era where man-machine interaction increasingly uses remote sensing, gesture recognition through use of the micro-Doppler (mD) effect is an emerging application which has attracted great interest. It is a sensible solution and here the authors show its potential for detecting aperiodic human mo...

Full description

Bibliographic Details
Main Authors: Jiayi Li, Aman Shrestha, Julien Le Kernec, Francesco Fioranelli
Format: Article
Language:English
Published: Wiley 2019-09-01
Series:The Journal of Engineering
Subjects:
Online Access:https://digital-library.theiet.org/content/journals/10.1049/joe.2019.0557
Description
Summary:In an era where man-machine interaction increasingly uses remote sensing, gesture recognition through use of the micro-Doppler (mD) effect is an emerging application which has attracted great interest. It is a sensible solution and here the authors show its potential for detecting aperiodic human movements. In this study, the authors classify ten hand gestures with a set of handcrafted features using simulated mD signatures generated from Kinect skeleton data. Data augmentation in the form of synthetic minority oversampling technique has been applied to create synthetic samples and classified with the support vector machine and K-nearest neighbour classifier with classification rate of 71.1 and 51% achieved. Finally, using weights generated by an action pair based one vs. one classification layer improves classification accuracy by 24.7 and 28.4%.
ISSN:2051-3305