Neural Networks for Automatic Posture Recognition in Ambient-Assisted Living

• Main Authors: Beltrami, G. (Author), Guerra, B.M.V (Author), Ramat, S. (Author), Schmid, M. (Author)
• Format: Article
• Language: English
• Published: NLM (Medline) 2022
• Subjects: aged; Aged; Ambient Intelligence; ambient-assisted living; artificial intelligence; Artificial Intelligence; body position; deep learning; feature selection; human; human action recognition; human activities; Human Activities; Humans; kinect; machine learning; neural networks; Neural Networks, Computer; Posture; visual sensor-based
• Online Access: View Fulltext in Publisher

 Human Action Recognition (HAR) is a rapidly evolving field impacting numerous domains, among which is Ambient Assisted Living (AAL). In such a context, the aim of HAR is meeting the needs of frail individuals, whether elderly and/or disabled and promoting autonomous, safe and secure living. To this goal, we propose a monitoring system detecting dangerous situations by classifying human postures through Artificial Intelligence (AI) solutions. The developed algorithm works on a set of features computed from the skeleton data provided by four Kinect One systems simultaneously recording the scene from different angles and identifying the posture of the subject in an ecological context within each recorded frame. Here, we compare the recognition abilities of Multi-Layer Perceptron (MLP) and Long-Short Term Memory (LSTM) Sequence networks. Starting from the set of previously selected features we performed a further feature selection based on an SVM algorithm for the optimization of the MLP network and used a genetic algorithm for selecting the features for the LSTM sequence model. We then optimized the architecture and hyperparameters of both models before comparing their performances. The best MLP model (3 hidden layers and a Softmax output layer) achieved 78.4%, while the best LSTM (2 bidirectional LSTM layers, 2 dropout and a fully connected layer) reached 85.7%. The analysis of the performances on individual classes highlights the better suitability of the LSTM approach.