A Review of Emotion Recognition Methods Based on Data Acquired via Smartphone Sensors

• Main Authors: Agata Kołakowska, Wioleta Szwoch, Mariusz Szwoch
• Format: Article
• Language: English
• Published: MDPI AG 2020-11-01
• Series: Sensors
• Subjects: affective computing; emotion recognition; smartphones; sensory data; sensors; human–computer interaction
• Online Access: https://www.mdpi.com/1424-8220/20/21/6367

In recent years, emotion recognition algorithms have achieved high efficiency, allowing the development of various affective and affect-aware applications. This advancement has taken place mainly in the environment of personal computers offering the appropriate hardware and sufficient power to process complex data from video, audio, and other channels. However, the increase in computing and communication capabilities of smartphones, the variety of their built-in sensors, as well as the availability of cloud computing services have made them an environment in which the task of recognising emotions can be performed at least as effectively. This is possible and particularly important due to the fact that smartphones and other mobile devices have become the main computer devices used by most people. This article provides a systematic overview of publications from the last 10 years related to emotion recognition methods using smartphone sensors. The characteristics of the most important sensors in this respect are presented, and the methods applied to extract informative features on the basis of data read from these input channels. Then, various machine learning approaches implemented to recognise emotional states are described.