Fear Facial Emotion Recognition Based on Angular Deviation

• Main Authors: Ahmed Fnaiech, Hanene Sahli, Mounir Sayadi, Philippe Gorce
• Format: Article
• Language: English
• Published: MDPI AG 2021-02-01
• Series: Electronics
• Subjects: negative facial emotions; fear emotion recognition; 3D/2D projection; angular deviation; face orientation; PCAN classifier
• Online Access: https://www.mdpi.com/2079-9292/10/3/358

This paper shows an advanced method that is able to achieve accurate recognition of fear facial emotions by providing quantitative evaluation of other negative emotions. The proposed approach is focused on both a calibration computing procedure and an important feature pattern technique, which is applied to extract the most relevant characteristics on different human faces. In fact, a 3D/2D projection method is highlighted in order to deal with angular variation (AD) and orientation effects on the emotion detection. Using the combination of the principal component analysis algorithm and the artificial neural network method (PCAN), a supervised classification system is finally achieved to recognize the considered emotion data split into two categories: fear and others. The obtained results have reached an encouraging accuracy up to 20° of AD. Compared to other state-of-art and classification strategies, we recorded the highest accuracy of identified fear emotion. A statistical analysis is carried out on the whole facial emotions, which confirms the best classification performance (positive predictive values (PPV) = 95.13, negative predictive values (NPV) = 94.65, positive likelihood ratio (PLr) = 33.9, and negative likelihood ratio (NLr) = 0.054. The confidence interval for both of PPV and NPV is 92–98%. The proposed framework can be easily applied for any security domain that needs to effectively distinguish the fear cases recognition.