High-Speed Video System for Micro-Expression Detection and Recognition

• Main Authors: Diana Borza, Radu Danescu, Razvan Itu, Adrian Darabant
• Format: Article
• Language: English
• Published: MDPI AG 2017-12-01
• Series: Sensors
• Subjects: micro-expression spotting; micro-expression recognition; affective computing; facial expression recognition; difference images
• Online Access: https://www.mdpi.com/1424-8220/17/12/2913

Micro-expressions play an essential part in understanding non-verbal communication and deceit detection. They are involuntary, brief facial movements that are shown when a person is trying to conceal something. Automatic analysis of micro-expression is challenging due to their low amplitude and to their short duration (they occur as fast as 1/15 to 1/25 of a second). We propose a fully micro-expression analysis system consisting of a high-speed image acquisition setup and a software framework which can detect the frames when the micro-expressions occurred as well as determine the type of the emerged expression. The detection and classification methods use fast and simple motion descriptors based on absolute image differences. The recognition module it only involves the computation of several 2D Gaussian probabilities. The software framework was tested on two publicly available high speed micro-expression databases and the whole system was used to acquire new data. The experiments we performed show that our solution outperforms state of the art works which use more complex and computationally intensive descriptors.