Nonfrontal Expression Recognition in the Wild Based on PRNet Frontalization and Muscle Feature Strengthening
Nonfrontal facial expression recognition in the wild is the key for artificial intelligence and human-computer interaction. However, it is easy to be disturbed when changing head pose. Therefore, this paper presents a face rebuilding method to solve this problem based on PRNet, which can build 3D fr...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Hindawi Limited
2021-01-01
|
Series: | Mathematical Problems in Engineering |
Online Access: | http://dx.doi.org/10.1155/2021/6620752 |
id |
doaj-74047e8b1c2848ee9d92b056cca6bd4a |
---|---|
record_format |
Article |
spelling |
doaj-74047e8b1c2848ee9d92b056cca6bd4a2021-07-26T00:33:44ZengHindawi LimitedMathematical Problems in Engineering1563-51472021-01-01202110.1155/2021/6620752Nonfrontal Expression Recognition in the Wild Based on PRNet Frontalization and Muscle Feature StrengtheningTianyang Cao0Chang Liu1Jiamin Chen2Aerospace Information Research InstituteAerospace Information Research InstituteAerospace Information Research InstituteNonfrontal facial expression recognition in the wild is the key for artificial intelligence and human-computer interaction. However, it is easy to be disturbed when changing head pose. Therefore, this paper presents a face rebuilding method to solve this problem based on PRNet, which can build 3D frontal face for 2D head photo with any pose. However, expression is still difficult to be recognized, because facial features weakened after frontalization, which had been widely reported by previous studies. It can be proved that all muscle parameters in frontalization face are more weakened than those of real face, except muscle moving direction on each small area. Thus, this paper also designed muscle movement rebuilding and intensifying method, and through 3D face contours and Fréchet distance, muscular moving directions on each muscle area are extracted and muscle movement is strengthened following these moving directions to intensify the whole face expression. Through this way, nonfrontal facial expression can be recognized effectively.http://dx.doi.org/10.1155/2021/6620752 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Tianyang Cao Chang Liu Jiamin Chen |
spellingShingle |
Tianyang Cao Chang Liu Jiamin Chen Nonfrontal Expression Recognition in the Wild Based on PRNet Frontalization and Muscle Feature Strengthening Mathematical Problems in Engineering |
author_facet |
Tianyang Cao Chang Liu Jiamin Chen |
author_sort |
Tianyang Cao |
title |
Nonfrontal Expression Recognition in the Wild Based on PRNet Frontalization and Muscle Feature Strengthening |
title_short |
Nonfrontal Expression Recognition in the Wild Based on PRNet Frontalization and Muscle Feature Strengthening |
title_full |
Nonfrontal Expression Recognition in the Wild Based on PRNet Frontalization and Muscle Feature Strengthening |
title_fullStr |
Nonfrontal Expression Recognition in the Wild Based on PRNet Frontalization and Muscle Feature Strengthening |
title_full_unstemmed |
Nonfrontal Expression Recognition in the Wild Based on PRNet Frontalization and Muscle Feature Strengthening |
title_sort |
nonfrontal expression recognition in the wild based on prnet frontalization and muscle feature strengthening |
publisher |
Hindawi Limited |
series |
Mathematical Problems in Engineering |
issn |
1563-5147 |
publishDate |
2021-01-01 |
description |
Nonfrontal facial expression recognition in the wild is the key for artificial intelligence and human-computer interaction. However, it is easy to be disturbed when changing head pose. Therefore, this paper presents a face rebuilding method to solve this problem based on PRNet, which can build 3D frontal face for 2D head photo with any pose. However, expression is still difficult to be recognized, because facial features weakened after frontalization, which had been widely reported by previous studies. It can be proved that all muscle parameters in frontalization face are more weakened than those of real face, except muscle moving direction on each small area. Thus, this paper also designed muscle movement rebuilding and intensifying method, and through 3D face contours and Fréchet distance, muscular moving directions on each muscle area are extracted and muscle movement is strengthened following these moving directions to intensify the whole face expression. Through this way, nonfrontal facial expression can be recognized effectively. |
url |
http://dx.doi.org/10.1155/2021/6620752 |
work_keys_str_mv |
AT tianyangcao nonfrontalexpressionrecognitioninthewildbasedonprnetfrontalizationandmusclefeaturestrengthening AT changliu nonfrontalexpressionrecognitioninthewildbasedonprnetfrontalizationandmusclefeaturestrengthening AT jiaminchen nonfrontalexpressionrecognitioninthewildbasedonprnetfrontalizationandmusclefeaturestrengthening |
_version_ |
1721282539874680832 |