Automatic Detection of Discrimination Actions from Social Images

• Main Authors: Zhihao Wu, Baopeng Zhang, Tianchen Zhou, Yan Li, Jianping Fan
• Format: Article
• Language: English
• Published: MDPI AG 2021-01-01
• Series: Electronics
• Subjects: discrimination action recognition; relationship prediction; representation learning
• Online Access: https://www.mdpi.com/2079-9292/10/3/325

In this paper, we developed a practical approach for automatic detection of discrimination actions from social images. Firstly, an image set is established, in which various discrimination actions and relations are manually labeled. To the best of our knowledge, this is the first work to create a dataset for discrimination action recognition and relationship identification. Secondly, a practical approach is developed to achieve automatic detection and identification of discrimination actions and relationships from social images. Thirdly, the task of relationship identification is seamlessly integrated with the task of discrimination action recognition into one single network called the Co-operative Visual Translation Embedding++ network (CVTransE++). We also compared our proposed method with numerous state-of-the-art methods, and our experimental results demonstrated that our proposed methods can significantly outperform state-of-the-art approaches.