Prevention of Unintended Appearance in Photos Based on Human Behavior Analysis

• Main Authors: Yuhi Kaihoko, Phan Xuan Tan, Eiji Kamioka
• Format: Article
• Language: English
• Published: MDPI AG 2020-10-01
• Series: Information
• Subjects: photo-taking behavior; photo capturing and sharing; bystanders; human behavior analysis; identity protection; facial privacy
• Online Access: https://www.mdpi.com/2078-2489/11/10/468

Nowadays, with smartphones, people can easily take photos, post photos to any social networks, and use the photos for various purposes. This leads to a social problem that unintended appearance in photos may threaten the facial privacy of photographed people. Some solutions to protect facial privacy in photos have already been proposed. However, most of them rely on different techniques to de-identify photos which can be done only by photographers, giving no choice to photographed person. To deal with that, we propose an approach that allows a photographed person to proactively detect whether someone is intentionally/unintentionally trying to take pictures of him. Thereby, he can have appropriate reaction to protect the facial privacy. In this approach, we assume that the photographed person uses a wearable camera to record the surrounding environment in real-time. The skeleton information of likely photographers who are captured in the monitoring video is then extracted and put into the calculation of dynamic programming score which is eventually compared with a threshold for recognition of photo-taking behavior. Experimental results demonstrate that by using the proposed approach, the photo-taking behavior is precisely recognized with high accuracy of 92.5%.