Social Density Monitoring Toward Selective Cleaning by Human Support Robot With 3D Based Perception System

Monitoring the safe social distancing then conducting efficient sterilization in potentially crowded public places are necessary but challenging especially during the COVID-19 pandemic. This work presents the 3D human space-based surveillance system enabling selective cleaning framework. To this end...

Full description

Bibliographic Details
Main Authors: Anh Vu Le, Balakrishnan Ramalingam, Braulio Felix Gomez, Rajesh Elara Mohan, Tran Hoang Quang Minh, Vinu Sivanantham
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9374447/
Description
Summary:Monitoring the safe social distancing then conducting efficient sterilization in potentially crowded public places are necessary but challenging especially during the COVID-19 pandemic. This work presents the 3D human space-based surveillance system enabling selective cleaning framework. To this end, the proposed AI-assisted perception techniques is deployed on Toyota Human Support Robot (HSR) equipped with autonomous navigation, Lidar, and RGBD vision sensor. The human density mapping represented as heatmap was constructed to identify areas with the level being likely the risks for interactions. The surveillance framework adopts the 3D human joints tracking technique and the accumulated asymmetrical Gaussian distribution scheme modeling the human location, size, and direction to quantify human density. The HSR generates the human density map as a grid-based heatmap to perform the safe human distance monitoring task while navigating autonomously inside the pre-built map. Then, the cleaning robot uses the levels of the generated heatmap to sterilize by the selective scheme. The experiment was tested in public places, including food court and wet market. The proposed framework performance analyzed with standard performance metrics in various map sizes spares about 19 % of the disinfection time and 15 % of the disinfection liquid usage, respectively.
ISSN:2169-3536