UAV Framework for Autonomous Onboard Navigation and People/Object Detection in Cluttered Indoor Environments

Response efforts in emergency applications such as border protection, humanitarian relief and disaster monitoring have improved with the use of Unmanned Aerial Vehicles (UAVs), which provide a flexibly deployed eye in the sky. These efforts have been further improved with advances in autonomous beha...

Full description

Bibliographic Details
Main Authors: Juan Sandino, Fernando Vanegas, Frederic Maire, Peter Caccetta, Conrad Sanderson, Felipe Gonzalez
Format: Article
Language:English
Published: MDPI AG 2020-10-01
Series:Remote Sensing
Subjects:
Online Access:https://www.mdpi.com/2072-4292/12/20/3386
id doaj-1d9a9634518041cdbd87a80024e01344
record_format Article
spelling doaj-1d9a9634518041cdbd87a80024e013442020-11-25T03:55:40ZengMDPI AGRemote Sensing2072-42922020-10-01123386338610.3390/rs12203386UAV Framework for Autonomous Onboard Navigation and People/Object Detection in Cluttered Indoor EnvironmentsJuan Sandino0Fernando Vanegas1Frederic Maire2Peter Caccetta3Conrad Sanderson4Felipe Gonzalez5School of Electrical Engineering and Robotics, Queensland University of Technology (QUT), 2 George Street, Brisbane City, QLD 4000, AustraliaSchool of Electrical Engineering and Robotics, Queensland University of Technology (QUT), 2 George Street, Brisbane City, QLD 4000, AustraliaSchool of Electrical Engineering and Robotics, Queensland University of Technology (QUT), 2 George Street, Brisbane City, QLD 4000, AustraliaData61, Commonwealth Scientific and Industrial Research Organisation (CSIRO), Building 101, Clunies Ross Street, Black Mountain, ACT 2601, AustraliaData61, Commonwealth Scientific and Industrial Research Organisation (CSIRO), Building 101, Clunies Ross Street, Black Mountain, ACT 2601, AustraliaSchool of Electrical Engineering and Robotics, Queensland University of Technology (QUT), 2 George Street, Brisbane City, QLD 4000, AustraliaResponse efforts in emergency applications such as border protection, humanitarian relief and disaster monitoring have improved with the use of Unmanned Aerial Vehicles (UAVs), which provide a flexibly deployed eye in the sky. These efforts have been further improved with advances in autonomous behaviours such as obstacle avoidance, take-off, landing, hovering and waypoint flight modes. However, most UAVs lack autonomous decision making for navigating in complex environments. This limitation creates a reliance on ground control stations to UAVs and, therefore, on their communication systems. The challenge is even more complex in indoor flight operations, where the strength of the Global Navigation Satellite System (GNSS) signals is absent or weak and compromises aircraft behaviour. This paper proposes a UAV framework for autonomous navigation to address uncertainty and partial observability from imperfect sensor readings in cluttered indoor scenarios. The framework design allocates the computing processes onboard the flight controller and companion computer of the UAV, allowing it to explore dangerous indoor areas without the supervision and physical presence of the human operator. The system is illustrated under a Search and Rescue (SAR) scenario to detect and locate victims inside a simulated office building. The navigation problem is modelled as a Partially Observable Markov Decision Process (POMDP) and solved in real time through the Augmented Belief Trees (ABT) algorithm. Data is collected using Hardware in the Loop (HIL) simulations and real flight tests. Experimental results show the robustness of the proposed framework to detect victims at various levels of location uncertainty. The proposed system ensures personal safety by letting the UAV to explore dangerous environments without the intervention of the human operator.https://www.mdpi.com/2072-4292/12/20/3386partially observable Markov decision process (POMDP)machine learningsearch and rescue (SAR)probabilistic decision-makingembedded systemscomputer vision
collection DOAJ
language English
format Article
sources DOAJ
author Juan Sandino
Fernando Vanegas
Frederic Maire
Peter Caccetta
Conrad Sanderson
Felipe Gonzalez
spellingShingle Juan Sandino
Fernando Vanegas
Frederic Maire
Peter Caccetta
Conrad Sanderson
Felipe Gonzalez
UAV Framework for Autonomous Onboard Navigation and People/Object Detection in Cluttered Indoor Environments
Remote Sensing
partially observable Markov decision process (POMDP)
machine learning
search and rescue (SAR)
probabilistic decision-making
embedded systems
computer vision
author_facet Juan Sandino
Fernando Vanegas
Frederic Maire
Peter Caccetta
Conrad Sanderson
Felipe Gonzalez
author_sort Juan Sandino
title UAV Framework for Autonomous Onboard Navigation and People/Object Detection in Cluttered Indoor Environments
title_short UAV Framework for Autonomous Onboard Navigation and People/Object Detection in Cluttered Indoor Environments
title_full UAV Framework for Autonomous Onboard Navigation and People/Object Detection in Cluttered Indoor Environments
title_fullStr UAV Framework for Autonomous Onboard Navigation and People/Object Detection in Cluttered Indoor Environments
title_full_unstemmed UAV Framework for Autonomous Onboard Navigation and People/Object Detection in Cluttered Indoor Environments
title_sort uav framework for autonomous onboard navigation and people/object detection in cluttered indoor environments
publisher MDPI AG
series Remote Sensing
issn 2072-4292
publishDate 2020-10-01
description Response efforts in emergency applications such as border protection, humanitarian relief and disaster monitoring have improved with the use of Unmanned Aerial Vehicles (UAVs), which provide a flexibly deployed eye in the sky. These efforts have been further improved with advances in autonomous behaviours such as obstacle avoidance, take-off, landing, hovering and waypoint flight modes. However, most UAVs lack autonomous decision making for navigating in complex environments. This limitation creates a reliance on ground control stations to UAVs and, therefore, on their communication systems. The challenge is even more complex in indoor flight operations, where the strength of the Global Navigation Satellite System (GNSS) signals is absent or weak and compromises aircraft behaviour. This paper proposes a UAV framework for autonomous navigation to address uncertainty and partial observability from imperfect sensor readings in cluttered indoor scenarios. The framework design allocates the computing processes onboard the flight controller and companion computer of the UAV, allowing it to explore dangerous indoor areas without the supervision and physical presence of the human operator. The system is illustrated under a Search and Rescue (SAR) scenario to detect and locate victims inside a simulated office building. The navigation problem is modelled as a Partially Observable Markov Decision Process (POMDP) and solved in real time through the Augmented Belief Trees (ABT) algorithm. Data is collected using Hardware in the Loop (HIL) simulations and real flight tests. Experimental results show the robustness of the proposed framework to detect victims at various levels of location uncertainty. The proposed system ensures personal safety by letting the UAV to explore dangerous environments without the intervention of the human operator.
topic partially observable Markov decision process (POMDP)
machine learning
search and rescue (SAR)
probabilistic decision-making
embedded systems
computer vision
url https://www.mdpi.com/2072-4292/12/20/3386
work_keys_str_mv AT juansandino uavframeworkforautonomousonboardnavigationandpeopleobjectdetectioninclutteredindoorenvironments
AT fernandovanegas uavframeworkforautonomousonboardnavigationandpeopleobjectdetectioninclutteredindoorenvironments
AT fredericmaire uavframeworkforautonomousonboardnavigationandpeopleobjectdetectioninclutteredindoorenvironments
AT petercaccetta uavframeworkforautonomousonboardnavigationandpeopleobjectdetectioninclutteredindoorenvironments
AT conradsanderson uavframeworkforautonomousonboardnavigationandpeopleobjectdetectioninclutteredindoorenvironments
AT felipegonzalez uavframeworkforautonomousonboardnavigationandpeopleobjectdetectioninclutteredindoorenvironments
_version_ 1724468850742788096