INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL

Indoor localization, navigation and mapping systems highly rely on the initial sensor pose information to achieve a high accuracy. Most existing indoor mapping and navigation systems cannot initialize the sensor poses automatically and consequently these systems cannot perform relocalization and rec...

Full description

Bibliographic Details
Main Authors: H. Zhao, D. Acharya, M. Tomko, K. Khoshelham
Format: Article
Language:English
Published: Copernicus Publications 2020-08-01
Series:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B1-2020/541/2020/isprs-archives-XLIII-B1-2020-541-2020.pdf
id doaj-22abd6e7893347b993c61eab8f4229b4
record_format Article
spelling doaj-22abd6e7893347b993c61eab8f4229b42020-11-25T02:47:49ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342020-08-01XLIII-B1-202054154710.5194/isprs-archives-XLIII-B1-2020-541-2020INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODELH. Zhao0D. Acharya1M. Tomko2K. Khoshelham3Dept. Infrastructure Engineering, The University of Melbourne, AustraliaDept. Infrastructure Engineering, The University of Melbourne, AustraliaDept. Infrastructure Engineering, The University of Melbourne, AustraliaDept. Infrastructure Engineering, The University of Melbourne, AustraliaIndoor localization, navigation and mapping systems highly rely on the initial sensor pose information to achieve a high accuracy. Most existing indoor mapping and navigation systems cannot initialize the sensor poses automatically and consequently these systems cannot perform relocalization and recover from a pose estimation failure. For most indoor environments, a map or a 3D model is often available, and can provide useful information for relocalization. This paper presents a novel relocalization method for lidar sensors in indoor environments to estimate the initial lidar pose using a CNN pose regression network trained using a 3D model. A set of synthetic lidar frames are generated from the 3D model with known poses. Each lidar range image is a one-channel range image, used to train the CNN pose regression network from scratch to predict the initial sensor location and orientation. The CNN regression network trained by synthetic range images is used to estimate the poses of the lidar using real range images captured in the indoor environment. The results show that the proposed CNN regression network can learn from synthetic lidar data and estimate the pose of real lidar data with an accuracy of 1.9 m and 8.7 degrees.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B1-2020/541/2020/isprs-archives-XLIII-B1-2020-541-2020.pdf
collection DOAJ
language English
format Article
sources DOAJ
author H. Zhao
D. Acharya
M. Tomko
K. Khoshelham
spellingShingle H. Zhao
D. Acharya
M. Tomko
K. Khoshelham
INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
author_facet H. Zhao
D. Acharya
M. Tomko
K. Khoshelham
author_sort H. Zhao
title INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL
title_short INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL
title_full INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL
title_fullStr INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL
title_full_unstemmed INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL
title_sort indoor lidar relocalization based on deep learning using a 3d model
publisher Copernicus Publications
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
issn 1682-1750
2194-9034
publishDate 2020-08-01
description Indoor localization, navigation and mapping systems highly rely on the initial sensor pose information to achieve a high accuracy. Most existing indoor mapping and navigation systems cannot initialize the sensor poses automatically and consequently these systems cannot perform relocalization and recover from a pose estimation failure. For most indoor environments, a map or a 3D model is often available, and can provide useful information for relocalization. This paper presents a novel relocalization method for lidar sensors in indoor environments to estimate the initial lidar pose using a CNN pose regression network trained using a 3D model. A set of synthetic lidar frames are generated from the 3D model with known poses. Each lidar range image is a one-channel range image, used to train the CNN pose regression network from scratch to predict the initial sensor location and orientation. The CNN regression network trained by synthetic range images is used to estimate the poses of the lidar using real range images captured in the indoor environment. The results show that the proposed CNN regression network can learn from synthetic lidar data and estimate the pose of real lidar data with an accuracy of 1.9 m and 8.7 degrees.
url https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B1-2020/541/2020/isprs-archives-XLIII-B1-2020-541-2020.pdf
work_keys_str_mv AT hzhao indoorlidarrelocalizationbasedondeeplearningusinga3dmodel
AT dacharya indoorlidarrelocalizationbasedondeeplearningusinga3dmodel
AT mtomko indoorlidarrelocalizationbasedondeeplearningusinga3dmodel
AT kkhoshelham indoorlidarrelocalizationbasedondeeplearningusinga3dmodel
_version_ 1724751132872409088