INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL
Indoor localization, navigation and mapping systems highly rely on the initial sensor pose information to achieve a high accuracy. Most existing indoor mapping and navigation systems cannot initialize the sensor poses automatically and consequently these systems cannot perform relocalization and rec...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Copernicus Publications
2020-08-01
|
Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
Online Access: | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B1-2020/541/2020/isprs-archives-XLIII-B1-2020-541-2020.pdf |
id |
doaj-22abd6e7893347b993c61eab8f4229b4 |
---|---|
record_format |
Article |
spelling |
doaj-22abd6e7893347b993c61eab8f4229b42020-11-25T02:47:49ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342020-08-01XLIII-B1-202054154710.5194/isprs-archives-XLIII-B1-2020-541-2020INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODELH. Zhao0D. Acharya1M. Tomko2K. Khoshelham3Dept. Infrastructure Engineering, The University of Melbourne, AustraliaDept. Infrastructure Engineering, The University of Melbourne, AustraliaDept. Infrastructure Engineering, The University of Melbourne, AustraliaDept. Infrastructure Engineering, The University of Melbourne, AustraliaIndoor localization, navigation and mapping systems highly rely on the initial sensor pose information to achieve a high accuracy. Most existing indoor mapping and navigation systems cannot initialize the sensor poses automatically and consequently these systems cannot perform relocalization and recover from a pose estimation failure. For most indoor environments, a map or a 3D model is often available, and can provide useful information for relocalization. This paper presents a novel relocalization method for lidar sensors in indoor environments to estimate the initial lidar pose using a CNN pose regression network trained using a 3D model. A set of synthetic lidar frames are generated from the 3D model with known poses. Each lidar range image is a one-channel range image, used to train the CNN pose regression network from scratch to predict the initial sensor location and orientation. The CNN regression network trained by synthetic range images is used to estimate the poses of the lidar using real range images captured in the indoor environment. The results show that the proposed CNN regression network can learn from synthetic lidar data and estimate the pose of real lidar data with an accuracy of 1.9 m and 8.7 degrees.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B1-2020/541/2020/isprs-archives-XLIII-B1-2020-541-2020.pdf |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
H. Zhao D. Acharya M. Tomko K. Khoshelham |
spellingShingle |
H. Zhao D. Acharya M. Tomko K. Khoshelham INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
author_facet |
H. Zhao D. Acharya M. Tomko K. Khoshelham |
author_sort |
H. Zhao |
title |
INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL |
title_short |
INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL |
title_full |
INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL |
title_fullStr |
INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL |
title_full_unstemmed |
INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL |
title_sort |
indoor lidar relocalization based on deep learning using a 3d model |
publisher |
Copernicus Publications |
series |
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
issn |
1682-1750 2194-9034 |
publishDate |
2020-08-01 |
description |
Indoor localization, navigation and mapping systems highly rely on the initial sensor pose information to achieve a high accuracy. Most existing indoor mapping and navigation systems cannot initialize the sensor poses automatically and consequently these systems cannot perform relocalization and recover from a pose estimation failure. For most indoor environments, a map or a 3D model is often available, and can provide useful information for relocalization. This paper presents a novel relocalization method for lidar sensors in indoor environments to estimate the initial lidar pose using a CNN pose regression network trained using a 3D model. A set of synthetic lidar frames are generated from the 3D model with known poses. Each lidar range image is a one-channel range image, used to train the CNN pose regression network from scratch to predict the initial sensor location and orientation. The CNN regression network trained by synthetic range images is used to estimate the poses of the lidar using real range images captured in the indoor environment. The results show that the proposed CNN regression network can learn from synthetic lidar data and estimate the pose of real lidar data with an accuracy of 1.9 m and 8.7 degrees. |
url |
https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B1-2020/541/2020/isprs-archives-XLIII-B1-2020-541-2020.pdf |
work_keys_str_mv |
AT hzhao indoorlidarrelocalizationbasedondeeplearningusinga3dmodel AT dacharya indoorlidarrelocalizationbasedondeeplearningusinga3dmodel AT mtomko indoorlidarrelocalizationbasedondeeplearningusinga3dmodel AT kkhoshelham indoorlidarrelocalizationbasedondeeplearningusinga3dmodel |
_version_ |
1724751132872409088 |