Fast and Robust Monocular Visua-Inertial Odometry Using Points and Lines

When the camera moves quickly and the image is blurred or the texture in the scene is missing, the Simultaneous Localization and Mapping (SLAM) algorithm based on point feature experiences difficulty tracking enough effective feature points, and the positioning accuracy and robustness are poor, and...

Full description

Bibliographic Details
Main Authors: Ning Zhang, Yongjia Zhao
Format: Article
Language:English
Published: MDPI AG 2019-10-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/19/20/4545
id doaj-a912fa4712b942f8901777fb56e09da3
record_format Article
spelling doaj-a912fa4712b942f8901777fb56e09da32020-11-25T00:10:07ZengMDPI AGSensors1424-82202019-10-011920454510.3390/s19204545s19204545Fast and Robust Monocular Visua-Inertial Odometry Using Points and LinesNing Zhang0Yongjia Zhao1State Key Laboratory of Virtual Reality Technology and Systems, School of Automation Science and Eletrical Engineering, Beihang University, Beijing 100191, ChinaState Key Laboratory of Virtual Reality Technology and Systems, School of Automation Science and Eletrical Engineering, Beihang University, Beijing 100191, ChinaWhen the camera moves quickly and the image is blurred or the texture in the scene is missing, the Simultaneous Localization and Mapping (SLAM) algorithm based on point feature experiences difficulty tracking enough effective feature points, and the positioning accuracy and robustness are poor, and even may not work properly. For this problem, we propose a monocular visual odometry algorithm based on the point and line features and combining IMU measurement data. Based on this, an environmental-feature map with geometric information is constructed, and the IMU measurement data is incorporated to provide prior and scale information for the visual localization algorithm. Then, the initial pose estimation is obtained based on the motion estimation of the sparse image alignment, and the feature alignment is further performed to obtain the sub-pixel level feature correlation. Finally, more accurate poses and 3D landmarks are obtained by minimizing the re-projection errors of local map points and lines. The experimental results on EuRoC public datasets show that the proposed algorithm outperforms the Open Keyframe-based Visual-Inertial SLAM (OKVIS-mono) algorithm and Oriented FAST and Rotated BRIEF-SLAM (ORB-SLAM) algorithm, which demonstrates the accuracy and speed of the algorithm.https://www.mdpi.com/1424-8220/19/20/4545line featurepoint-line feature fusionsemi-direct method
collection DOAJ
language English
format Article
sources DOAJ
author Ning Zhang
Yongjia Zhao
spellingShingle Ning Zhang
Yongjia Zhao
Fast and Robust Monocular Visua-Inertial Odometry Using Points and Lines
Sensors
line feature
point-line feature fusion
semi-direct method
author_facet Ning Zhang
Yongjia Zhao
author_sort Ning Zhang
title Fast and Robust Monocular Visua-Inertial Odometry Using Points and Lines
title_short Fast and Robust Monocular Visua-Inertial Odometry Using Points and Lines
title_full Fast and Robust Monocular Visua-Inertial Odometry Using Points and Lines
title_fullStr Fast and Robust Monocular Visua-Inertial Odometry Using Points and Lines
title_full_unstemmed Fast and Robust Monocular Visua-Inertial Odometry Using Points and Lines
title_sort fast and robust monocular visua-inertial odometry using points and lines
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2019-10-01
description When the camera moves quickly and the image is blurred or the texture in the scene is missing, the Simultaneous Localization and Mapping (SLAM) algorithm based on point feature experiences difficulty tracking enough effective feature points, and the positioning accuracy and robustness are poor, and even may not work properly. For this problem, we propose a monocular visual odometry algorithm based on the point and line features and combining IMU measurement data. Based on this, an environmental-feature map with geometric information is constructed, and the IMU measurement data is incorporated to provide prior and scale information for the visual localization algorithm. Then, the initial pose estimation is obtained based on the motion estimation of the sparse image alignment, and the feature alignment is further performed to obtain the sub-pixel level feature correlation. Finally, more accurate poses and 3D landmarks are obtained by minimizing the re-projection errors of local map points and lines. The experimental results on EuRoC public datasets show that the proposed algorithm outperforms the Open Keyframe-based Visual-Inertial SLAM (OKVIS-mono) algorithm and Oriented FAST and Rotated BRIEF-SLAM (ORB-SLAM) algorithm, which demonstrates the accuracy and speed of the algorithm.
topic line feature
point-line feature fusion
semi-direct method
url https://www.mdpi.com/1424-8220/19/20/4545
work_keys_str_mv AT ningzhang fastandrobustmonocularvisuainertialodometryusingpointsandlines
AT yongjiazhao fastandrobustmonocularvisuainertialodometryusingpointsandlines
_version_ 1725409177701974016