FAST AND ROBUST REGISTRATION OF AERIAL IMAGES AND LIDAR DATA BASED ON STRUCTURAL FEATURES AND 3D PHASE CORRELATION

Co-Registration of aerial imagery and Light Detection and Ranging (LiDAR) data is quilt challenging because the different imaging mechanism causes significant geometric and radiometric distortions between such data. To tackle the problem, this paper proposes an automatic registration method based on...

Full description

Bibliographic Details
Main Authors: B. Zhu, Y. Ye, C. Yang, L. Zhou, H. Liu, Y. Cao
Format: Article
Language:English
Published: Copernicus Publications 2020-08-01
Series:ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-2-2020/135/2020/isprs-annals-V-2-2020-135-2020.pdf
id doaj-e27655bb341c454c80fdb9feeaff8127
record_format Article
spelling doaj-e27655bb341c454c80fdb9feeaff81272020-11-25T03:13:32ZengCopernicus PublicationsISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences2194-90422194-90502020-08-01V-2-202013514110.5194/isprs-annals-V-2-2020-135-2020FAST AND ROBUST REGISTRATION OF AERIAL IMAGES AND LIDAR DATA BASED ON STRUCTURAL FEATURES AND 3D PHASE CORRELATIONB. Zhu0Y. Ye1C. Yang2L. Zhou3H. Liu4Y. Cao5Faculty of Geosciences and Environmental Engineering, Southwest Jiaotong University, Chengdu 610031, ChinaFaculty of Geosciences and Environmental Engineering, Southwest Jiaotong University, Chengdu 610031, ChinaFaculty of Geosciences and Environmental Engineering, Southwest Jiaotong University, Chengdu 610031, ChinaFaculty of Geosciences and Environmental Engineering, Southwest Jiaotong University, Chengdu 610031, ChinaFaculty of Geosciences and Environmental Engineering, Southwest Jiaotong University, Chengdu 610031, ChinaFaculty of Geosciences and Environmental Engineering, Southwest Jiaotong University, Chengdu 610031, ChinaCo-Registration of aerial imagery and Light Detection and Ranging (LiDAR) data is quilt challenging because the different imaging mechanism causes significant geometric and radiometric distortions between such data. To tackle the problem, this paper proposes an automatic registration method based on structural features and three-dimension (3D) phase correlation. In the proposed method, the LiDAR point cloud data is first transformed into the intensity map, which is used as the reference image. Then, we employ the Fast operator to extract uniformly distributed interest points in the aerial image by a partition strategy and perform a local geometric correction by using the collinearity equation to eliminate scale and rotation difference between images. Subsequently, a robust structural feature descriptor is build based on dense gradient features, and the 3D phase correlation is used to detect control points (CPs) between aerial images and LiDAR data in the frequency domain, where the image matching is accelerated by the 3D Fast Fourier Transform (FFT). Finally, the obtained CPs are employed to correct the exterior orientation elements, which is used to achieve co-registration of aerial images and LiDAR data. Experiments with two datasets of aerial images and LiDAR data show that the proposed method is much faster and more robust than state of the art methods.https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-2-2020/135/2020/isprs-annals-V-2-2020-135-2020.pdf
collection DOAJ
language English
format Article
sources DOAJ
author B. Zhu
Y. Ye
C. Yang
L. Zhou
H. Liu
Y. Cao
spellingShingle B. Zhu
Y. Ye
C. Yang
L. Zhou
H. Liu
Y. Cao
FAST AND ROBUST REGISTRATION OF AERIAL IMAGES AND LIDAR DATA BASED ON STRUCTURAL FEATURES AND 3D PHASE CORRELATION
ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
author_facet B. Zhu
Y. Ye
C. Yang
L. Zhou
H. Liu
Y. Cao
author_sort B. Zhu
title FAST AND ROBUST REGISTRATION OF AERIAL IMAGES AND LIDAR DATA BASED ON STRUCTURAL FEATURES AND 3D PHASE CORRELATION
title_short FAST AND ROBUST REGISTRATION OF AERIAL IMAGES AND LIDAR DATA BASED ON STRUCTURAL FEATURES AND 3D PHASE CORRELATION
title_full FAST AND ROBUST REGISTRATION OF AERIAL IMAGES AND LIDAR DATA BASED ON STRUCTURAL FEATURES AND 3D PHASE CORRELATION
title_fullStr FAST AND ROBUST REGISTRATION OF AERIAL IMAGES AND LIDAR DATA BASED ON STRUCTURAL FEATURES AND 3D PHASE CORRELATION
title_full_unstemmed FAST AND ROBUST REGISTRATION OF AERIAL IMAGES AND LIDAR DATA BASED ON STRUCTURAL FEATURES AND 3D PHASE CORRELATION
title_sort fast and robust registration of aerial images and lidar data based on structural features and 3d phase correlation
publisher Copernicus Publications
series ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
issn 2194-9042
2194-9050
publishDate 2020-08-01
description Co-Registration of aerial imagery and Light Detection and Ranging (LiDAR) data is quilt challenging because the different imaging mechanism causes significant geometric and radiometric distortions between such data. To tackle the problem, this paper proposes an automatic registration method based on structural features and three-dimension (3D) phase correlation. In the proposed method, the LiDAR point cloud data is first transformed into the intensity map, which is used as the reference image. Then, we employ the Fast operator to extract uniformly distributed interest points in the aerial image by a partition strategy and perform a local geometric correction by using the collinearity equation to eliminate scale and rotation difference between images. Subsequently, a robust structural feature descriptor is build based on dense gradient features, and the 3D phase correlation is used to detect control points (CPs) between aerial images and LiDAR data in the frequency domain, where the image matching is accelerated by the 3D Fast Fourier Transform (FFT). Finally, the obtained CPs are employed to correct the exterior orientation elements, which is used to achieve co-registration of aerial images and LiDAR data. Experiments with two datasets of aerial images and LiDAR data show that the proposed method is much faster and more robust than state of the art methods.
url https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-2-2020/135/2020/isprs-annals-V-2-2020-135-2020.pdf
work_keys_str_mv AT bzhu fastandrobustregistrationofaerialimagesandlidardatabasedonstructuralfeaturesand3dphasecorrelation
AT yye fastandrobustregistrationofaerialimagesandlidardatabasedonstructuralfeaturesand3dphasecorrelation
AT cyang fastandrobustregistrationofaerialimagesandlidardatabasedonstructuralfeaturesand3dphasecorrelation
AT lzhou fastandrobustregistrationofaerialimagesandlidardatabasedonstructuralfeaturesand3dphasecorrelation
AT hliu fastandrobustregistrationofaerialimagesandlidardatabasedonstructuralfeaturesand3dphasecorrelation
AT ycao fastandrobustregistrationofaerialimagesandlidardatabasedonstructuralfeaturesand3dphasecorrelation
_version_ 1724646370358329344