MINDFLOW BASED DENSE MATCHING BETWEEN TIR AND RGB IMAGES

• Main Authors: J. Zhu, Z. Ye, Y. Xu, L. Hoegner, U. Stilla
• Format: Article
• Language: English
• Published: Copernicus Publications 2020-08-01
• Series: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
• Online Access: https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/111/2020/isprs-archives-XLIII-B2-2020-111-2020.pdf

Image registration is a fundamental issue in photogrammetry and remote sensing, which targets to find the alignment between different images. Recently, registration of images from difference sensors become the hot topic. The registered images from different sensors are able to offer additional information, which help with different tasks like segmentation, classification, and even emergency analysis. In this paper, we proposed a registration strategy to calculate the dominant orientation difference and then achieve the dense alignment of Thermal Infrared (TIR) image and RGB image with MINDflow. Firstly, the orientation difference of TIR images and RGB images is calculated by finding the dominant image orientations based on phase congruency. Then, the modality independent neighborhood descriptor (MIND) together with global optical flow algorithm are adopted as MINDflow for dense matching. Our method is tested in the image sets containing TIR images and RGB images captured separately but in the same construction site areas. The results show that it is able to achieve the optimal results with features of significance even for dramatically radiometric differences between TIR images and RGB images. By comparing the results with other descriptor, our method is more robust and keep the features of objects in the images.