Multi-Sensor Image Fusion Using Optimized Support Vector Machine and Multiscale Weighted Principal Component Analysis

• Main Authors: Shanshan Huang, Yikun Yang, Xin Jin, Ya Zhang, Qian Jiang, Shaowen Yao
• Format: Article
• Language: English
• Published: MDPI AG 2020-09-01
• Series: Electronics
• Subjects: feature extraction; multi-sensor information fusion; image fusion; principal component analysis; multiscale sliding windows; support vector machine
• Online Access: https://www.mdpi.com/2079-9292/9/9/1531

Multi-sensor image fusion is used to combine the complementary information of source images from the multiple sensors. Recently, conventional image fusion schemes based on signal processing techniques have been studied extensively, and machine learning-based techniques have been introduced into image fusion because of the prominent advantages. In this work, a new multi-sensor image fusion method based on the support vector machine and principal component analysis is proposed. First, the key features of the source images are extracted by combining the sliding window technique and five effective evaluation indicators. Second, a trained support vector machine model is used to extract the focus region and the non-focus region of the source images according to the extracted image features, the fusion decision is therefore obtained for each source image. Then, the consistency verification operation is used to absorb a single singular point in the decisions of the trained classifier. Finally, a novel method based on principal component analysis and the multi-scale sliding window is proposed to handle the disputed areas in the fusion decision pair. Experiments are performed to verify the performance of the new combined method.