Multi-Feature Fusion for Enhancing Image Similarity Learning

• Main Authors: Jian Lu, Cheng-Xian Ma, Yan-Ran Zhou, Mao-Xin Luo, Kai-Bing Zhang
• Format: Article
• Language: English
• Published: IEEE 2019-01-01
• Series: IEEE Access
• Subjects: Image similarity learning; CNN; data augmentation; feature extraction; multi-feature fusion
• Online Access: https://ieeexplore.ieee.org/document/8896979/

Image similarity learning aims to exploit the correlation between different images by learning image appropriate common features. In recent years, the previous CNN-based methods have directly learned the similarity between image features, which effectively improves the learning efficiency of image similarity. However, it has the following limitations: (1) The extracted image features are too single to describe the content of the image accurately; and (2) the network training is limited by the amount of dataset size. Data augmentation and multi-feature fusion have been demonstrated to appropriately improve the model generalization ability for various vision tasks. This paper integrates these methods into the network structure to design three multi-feature fusion network. The input of network training adopts the same data from the multi-input method to realize data augmentation, and the diversity of extracted image features is greatly improved by fusing different features. Then, the trained network of different dataset size is utilized to verify the network training adaptability of multi-feature fusion network. Moreover, the influence of loss function and optimization algorithm on the learning efficiency of complicated networks have been studied. The experimental results show that our proposed method has excellent performance on the self-collected XPU and Totally-Looks-Like (TLL) dataset, the learning and model generalization ability of multi-feature fusion network are significantly improved through data augmentation and multi-feature fusion. The multi-feature fusion network proposed in this paper has strong adaptability to network training.