A Superpixel-Based Relational Auto-Encoder for Feature Extraction of Hyperspectral Images

• Main Authors: Miaomiao Liang, Licheng Jiao, Zhe Meng
• Format: Article
• Language: English
• Published: MDPI AG 2019-10-01
• Series: Remote Sensing
• Subjects: hyperspectral images classification (hsic); convolutional neural network (cnn); relational auto-encoder (rae); transfer learning; superpixel; feature fusion
• Online Access: https://www.mdpi.com/2072-4292/11/20/2454

Filter banks transferred from a pre-trained deep convolutional network exhibit significant performance in heightening the inter-class separability for hyperspectral image feature extraction, but weakening the intra-class consistency simultaneously. In this paper, we propose a new superpixel-based relational auto-encoder for cohesive spectral−spatial feature learning. Firstly, multiscale local spatial information and global semantic features of hyperspectral images are extracted by filter banks transferred from the pre-trained VGG-16. Meanwhile, we utilize superpixel segmentation to construct the low-dimensional manifold embedded in the spectral domain. Then, representational consistency constraint among each superpixel is added in the objective function of sparse auto-encoder, which iteratively assist and supervisedly learn hidden representation of deep spatial feature with greater cohesiveness. Superpixel-based local consistency constraint in this work not only reduces the computational complexity, but builds the neighborhood relationships adaptively. The final feature extraction is accomplished by collaborative encoder of spectral−spatial feature and weighting fusion of multiscale features. A large number of experimental results demonstrate that our proposed method achieves expected results in discriminant feature extraction and has certain advantages over some existing methods, especially on extremely limited sample conditions.