Hyperspectral Image Classification Based on Multi-Scale Residual Network with Attention Mechanism

In recent years, image classification on hyperspectral imagery utilizing deep learning algorithms has attained good results. Thus, spurred by that finding and to further improve the deep learning classification accuracy, we propose a multi-scale residual convolutional neural network model fused with...

Full description

Bibliographic Details
Main Authors: Yuhao Qing, Wenyi Liu
Format: Article
Language:English
Published: MDPI AG 2021-01-01
Series:Remote Sensing
Subjects:
Online Access:https://www.mdpi.com/2072-4292/13/3/335
id doaj-5c1f7cea13694f178b74282fb9007d98
record_format Article
spelling doaj-5c1f7cea13694f178b74282fb9007d982021-01-21T00:00:59ZengMDPI AGRemote Sensing2072-42922021-01-011333533510.3390/rs13030335Hyperspectral Image Classification Based on Multi-Scale Residual Network with Attention MechanismYuhao Qing0Wenyi Liu1School of Instrument and Electronics, North University of China, Taiyuan 030000, ChinaSchool of Instrument and Electronics, North University of China, Taiyuan 030000, ChinaIn recent years, image classification on hyperspectral imagery utilizing deep learning algorithms has attained good results. Thus, spurred by that finding and to further improve the deep learning classification accuracy, we propose a multi-scale residual convolutional neural network model fused with an efficient channel attention network (MRA-NET) that is appropriate for hyperspectral image classification. The suggested technique comprises a multi-staged architecture, where initially the spectral information of the hyperspectral image is reduced into a two-dimensional tensor, utilizing a principal component analysis (PCA) scheme. Then, the constructed low-dimensional image is input to our proposed ECA-NET deep network, which exploits the advantages of its core components, i.e., multi-scale residual structure and attention mechanisms. We evaluate the performance of the proposed MRA-NET on three public available hyperspectral datasets and demonstrate that, overall, the classification accuracy of our method is 99.82%, 99.81%, and 99.37, respectively, which is higher compared to the corresponding accuracy of current networks such as 3D convolutional neural network (CNN), three-dimensional residual convolution structure (RES-3D-CNN), and space–spectrum joint deep network (SSRN).https://www.mdpi.com/2072-4292/13/3/335hyperspectral image classificationconvolutional neural networksattention mechanismmulti-scaleresidual network
collection DOAJ
language English
format Article
sources DOAJ
author Yuhao Qing
Wenyi Liu
spellingShingle Yuhao Qing
Wenyi Liu
Hyperspectral Image Classification Based on Multi-Scale Residual Network with Attention Mechanism
Remote Sensing
hyperspectral image classification
convolutional neural networks
attention mechanism
multi-scale
residual network
author_facet Yuhao Qing
Wenyi Liu
author_sort Yuhao Qing
title Hyperspectral Image Classification Based on Multi-Scale Residual Network with Attention Mechanism
title_short Hyperspectral Image Classification Based on Multi-Scale Residual Network with Attention Mechanism
title_full Hyperspectral Image Classification Based on Multi-Scale Residual Network with Attention Mechanism
title_fullStr Hyperspectral Image Classification Based on Multi-Scale Residual Network with Attention Mechanism
title_full_unstemmed Hyperspectral Image Classification Based on Multi-Scale Residual Network with Attention Mechanism
title_sort hyperspectral image classification based on multi-scale residual network with attention mechanism
publisher MDPI AG
series Remote Sensing
issn 2072-4292
publishDate 2021-01-01
description In recent years, image classification on hyperspectral imagery utilizing deep learning algorithms has attained good results. Thus, spurred by that finding and to further improve the deep learning classification accuracy, we propose a multi-scale residual convolutional neural network model fused with an efficient channel attention network (MRA-NET) that is appropriate for hyperspectral image classification. The suggested technique comprises a multi-staged architecture, where initially the spectral information of the hyperspectral image is reduced into a two-dimensional tensor, utilizing a principal component analysis (PCA) scheme. Then, the constructed low-dimensional image is input to our proposed ECA-NET deep network, which exploits the advantages of its core components, i.e., multi-scale residual structure and attention mechanisms. We evaluate the performance of the proposed MRA-NET on three public available hyperspectral datasets and demonstrate that, overall, the classification accuracy of our method is 99.82%, 99.81%, and 99.37, respectively, which is higher compared to the corresponding accuracy of current networks such as 3D convolutional neural network (CNN), three-dimensional residual convolution structure (RES-3D-CNN), and space–spectrum joint deep network (SSRN).
topic hyperspectral image classification
convolutional neural networks
attention mechanism
multi-scale
residual network
url https://www.mdpi.com/2072-4292/13/3/335
work_keys_str_mv AT yuhaoqing hyperspectralimageclassificationbasedonmultiscaleresidualnetworkwithattentionmechanism
AT wenyiliu hyperspectralimageclassificationbasedonmultiscaleresidualnetworkwithattentionmechanism
_version_ 1724330496392953856