Spatial Resolution Enhancement of Remote Sensing Hyperspectral Images With Localized Spatial-Spectral Dictionary Pair
The hyperspectral image (HSI) is capable of providing abundant and detailed spectral information in hundreds of contiguous spectral bands. While due to some practical reasons, its spatial resolution is generally lower than that of multispectral image (MSI) and panchromatic image. To deal with the li...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9040549/ |
id |
doaj-c94b0182f323410284d7487f920f241f |
---|---|
record_format |
Article |
spelling |
doaj-c94b0182f323410284d7487f920f241f2021-03-30T01:30:06ZengIEEEIEEE Access2169-35362020-01-018610516106910.1109/ACCESS.2020.29816909040549Spatial Resolution Enhancement of Remote Sensing Hyperspectral Images With Localized Spatial-Spectral Dictionary PairYifan Zhang0https://orcid.org/0000-0003-4533-3880Jin Tian1Tuo Zhao2Shaohui Mei3https://orcid.org/0000-0002-8018-596XSchool of Electronics and Information, Northwestern Polytechnical University, Xi’an, ChinaSchool of Physics and Information Engineering, Shanxi Normal University, Linfen, ChinaHuawei Technologies Company, Ltd., Xi’an, ChinaSchool of Electronics and Information, Northwestern Polytechnical University, Xi’an, ChinaThe hyperspectral image (HSI) is capable of providing abundant and detailed spectral information in hundreds of contiguous spectral bands. While due to some practical reasons, its spatial resolution is generally lower than that of multispectral image (MSI) and panchromatic image. To deal with the limited spatial resolution issue of HSI, a low resolution (LR) HSI can be fused with a high resolution (HR) MSI of the same scene to generate an HR HSI. A novel dictionary-based HSI and MSI fusion method (SSLDF method) is proposed in this paper, in which a localized spatial-spectral dictionary pair incorporating both spatial and spectral information simultaneously is constructed and adopted, rather than the traditional spectral or spatial one. To construct the HR and LR dictionary pair, HR MSI and its spatial degradation (LR MSI) are divided into overlapped subimages. Furthermore, to reduce the dictionary scale and hence to efficiently reduce the computation cost, a localized strategy is employed for dictionary construction rather than a global one, which makes atoms of the spatial-spectral dictionary actually all patches within the subimage. Based on the appropriate assumption that the LR HSI and HR HSI (expected fusion result) can be collaboratively represented by LR dictionary and HR dictionary respectively sharing the same set of representation coefficients, the desired HR HSI is reconstructed by HR dictionary and the collaborative representation coefficients obtained with LR HSI and LR dictionary. In simulative experiments, the newly proposed SSLDF method is validated and compared with both state-of-the-art dictionary-based fusion methods and representative fusion methods not limited to the dictionary-based ones. Simulative experimental results illustrate that the proposed fusion method is capable of producing better or comparable fused results compared with these representative fusion methods. Its simple structure as well as low computation cost makes it quite promising in practical applications.https://ieeexplore.ieee.org/document/9040549/Collaborative representationdictionaryhyperspectralimage fusionmultispectralresolution enhancement |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Yifan Zhang Jin Tian Tuo Zhao Shaohui Mei |
spellingShingle |
Yifan Zhang Jin Tian Tuo Zhao Shaohui Mei Spatial Resolution Enhancement of Remote Sensing Hyperspectral Images With Localized Spatial-Spectral Dictionary Pair IEEE Access Collaborative representation dictionary hyperspectral image fusion multispectral resolution enhancement |
author_facet |
Yifan Zhang Jin Tian Tuo Zhao Shaohui Mei |
author_sort |
Yifan Zhang |
title |
Spatial Resolution Enhancement of Remote Sensing Hyperspectral Images With Localized Spatial-Spectral Dictionary Pair |
title_short |
Spatial Resolution Enhancement of Remote Sensing Hyperspectral Images With Localized Spatial-Spectral Dictionary Pair |
title_full |
Spatial Resolution Enhancement of Remote Sensing Hyperspectral Images With Localized Spatial-Spectral Dictionary Pair |
title_fullStr |
Spatial Resolution Enhancement of Remote Sensing Hyperspectral Images With Localized Spatial-Spectral Dictionary Pair |
title_full_unstemmed |
Spatial Resolution Enhancement of Remote Sensing Hyperspectral Images With Localized Spatial-Spectral Dictionary Pair |
title_sort |
spatial resolution enhancement of remote sensing hyperspectral images with localized spatial-spectral dictionary pair |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2020-01-01 |
description |
The hyperspectral image (HSI) is capable of providing abundant and detailed spectral information in hundreds of contiguous spectral bands. While due to some practical reasons, its spatial resolution is generally lower than that of multispectral image (MSI) and panchromatic image. To deal with the limited spatial resolution issue of HSI, a low resolution (LR) HSI can be fused with a high resolution (HR) MSI of the same scene to generate an HR HSI. A novel dictionary-based HSI and MSI fusion method (SSLDF method) is proposed in this paper, in which a localized spatial-spectral dictionary pair incorporating both spatial and spectral information simultaneously is constructed and adopted, rather than the traditional spectral or spatial one. To construct the HR and LR dictionary pair, HR MSI and its spatial degradation (LR MSI) are divided into overlapped subimages. Furthermore, to reduce the dictionary scale and hence to efficiently reduce the computation cost, a localized strategy is employed for dictionary construction rather than a global one, which makes atoms of the spatial-spectral dictionary actually all patches within the subimage. Based on the appropriate assumption that the LR HSI and HR HSI (expected fusion result) can be collaboratively represented by LR dictionary and HR dictionary respectively sharing the same set of representation coefficients, the desired HR HSI is reconstructed by HR dictionary and the collaborative representation coefficients obtained with LR HSI and LR dictionary. In simulative experiments, the newly proposed SSLDF method is validated and compared with both state-of-the-art dictionary-based fusion methods and representative fusion methods not limited to the dictionary-based ones. Simulative experimental results illustrate that the proposed fusion method is capable of producing better or comparable fused results compared with these representative fusion methods. Its simple structure as well as low computation cost makes it quite promising in practical applications. |
topic |
Collaborative representation dictionary hyperspectral image fusion multispectral resolution enhancement |
url |
https://ieeexplore.ieee.org/document/9040549/ |
work_keys_str_mv |
AT yifanzhang spatialresolutionenhancementofremotesensinghyperspectralimageswithlocalizedspatialspectraldictionarypair AT jintian spatialresolutionenhancementofremotesensinghyperspectralimageswithlocalizedspatialspectraldictionarypair AT tuozhao spatialresolutionenhancementofremotesensinghyperspectralimageswithlocalizedspatialspectraldictionarypair AT shaohuimei spatialresolutionenhancementofremotesensinghyperspectralimageswithlocalizedspatialspectraldictionarypair |
_version_ |
1724186952823996416 |