Investigating the Influence of Registration Errors on the Patch-Based Spatio-Temporal Fusion Method
Spatio-temporal fusion is a common approach in remote sensing, used to create time-series image data with both fine spatial and temporal resolutions. However, geometric registration error, which is a common problem in remote sensing relative to the ground reference, is a particular problem for multi...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9220778/ |
id |
doaj-b7a017fc5f434044958ebf4f5f0ef114 |
---|---|
record_format |
Article |
spelling |
doaj-b7a017fc5f434044958ebf4f5f0ef1142021-06-03T23:05:10ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352020-01-01136291630710.1109/JSTARS.2020.30301229220778Investigating the Influence of Registration Errors on the Patch-Based Spatio-Temporal Fusion MethodLiguo Wang0https://orcid.org/0000-0001-9373-6233Xiaoyi Wang1Qunming Wang2https://orcid.org/0000-0002-5188-0939Peter M. Atkinson3https://orcid.org/0000-0002-5489-6880College of Information and Communication Engineering, Harbin Engineering University, Harbin, ChinaCollege of Information and Communication Engineering, Harbin Engineering University, Harbin, ChinaCollege of Surveying and Geo-Informatics, Tongji University, Shanghai, ChinaFaculty of Science and Technology, Lancaster University, Lancaster, U.K.Spatio-temporal fusion is a common approach in remote sensing, used to create time-series image data with both fine spatial and temporal resolutions. However, geometric registration error, which is a common problem in remote sensing relative to the ground reference, is a particular problem for multiresolution remote sensing data, especially for images with very different spatial resolutions (e.g., Landsat and MODIS images). Registration error can, thus, have a significant impact on the accuracy of spatio-temporal fusion. To the best of our knowledge, however, almost no effective solutions have been provided to-date to cope with this important issue. This article demonstrates the robustness to registration error of the existing SParse representation-based spatio-temporal reflectance fusion model (SPSTFM). Different to conventional methods that are performed on a per-pixel basis, SPSTFM utilizes image patches as the basic unit. We demonstrate theoretically that the effect of registration error on patch-based methods is smaller than for pixel-based methods. Experimental results show that SPSTFM is highly robust to registration error and is far more accurate under various registration errors relative to pixel-based methods. The advantage is shown to be greater for heterogeneous regions than for homogeneous regions, and is large for the fusion of normalized difference vegetation index data. SPSTFM, thus, offers the remote sensing community a crucial tool to overcome one of the longest standing challenges to the effective fusion of remote sensing image time-series.https://ieeexplore.ieee.org/document/9220778/DownscalingLandsatmoderate resolution imaging spectroradiometer (MODIS)registration errorsparse representation based spatio-temporal reflectance fusion model (SPSTFM)spatio-temporal fusion |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Liguo Wang Xiaoyi Wang Qunming Wang Peter M. Atkinson |
spellingShingle |
Liguo Wang Xiaoyi Wang Qunming Wang Peter M. Atkinson Investigating the Influence of Registration Errors on the Patch-Based Spatio-Temporal Fusion Method IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Downscaling Landsat moderate resolution imaging spectroradiometer (MODIS) registration error sparse representation based spatio-temporal reflectance fusion model (SPSTFM) spatio-temporal fusion |
author_facet |
Liguo Wang Xiaoyi Wang Qunming Wang Peter M. Atkinson |
author_sort |
Liguo Wang |
title |
Investigating the Influence of Registration Errors on the Patch-Based Spatio-Temporal Fusion Method |
title_short |
Investigating the Influence of Registration Errors on the Patch-Based Spatio-Temporal Fusion Method |
title_full |
Investigating the Influence of Registration Errors on the Patch-Based Spatio-Temporal Fusion Method |
title_fullStr |
Investigating the Influence of Registration Errors on the Patch-Based Spatio-Temporal Fusion Method |
title_full_unstemmed |
Investigating the Influence of Registration Errors on the Patch-Based Spatio-Temporal Fusion Method |
title_sort |
investigating the influence of registration errors on the patch-based spatio-temporal fusion method |
publisher |
IEEE |
series |
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
issn |
2151-1535 |
publishDate |
2020-01-01 |
description |
Spatio-temporal fusion is a common approach in remote sensing, used to create time-series image data with both fine spatial and temporal resolutions. However, geometric registration error, which is a common problem in remote sensing relative to the ground reference, is a particular problem for multiresolution remote sensing data, especially for images with very different spatial resolutions (e.g., Landsat and MODIS images). Registration error can, thus, have a significant impact on the accuracy of spatio-temporal fusion. To the best of our knowledge, however, almost no effective solutions have been provided to-date to cope with this important issue. This article demonstrates the robustness to registration error of the existing SParse representation-based spatio-temporal reflectance fusion model (SPSTFM). Different to conventional methods that are performed on a per-pixel basis, SPSTFM utilizes image patches as the basic unit. We demonstrate theoretically that the effect of registration error on patch-based methods is smaller than for pixel-based methods. Experimental results show that SPSTFM is highly robust to registration error and is far more accurate under various registration errors relative to pixel-based methods. The advantage is shown to be greater for heterogeneous regions than for homogeneous regions, and is large for the fusion of normalized difference vegetation index data. SPSTFM, thus, offers the remote sensing community a crucial tool to overcome one of the longest standing challenges to the effective fusion of remote sensing image time-series. |
topic |
Downscaling Landsat moderate resolution imaging spectroradiometer (MODIS) registration error sparse representation based spatio-temporal reflectance fusion model (SPSTFM) spatio-temporal fusion |
url |
https://ieeexplore.ieee.org/document/9220778/ |
work_keys_str_mv |
AT liguowang investigatingtheinfluenceofregistrationerrorsonthepatchbasedspatiotemporalfusionmethod AT xiaoyiwang investigatingtheinfluenceofregistrationerrorsonthepatchbasedspatiotemporalfusionmethod AT qunmingwang investigatingtheinfluenceofregistrationerrorsonthepatchbasedspatiotemporalfusionmethod AT petermatkinson investigatingtheinfluenceofregistrationerrorsonthepatchbasedspatiotemporalfusionmethod |
_version_ |
1721398713150078976 |