RDCRMG: A Raster Dataset Clean & Reconstitution Multi-Grid Architecture for Remote Sensing Monitoring of Vegetation Dryness

In recent years, remote sensing (RS) research on crop growth status monitoring has gradually turned from static spectrum information retrieval in large-scale to meso-scale or micro-scale, timely multi-source data cooperative analysis; this change has presented higher requirements for RS data acquisi...

Full description

Bibliographic Details
Main Authors: Sijing Ye, Diyou Liu, Xiaochuang Yao, Huaizhi Tang, Quan Xiong, Wen Zhuo, Zhenbo Du, Jianxi Huang, Wei Su, Shi Shen, Zuliang Zhao, Shaolong Cui, Lixin Ning, Dehai Zhu, Changxiu Cheng, Changqing Song
Format: Article
Language:English
Published: MDPI AG 2018-08-01
Series:Remote Sensing
Subjects:
Online Access:http://www.mdpi.com/2072-4292/10/9/1376
id doaj-fca26cfa576e4ea6aaab7efe18d14493
record_format Article
collection DOAJ
language English
format Article
sources DOAJ
author Sijing Ye
Diyou Liu
Xiaochuang Yao
Huaizhi Tang
Quan Xiong
Wen Zhuo
Zhenbo Du
Jianxi Huang
Wei Su
Shi Shen
Zuliang Zhao
Shaolong Cui
Lixin Ning
Dehai Zhu
Changxiu Cheng
Changqing Song
spellingShingle Sijing Ye
Diyou Liu
Xiaochuang Yao
Huaizhi Tang
Quan Xiong
Wen Zhuo
Zhenbo Du
Jianxi Huang
Wei Su
Shi Shen
Zuliang Zhao
Shaolong Cui
Lixin Ning
Dehai Zhu
Changxiu Cheng
Changqing Song
RDCRMG: A Raster Dataset Clean & Reconstitution Multi-Grid Architecture for Remote Sensing Monitoring of Vegetation Dryness
Remote Sensing
big data
remote sensing
vegetation dryness
multi-grid
architecture
author_facet Sijing Ye
Diyou Liu
Xiaochuang Yao
Huaizhi Tang
Quan Xiong
Wen Zhuo
Zhenbo Du
Jianxi Huang
Wei Su
Shi Shen
Zuliang Zhao
Shaolong Cui
Lixin Ning
Dehai Zhu
Changxiu Cheng
Changqing Song
author_sort Sijing Ye
title RDCRMG: A Raster Dataset Clean & Reconstitution Multi-Grid Architecture for Remote Sensing Monitoring of Vegetation Dryness
title_short RDCRMG: A Raster Dataset Clean & Reconstitution Multi-Grid Architecture for Remote Sensing Monitoring of Vegetation Dryness
title_full RDCRMG: A Raster Dataset Clean & Reconstitution Multi-Grid Architecture for Remote Sensing Monitoring of Vegetation Dryness
title_fullStr RDCRMG: A Raster Dataset Clean & Reconstitution Multi-Grid Architecture for Remote Sensing Monitoring of Vegetation Dryness
title_full_unstemmed RDCRMG: A Raster Dataset Clean & Reconstitution Multi-Grid Architecture for Remote Sensing Monitoring of Vegetation Dryness
title_sort rdcrmg: a raster dataset clean & reconstitution multi-grid architecture for remote sensing monitoring of vegetation dryness
publisher MDPI AG
series Remote Sensing
issn 2072-4292
publishDate 2018-08-01
description In recent years, remote sensing (RS) research on crop growth status monitoring has gradually turned from static spectrum information retrieval in large-scale to meso-scale or micro-scale, timely multi-source data cooperative analysis; this change has presented higher requirements for RS data acquisition and analysis efficiency. How to implement rapid and stable massive RS data extraction and analysis becomes a serious problem. This paper reports on a Raster Dataset Clean & Reconstitution Multi-Grid (RDCRMG) architecture for remote sensing monitoring of vegetation dryness in which different types of raster datasets have been partitioned, organized and systematically applied. First, raster images have been subdivided into several independent blocks and distributed for storage in different data nodes by using the multi-grid as a consistent partition unit. Second, the “no metadata model” ideology has been referenced so that targets raster data can be speedily extracted by directly calculating the data storage path without retrieving metadata records; third, grids that cover the query range can be easily assessed. This assessment allows the query task to be easily split into several sub-tasks and executed in parallel by grouping these grids. Our RDCRMG-based change detection of the spectral reflectance information test and the data extraction efficiency comparative test shows that the RDCRMG is reliable for vegetation dryness monitoring with a slight reflectance information distortion and consistent percentage histograms. Furthermore, the RDCGMG-based data extraction in parallel circumstances has the advantages of high efficiency and excellent stability compared to that of the RDCGMG-based data extraction in serial circumstances and traditional data extraction. At last, an RDCRMG-based vegetation dryness monitoring platform (VDMP) has been constructed to apply RS data inversion in vegetation dryness monitoring. Through actual applications, the RDCRMG architecture is proven to be appropriate for timely vegetation dryness RS automatic monitoring with better performance, more reliability and higher extensibility. Our future works will focus on integrating more kinds of continuously updated RS data into the RDCRMG-based VDMP and integrating more multi-source datasets based collaborative analysis models for agricultural monitoring.
topic big data
remote sensing
vegetation dryness
multi-grid
architecture
url http://www.mdpi.com/2072-4292/10/9/1376
work_keys_str_mv AT sijingye rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT diyouliu rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT xiaochuangyao rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT huaizhitang rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT quanxiong rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT wenzhuo rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT zhenbodu rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT jianxihuang rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT weisu rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT shishen rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT zuliangzhao rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT shaolongcui rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT lixinning rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT dehaizhu rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT changxiucheng rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
AT changqingsong rdcrmgarasterdatasetcleanampreconstitutionmultigridarchitectureforremotesensingmonitoringofvegetationdryness
_version_ 1725299977845997568
spelling doaj-fca26cfa576e4ea6aaab7efe18d144932020-11-25T00:37:42ZengMDPI AGRemote Sensing2072-42922018-08-01109137610.3390/rs10091376rs10091376RDCRMG: A Raster Dataset Clean & Reconstitution Multi-Grid Architecture for Remote Sensing Monitoring of Vegetation DrynessSijing Ye0Diyou Liu1Xiaochuang Yao2Huaizhi Tang3Quan Xiong4Wen Zhuo5Zhenbo Du6Jianxi Huang7Wei Su8Shi Shen9Zuliang Zhao10Shaolong Cui11Lixin Ning12Dehai Zhu13Changxiu Cheng14Changqing Song15State Key Laboratory of Earth Surface Processes and Resource Ecology, Beijing Normal University, Beijing 100875, ChinaKey Laboratory of Agricultural Land Quality (Beijing) Ministry of Land and Resources, China Agricultural University, Beijing 100083, ChinaInstitute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, ChinaKey Laboratory of Agricultural Land Quality (Beijing) Ministry of Land and Resources, China Agricultural University, Beijing 100083, ChinaKey Laboratory of Agricultural Land Quality (Beijing) Ministry of Land and Resources, China Agricultural University, Beijing 100083, ChinaKey Laboratory of Agricultural Land Quality (Beijing) Ministry of Land and Resources, China Agricultural University, Beijing 100083, ChinaKey Laboratory of Agricultural Land Quality (Beijing) Ministry of Land and Resources, China Agricultural University, Beijing 100083, ChinaKey Laboratory of Agricultural Land Quality (Beijing) Ministry of Land and Resources, China Agricultural University, Beijing 100083, ChinaKey Laboratory of Agricultural Land Quality (Beijing) Ministry of Land and Resources, China Agricultural University, Beijing 100083, ChinaState Key Laboratory of Earth Surface Processes and Resource Ecology, Beijing Normal University, Beijing 100875, ChinaKey Laboratory of Agricultural Land Quality (Beijing) Ministry of Land and Resources, China Agricultural University, Beijing 100083, ChinaInstitute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, ChinaState Key Laboratory of Earth Surface Processes and Resource Ecology, Beijing Normal University, Beijing 100875, ChinaKey Laboratory of Agricultural Land Quality (Beijing) Ministry of Land and Resources, China Agricultural University, Beijing 100083, ChinaState Key Laboratory of Earth Surface Processes and Resource Ecology, Beijing Normal University, Beijing 100875, ChinaCenter for Geodata and Analysis, Beijing Normal University, Beijing 100875, ChinaIn recent years, remote sensing (RS) research on crop growth status monitoring has gradually turned from static spectrum information retrieval in large-scale to meso-scale or micro-scale, timely multi-source data cooperative analysis; this change has presented higher requirements for RS data acquisition and analysis efficiency. How to implement rapid and stable massive RS data extraction and analysis becomes a serious problem. This paper reports on a Raster Dataset Clean & Reconstitution Multi-Grid (RDCRMG) architecture for remote sensing monitoring of vegetation dryness in which different types of raster datasets have been partitioned, organized and systematically applied. First, raster images have been subdivided into several independent blocks and distributed for storage in different data nodes by using the multi-grid as a consistent partition unit. Second, the “no metadata model” ideology has been referenced so that targets raster data can be speedily extracted by directly calculating the data storage path without retrieving metadata records; third, grids that cover the query range can be easily assessed. This assessment allows the query task to be easily split into several sub-tasks and executed in parallel by grouping these grids. Our RDCRMG-based change detection of the spectral reflectance information test and the data extraction efficiency comparative test shows that the RDCRMG is reliable for vegetation dryness monitoring with a slight reflectance information distortion and consistent percentage histograms. Furthermore, the RDCGMG-based data extraction in parallel circumstances has the advantages of high efficiency and excellent stability compared to that of the RDCGMG-based data extraction in serial circumstances and traditional data extraction. At last, an RDCRMG-based vegetation dryness monitoring platform (VDMP) has been constructed to apply RS data inversion in vegetation dryness monitoring. Through actual applications, the RDCRMG architecture is proven to be appropriate for timely vegetation dryness RS automatic monitoring with better performance, more reliability and higher extensibility. Our future works will focus on integrating more kinds of continuously updated RS data into the RDCRMG-based VDMP and integrating more multi-source datasets based collaborative analysis models for agricultural monitoring.http://www.mdpi.com/2072-4292/10/9/1376big dataremote sensingvegetation drynessmulti-gridarchitecture