Incorporating Deep Features into GEOBIA Paradigm for Remote Sensing Imagery Classification: A Patch-Based Approach
The fast and accurate creation of land use/land cover maps from very-high-resolution (VHR) remote sensing imagery is crucial for urban planning and environmental monitoring. Geographic object-based image analysis methods (GEOBIA) provide an effective solution using image objects instead of individua...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2020-09-01
|
Series: | Remote Sensing |
Subjects: | |
Online Access: | https://www.mdpi.com/2072-4292/12/18/3007 |
id |
doaj-58dd13481e20435a9788b84ea1802c5b |
---|---|
record_format |
Article |
spelling |
doaj-58dd13481e20435a9788b84ea1802c5b2020-11-25T03:07:15ZengMDPI AGRemote Sensing2072-42922020-09-01123007300710.3390/rs12183007Incorporating Deep Features into GEOBIA Paradigm for Remote Sensing Imagery Classification: A Patch-Based ApproachBo Liu0Shihong Du1Shouji Du2Xiuyuan Zhang3Institute of Remote Sensing and GIS, Peking University, Beijing 100871, ChinaInstitute of Remote Sensing and GIS, Peking University, Beijing 100871, ChinaInstitute of Remote Sensing and GIS, Peking University, Beijing 100871, ChinaInstitute of Remote Sensing and GIS, Peking University, Beijing 100871, ChinaThe fast and accurate creation of land use/land cover maps from very-high-resolution (VHR) remote sensing imagery is crucial for urban planning and environmental monitoring. Geographic object-based image analysis methods (GEOBIA) provide an effective solution using image objects instead of individual pixels in VHR remote sensing imagery analysis. Simultaneously, convolutional neural networks (CNN) have been widely used in the image processing field because of their powerful feature extraction capabilities. This study presents a patch-based strategy for integrating deep features into GEOBIA for VHR remote sensing imagery classification. To extract deep features from irregular image objects through CNN, a patch-based approach is proposed for representing image objects and learning patch-based deep features, and a deep features aggregation method is proposed for aggregating patch-based deep features into object-based deep features. Finally, both object and deep features are integrated into a GEOBIA paradigm for classifying image objects. We explored the influences of segmentation scales and patch sizes in our method and explored the effectiveness of deep and object features in classification. Moreover, we performed 5-fold stratified cross validations 50 times to explore the uncertainty of our method. Additionally, we explored the importance of deep feature aggregation, and we evaluated our method by comparing it with three state-of-the-art methods in a Beijing dataset and Zurich dataset. The results indicate that smaller segmentation scales were more conducive to VHR remote sensing imagery classification, and it was not appropriate to select too large or too small patches as the patch size should be determined by imagery and its resolution. Moreover, we found that deep features are more effective than object features, while object features still matter for image classification, and deep feature aggregation is a critical step in our method. Finally, our method can achieve the highest overall accuracies compared with the state-of-the-art methods, and the overall accuracies are 91.21% for the Beijing dataset and 99.05% for the Zurich dataset.https://www.mdpi.com/2072-4292/12/18/3007GEOBIAconvolutional neural networksvery-high-resolution remote sensing images |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Bo Liu Shihong Du Shouji Du Xiuyuan Zhang |
spellingShingle |
Bo Liu Shihong Du Shouji Du Xiuyuan Zhang Incorporating Deep Features into GEOBIA Paradigm for Remote Sensing Imagery Classification: A Patch-Based Approach Remote Sensing GEOBIA convolutional neural networks very-high-resolution remote sensing images |
author_facet |
Bo Liu Shihong Du Shouji Du Xiuyuan Zhang |
author_sort |
Bo Liu |
title |
Incorporating Deep Features into GEOBIA Paradigm for Remote Sensing Imagery Classification: A Patch-Based Approach |
title_short |
Incorporating Deep Features into GEOBIA Paradigm for Remote Sensing Imagery Classification: A Patch-Based Approach |
title_full |
Incorporating Deep Features into GEOBIA Paradigm for Remote Sensing Imagery Classification: A Patch-Based Approach |
title_fullStr |
Incorporating Deep Features into GEOBIA Paradigm for Remote Sensing Imagery Classification: A Patch-Based Approach |
title_full_unstemmed |
Incorporating Deep Features into GEOBIA Paradigm for Remote Sensing Imagery Classification: A Patch-Based Approach |
title_sort |
incorporating deep features into geobia paradigm for remote sensing imagery classification: a patch-based approach |
publisher |
MDPI AG |
series |
Remote Sensing |
issn |
2072-4292 |
publishDate |
2020-09-01 |
description |
The fast and accurate creation of land use/land cover maps from very-high-resolution (VHR) remote sensing imagery is crucial for urban planning and environmental monitoring. Geographic object-based image analysis methods (GEOBIA) provide an effective solution using image objects instead of individual pixels in VHR remote sensing imagery analysis. Simultaneously, convolutional neural networks (CNN) have been widely used in the image processing field because of their powerful feature extraction capabilities. This study presents a patch-based strategy for integrating deep features into GEOBIA for VHR remote sensing imagery classification. To extract deep features from irregular image objects through CNN, a patch-based approach is proposed for representing image objects and learning patch-based deep features, and a deep features aggregation method is proposed for aggregating patch-based deep features into object-based deep features. Finally, both object and deep features are integrated into a GEOBIA paradigm for classifying image objects. We explored the influences of segmentation scales and patch sizes in our method and explored the effectiveness of deep and object features in classification. Moreover, we performed 5-fold stratified cross validations 50 times to explore the uncertainty of our method. Additionally, we explored the importance of deep feature aggregation, and we evaluated our method by comparing it with three state-of-the-art methods in a Beijing dataset and Zurich dataset. The results indicate that smaller segmentation scales were more conducive to VHR remote sensing imagery classification, and it was not appropriate to select too large or too small patches as the patch size should be determined by imagery and its resolution. Moreover, we found that deep features are more effective than object features, while object features still matter for image classification, and deep feature aggregation is a critical step in our method. Finally, our method can achieve the highest overall accuracies compared with the state-of-the-art methods, and the overall accuracies are 91.21% for the Beijing dataset and 99.05% for the Zurich dataset. |
topic |
GEOBIA convolutional neural networks very-high-resolution remote sensing images |
url |
https://www.mdpi.com/2072-4292/12/18/3007 |
work_keys_str_mv |
AT boliu incorporatingdeepfeaturesintogeobiaparadigmforremotesensingimageryclassificationapatchbasedapproach AT shihongdu incorporatingdeepfeaturesintogeobiaparadigmforremotesensingimageryclassificationapatchbasedapproach AT shoujidu incorporatingdeepfeaturesintogeobiaparadigmforremotesensingimageryclassificationapatchbasedapproach AT xiuyuanzhang incorporatingdeepfeaturesintogeobiaparadigmforremotesensingimageryclassificationapatchbasedapproach |
_version_ |
1724671687148961792 |