Multi-Scale Ship Detection From SAR and Optical Imagery Via A More Accurate YOLOv3
Deep learning detection methods use in ship detection remains a challenge, owing to the small scale of the objects and interference from complex sea surfaces. In addition, existing ship detection methods rarely verify the robustness of their algorithms on multisensor images. Thus, we propose a new i...
Main Authors: | , , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2021-01-01
|
Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9448440/ |
id |
doaj-bf97c5833c7a4f298bf1f0206315fc55 |
---|---|
record_format |
Article |
spelling |
doaj-bf97c5833c7a4f298bf1f0206315fc552021-07-01T23:00:14ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352021-01-01146083610110.1109/JSTARS.2021.30875559448440Multi-Scale Ship Detection From SAR and Optical Imagery Via A More Accurate YOLOv3Zhonghua Hong0https://orcid.org/0000-0003-0045-1066Ting Yang1Xiaohua Tong2https://orcid.org/0000-0002-1045-3797Yun Zhang3https://orcid.org/0000-0003-4367-8674Shenlu Jiang4Ruyan Zhou5Yanling Han6Jing Wang7Shuhu Yang8https://orcid.org/0000-0001-9967-7756Sichong Liu9https://orcid.org/0000-0003-1612-4844College of Information Technology, Shanghai Ocean University, Shanghai, ChinaCollege of Information Technology, Shanghai Ocean University, Shanghai, ChinaCollege of Surveying and Geo-Informatics, Tongji University, Shanghai, ChinaCollege of Information Technology, Shanghai Ocean University, Shanghai, ChinaSpace and Earth Information Science, The Chinese University of Hong Kong, Hong KongCollege of Information Technology, Shanghai Ocean University, Shanghai, ChinaCollege of Information Technology, Shanghai Ocean University, Shanghai, ChinaCollege of Information Technology, Shanghai Ocean University, Shanghai, ChinaCollege of Information Technology, Shanghai Ocean University, Shanghai, ChinaCollege of Surveying and Geo-Informatics, Tongji University, Shanghai, ChinaDeep learning detection methods use in ship detection remains a challenge, owing to the small scale of the objects and interference from complex sea surfaces. In addition, existing ship detection methods rarely verify the robustness of their algorithms on multisensor images. Thus, we propose a new improvement on the “you only look once” version 3 (YOLOv3) framework for ship detection in marine surveillance, based on synthetic aperture radar (SAR) and optical imagery. First, improved choices are obtained for the anchor boxes by using linear scaling based on the k-means++ algorithm. This addresses the difficulty in reflecting the advantages of YOLOv3's multiscale detection, as the anchor boxes of a single detection target type between different detection scales have small differences. Second, we add uncertainty estimators for the positioning of the bounding boxes by introducing a Gaussian parameter for ship detection into the YOLOv3 framework. Finally, four anchor boxes are allocated to each detection scale in the Gaussian-YOLO layer instead of three as in the default YOLOv3 settings, as there are wide disparities in an object's size and direction in remote sensing images with different resolutions. Applying the proposed strategy to ``YOLOv3-spp” and ``YOLOv3-tiny,” the results are enhanced by 2%–3%. Compared with other models, the improved-YOLOv3 has the highest average precision on both the optical (93.56%) and SAR (95.52%) datasets. The improved-YOLOv3 is robust, even in the context of a mixed dataset of SAR and optical images comprising images from different satellites and with different scales.https://ieeexplore.ieee.org/document/9448440/Deep learning-based object detectionsynthetic aperture radar (SAR) and optical imageryship detection“you only look once”version 3 (YOLOv3) |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Zhonghua Hong Ting Yang Xiaohua Tong Yun Zhang Shenlu Jiang Ruyan Zhou Yanling Han Jing Wang Shuhu Yang Sichong Liu |
spellingShingle |
Zhonghua Hong Ting Yang Xiaohua Tong Yun Zhang Shenlu Jiang Ruyan Zhou Yanling Han Jing Wang Shuhu Yang Sichong Liu Multi-Scale Ship Detection From SAR and Optical Imagery Via A More Accurate YOLOv3 IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Deep learning-based object detection synthetic aperture radar (SAR) and optical imagery ship detection “you only look once”version 3 (YOLOv3) |
author_facet |
Zhonghua Hong Ting Yang Xiaohua Tong Yun Zhang Shenlu Jiang Ruyan Zhou Yanling Han Jing Wang Shuhu Yang Sichong Liu |
author_sort |
Zhonghua Hong |
title |
Multi-Scale Ship Detection From SAR and Optical Imagery Via A More Accurate YOLOv3 |
title_short |
Multi-Scale Ship Detection From SAR and Optical Imagery Via A More Accurate YOLOv3 |
title_full |
Multi-Scale Ship Detection From SAR and Optical Imagery Via A More Accurate YOLOv3 |
title_fullStr |
Multi-Scale Ship Detection From SAR and Optical Imagery Via A More Accurate YOLOv3 |
title_full_unstemmed |
Multi-Scale Ship Detection From SAR and Optical Imagery Via A More Accurate YOLOv3 |
title_sort |
multi-scale ship detection from sar and optical imagery via a more accurate yolov3 |
publisher |
IEEE |
series |
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
issn |
2151-1535 |
publishDate |
2021-01-01 |
description |
Deep learning detection methods use in ship detection remains a challenge, owing to the small scale of the objects and interference from complex sea surfaces. In addition, existing ship detection methods rarely verify the robustness of their algorithms on multisensor images. Thus, we propose a new improvement on the “you only look once” version 3 (YOLOv3) framework for ship detection in marine surveillance, based on synthetic aperture radar (SAR) and optical imagery. First, improved choices are obtained for the anchor boxes by using linear scaling based on the k-means++ algorithm. This addresses the difficulty in reflecting the advantages of YOLOv3's multiscale detection, as the anchor boxes of a single detection target type between different detection scales have small differences. Second, we add uncertainty estimators for the positioning of the bounding boxes by introducing a Gaussian parameter for ship detection into the YOLOv3 framework. Finally, four anchor boxes are allocated to each detection scale in the Gaussian-YOLO layer instead of three as in the default YOLOv3 settings, as there are wide disparities in an object's size and direction in remote sensing images with different resolutions. Applying the proposed strategy to ``YOLOv3-spp” and ``YOLOv3-tiny,” the results are enhanced by 2%–3%. Compared with other models, the improved-YOLOv3 has the highest average precision on both the optical (93.56%) and SAR (95.52%) datasets. The improved-YOLOv3 is robust, even in the context of a mixed dataset of SAR and optical images comprising images from different satellites and with different scales. |
topic |
Deep learning-based object detection synthetic aperture radar (SAR) and optical imagery ship detection “you only look once”version 3 (YOLOv3) |
url |
https://ieeexplore.ieee.org/document/9448440/ |
work_keys_str_mv |
AT zhonghuahong multiscaleshipdetectionfromsarandopticalimageryviaamoreaccurateyolov3 AT tingyang multiscaleshipdetectionfromsarandopticalimageryviaamoreaccurateyolov3 AT xiaohuatong multiscaleshipdetectionfromsarandopticalimageryviaamoreaccurateyolov3 AT yunzhang multiscaleshipdetectionfromsarandopticalimageryviaamoreaccurateyolov3 AT shenlujiang multiscaleshipdetectionfromsarandopticalimageryviaamoreaccurateyolov3 AT ruyanzhou multiscaleshipdetectionfromsarandopticalimageryviaamoreaccurateyolov3 AT yanlinghan multiscaleshipdetectionfromsarandopticalimageryviaamoreaccurateyolov3 AT jingwang multiscaleshipdetectionfromsarandopticalimageryviaamoreaccurateyolov3 AT shuhuyang multiscaleshipdetectionfromsarandopticalimageryviaamoreaccurateyolov3 AT sichongliu multiscaleshipdetectionfromsarandopticalimageryviaamoreaccurateyolov3 |
_version_ |
1721345690087456768 |