Real-Time Underwater Maritime Object Detection in Side-Scan Sonar Images Based on Transformer-YOLOv5

To overcome the shortcomings of the traditional manual detection of underwater targets in side-scan sonar (SSS) images, a real-time automatic target recognition (ATR) method is proposed in this paper. This method consists of image preprocessing, sampling, ATR by integration of the transformer module...

Full description

Bibliographic Details
Main Authors: Yongcan Yu, Jianhu Zhao, Quanhua Gong, Chao Huang, Gen Zheng, Jinye Ma
Format: Article
Language:English
Published: MDPI AG 2021-09-01
Series:Remote Sensing
Subjects:
Online Access:https://www.mdpi.com/2072-4292/13/18/3555
id doaj-85d4fdeabcd748a9914d572c767bf7ff
record_format Article
spelling doaj-85d4fdeabcd748a9914d572c767bf7ff2021-09-26T01:15:24ZengMDPI AGRemote Sensing2072-42922021-09-01133555355510.3390/rs13183555Real-Time Underwater Maritime Object Detection in Side-Scan Sonar Images Based on Transformer-YOLOv5Yongcan Yu0Jianhu Zhao1Quanhua Gong2Chao Huang3Gen Zheng4Jinye Ma5School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, ChinaSchool of Geodesy and Geomatics, Wuhan University, Wuhan 430079, ChinaNew Energy Engineering Limited Company of China Communications Construction Company Third Harbor Engineering Limited Company, Shanghai 200137, ChinaSchool of Geodesy and Geomatics, Wuhan University, Wuhan 430079, ChinaSchool of Geodesy and Geomatics, Wuhan University, Wuhan 430079, ChinaSchool of Geodesy and Geomatics, Wuhan University, Wuhan 430079, ChinaTo overcome the shortcomings of the traditional manual detection of underwater targets in side-scan sonar (SSS) images, a real-time automatic target recognition (ATR) method is proposed in this paper. This method consists of image preprocessing, sampling, ATR by integration of the transformer module and YOLOv5s (that is, TR–YOLOv5s), and target localization. By considering the target-sparse and feature-barren characteristics of SSS images, a novel TR–YOLOv5s network and a down-sampling principle are put forward, and the attention mechanism is introduced in the method to meet the requirements of accuracy and efficiency for underwater target recognition. Experiments verified the proposed method achieved 85.6% mean average precision (mAP) and 87.8% macro-F<sub>2</sub> score, and brought 12.5% and 10.6% gains compared with the YOLOv5s network trained from scratch, and had the real-time recognition speed of about 0.068 s per image.https://www.mdpi.com/2072-4292/13/18/3555sonar automatic target recognition (ATR)real timeunderwater maritime objectdeep learningside-scan sonar images
collection DOAJ
language English
format Article
sources DOAJ
author Yongcan Yu
Jianhu Zhao
Quanhua Gong
Chao Huang
Gen Zheng
Jinye Ma
spellingShingle Yongcan Yu
Jianhu Zhao
Quanhua Gong
Chao Huang
Gen Zheng
Jinye Ma
Real-Time Underwater Maritime Object Detection in Side-Scan Sonar Images Based on Transformer-YOLOv5
Remote Sensing
sonar automatic target recognition (ATR)
real time
underwater maritime object
deep learning
side-scan sonar images
author_facet Yongcan Yu
Jianhu Zhao
Quanhua Gong
Chao Huang
Gen Zheng
Jinye Ma
author_sort Yongcan Yu
title Real-Time Underwater Maritime Object Detection in Side-Scan Sonar Images Based on Transformer-YOLOv5
title_short Real-Time Underwater Maritime Object Detection in Side-Scan Sonar Images Based on Transformer-YOLOv5
title_full Real-Time Underwater Maritime Object Detection in Side-Scan Sonar Images Based on Transformer-YOLOv5
title_fullStr Real-Time Underwater Maritime Object Detection in Side-Scan Sonar Images Based on Transformer-YOLOv5
title_full_unstemmed Real-Time Underwater Maritime Object Detection in Side-Scan Sonar Images Based on Transformer-YOLOv5
title_sort real-time underwater maritime object detection in side-scan sonar images based on transformer-yolov5
publisher MDPI AG
series Remote Sensing
issn 2072-4292
publishDate 2021-09-01
description To overcome the shortcomings of the traditional manual detection of underwater targets in side-scan sonar (SSS) images, a real-time automatic target recognition (ATR) method is proposed in this paper. This method consists of image preprocessing, sampling, ATR by integration of the transformer module and YOLOv5s (that is, TR–YOLOv5s), and target localization. By considering the target-sparse and feature-barren characteristics of SSS images, a novel TR–YOLOv5s network and a down-sampling principle are put forward, and the attention mechanism is introduced in the method to meet the requirements of accuracy and efficiency for underwater target recognition. Experiments verified the proposed method achieved 85.6% mean average precision (mAP) and 87.8% macro-F<sub>2</sub> score, and brought 12.5% and 10.6% gains compared with the YOLOv5s network trained from scratch, and had the real-time recognition speed of about 0.068 s per image.
topic sonar automatic target recognition (ATR)
real time
underwater maritime object
deep learning
side-scan sonar images
url https://www.mdpi.com/2072-4292/13/18/3555
work_keys_str_mv AT yongcanyu realtimeunderwatermaritimeobjectdetectioninsidescansonarimagesbasedontransformeryolov5
AT jianhuzhao realtimeunderwatermaritimeobjectdetectioninsidescansonarimagesbasedontransformeryolov5
AT quanhuagong realtimeunderwatermaritimeobjectdetectioninsidescansonarimagesbasedontransformeryolov5
AT chaohuang realtimeunderwatermaritimeobjectdetectioninsidescansonarimagesbasedontransformeryolov5
AT genzheng realtimeunderwatermaritimeobjectdetectioninsidescansonarimagesbasedontransformeryolov5
AT jinyema realtimeunderwatermaritimeobjectdetectioninsidescansonarimagesbasedontransformeryolov5
_version_ 1716869159670775808