Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD

Object detection and distance estimation based on videos are important issues in advanced driver-sssistant system (ADAS). In practice, fisheye cameras are widely used to capture images with a large field of view, which will produce distorted image frames. But most of the object detection algorithms...

Full description

Bibliographic Details
Main Authors: Fanghui Zhang, Yi Jin, Shichao Kan, Linna Zhang, Yigang Cen, Wen Jin
Format: Article
Language:English
Published: Atlantis Press 2021-04-01
Series:International Journal of Computational Intelligence Systems
Subjects:
Online Access:https://www.atlantis-press.com/article/125956005/view
id doaj-ee5a0a21bc61458098d9800723b56c14
record_format Article
spelling doaj-ee5a0a21bc61458098d9800723b56c142021-05-06T12:00:39ZengAtlantis PressInternational Journal of Computational Intelligence Systems 1875-68832021-04-0114110.2991/ijcis.d.210419.001Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSDFanghui ZhangYi JinShichao KanLinna ZhangYigang CenWen JinObject detection and distance estimation based on videos are important issues in advanced driver-sssistant system (ADAS). In practice, fisheye cameras are widely used to capture images with a large field of view, which will produce distorted image frames. But most of the object detection algorithms were designed for the nonfisheye camera videos without distortion, which is not suitable for the application of ADAS since one always expects the panorama stitching and object detection system should share one set of cameras. The research of vehicle detection based on fisheye cameras is relatively rare. In this paper, vehicle detection and distance estimation based on fisheye cameras are studied. First, a multi-scale partition preprocessing is proposed, which can enlarge the size of small targets to improve the detection accuracy of small targets. Second, parameters learned from the public datasets without distortion is transferred to our fisheye video dataset. Then metric learning-based single shot multibox detector (MLSSD) is proposed to improve the accuracy of distorted vehicle detection. Combining metric learning and SSD network, MLSSD can significantly reduce the missing and false detection rates. Moreover, a scalable overlapping partition pooling method is proposed to explore the relations among the adjacent features in a feature map. Finally, the distance between the driving vehicle and vehicles around this vehicle is estimated based on the object detection results by the method of marker points. Experimental results show that our proposed MLSSD network significantly outperforms other networks for distorted object detection.https://www.atlantis-press.com/article/125956005/viewObject detectionVehicle distance estimationMetric learningScalable overlapping partition-pooling
collection DOAJ
language English
format Article
sources DOAJ
author Fanghui Zhang
Yi Jin
Shichao Kan
Linna Zhang
Yigang Cen
Wen Jin
spellingShingle Fanghui Zhang
Yi Jin
Shichao Kan
Linna Zhang
Yigang Cen
Wen Jin
Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD
International Journal of Computational Intelligence Systems
Object detection
Vehicle distance estimation
Metric learning
Scalable overlapping partition-pooling
author_facet Fanghui Zhang
Yi Jin
Shichao Kan
Linna Zhang
Yigang Cen
Wen Jin
author_sort Fanghui Zhang
title Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD
title_short Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD
title_full Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD
title_fullStr Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD
title_full_unstemmed Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD
title_sort distorted vehicle detection and distance estimation by metric learning-based ssd
publisher Atlantis Press
series International Journal of Computational Intelligence Systems
issn 1875-6883
publishDate 2021-04-01
description Object detection and distance estimation based on videos are important issues in advanced driver-sssistant system (ADAS). In practice, fisheye cameras are widely used to capture images with a large field of view, which will produce distorted image frames. But most of the object detection algorithms were designed for the nonfisheye camera videos without distortion, which is not suitable for the application of ADAS since one always expects the panorama stitching and object detection system should share one set of cameras. The research of vehicle detection based on fisheye cameras is relatively rare. In this paper, vehicle detection and distance estimation based on fisheye cameras are studied. First, a multi-scale partition preprocessing is proposed, which can enlarge the size of small targets to improve the detection accuracy of small targets. Second, parameters learned from the public datasets without distortion is transferred to our fisheye video dataset. Then metric learning-based single shot multibox detector (MLSSD) is proposed to improve the accuracy of distorted vehicle detection. Combining metric learning and SSD network, MLSSD can significantly reduce the missing and false detection rates. Moreover, a scalable overlapping partition pooling method is proposed to explore the relations among the adjacent features in a feature map. Finally, the distance between the driving vehicle and vehicles around this vehicle is estimated based on the object detection results by the method of marker points. Experimental results show that our proposed MLSSD network significantly outperforms other networks for distorted object detection.
topic Object detection
Vehicle distance estimation
Metric learning
Scalable overlapping partition-pooling
url https://www.atlantis-press.com/article/125956005/view
work_keys_str_mv AT fanghuizhang distortedvehicledetectionanddistanceestimationbymetriclearningbasedssd
AT yijin distortedvehicledetectionanddistanceestimationbymetriclearningbasedssd
AT shichaokan distortedvehicledetectionanddistanceestimationbymetriclearningbasedssd
AT linnazhang distortedvehicledetectionanddistanceestimationbymetriclearningbasedssd
AT yigangcen distortedvehicledetectionanddistanceestimationbymetriclearningbasedssd
AT wenjin distortedvehicledetectionanddistanceestimationbymetriclearningbasedssd
_version_ 1721456774254428160