Near-Infrared Road-Marking Detection Based on a Modified Faster Regional Convolutional Neural Network

Pedestrians, motorist, and cyclist remain the victims of poor vision and negligence of human drivers, especially in the night. Millions of people die or sustain physical injury yearly as a result of traffic accidents. Detection and recognition of road markings play a vital role in many applications...

Full description

Bibliographic Details
Main Authors: Junping Hu, Shitu Abubakar, Shengjun Liu, Xiaobiao Dai, Gen Yang, Hao Sha
Format: Article
Language:English
Published: Hindawi Limited 2019-01-01
Series:Journal of Sensors
Online Access:http://dx.doi.org/10.1155/2019/7174602
id doaj-597f1c5554f947eeb6e5ebba9264c720
record_format Article
spelling doaj-597f1c5554f947eeb6e5ebba9264c7202020-11-25T02:20:20ZengHindawi LimitedJournal of Sensors1687-725X1687-72682019-01-01201910.1155/2019/71746027174602Near-Infrared Road-Marking Detection Based on a Modified Faster Regional Convolutional Neural NetworkJunping Hu0Shitu Abubakar1Shengjun Liu2Xiaobiao Dai3Gen Yang4Hao Sha5Department of Vehicle Engineering, College of Mechanical and Electrical Engineering, Central South University, 932 Lushan South Road, Changsha, 410083 Hunan, ChinaDepartment of Vehicle Engineering, College of Mechanical and Electrical Engineering, Central South University, 932 Lushan South Road, Changsha, 410083 Hunan, ChinaSchool of Mathematics and Statistics, Central South University, 932 Lushan South Road, Changsha, 410083 Hunan, ChinaDepartment of Vehicle Engineering, College of Mechanical and Electrical Engineering, Central South University, 932 Lushan South Road, Changsha, 410083 Hunan, ChinaDepartment of Vehicle Engineering, College of Mechanical and Electrical Engineering, Central South University, 932 Lushan South Road, Changsha, 410083 Hunan, ChinaDepartment of Vehicle Engineering, College of Mechanical and Electrical Engineering, Central South University, 932 Lushan South Road, Changsha, 410083 Hunan, ChinaPedestrians, motorist, and cyclist remain the victims of poor vision and negligence of human drivers, especially in the night. Millions of people die or sustain physical injury yearly as a result of traffic accidents. Detection and recognition of road markings play a vital role in many applications such as traffic surveillance and autonomous driving. In this study, we have trained a nighttime road-marking detection model using NIR camera images. We have modified the VGG-16 base network of the state-of-the-art faster R-CNN algorithm by using a multilayer feature fusion technique. We have demonstrated another promising feature fusion technique of concatenating all the convolutional layers within a stage to extract image features. The modification boosts the overall detection performance of the model by utilizing the advantages of the shallow layers and the deep layers of the VGG-16 network. The training samples were augmented using random rotation and translation to enhance the heterogeneity of the detection algorithm. We have achieved a mean average precision (mAP) of 89.48% and 92.83% for the baseline faster R-CNN and our modified method, respectively.http://dx.doi.org/10.1155/2019/7174602
collection DOAJ
language English
format Article
sources DOAJ
author Junping Hu
Shitu Abubakar
Shengjun Liu
Xiaobiao Dai
Gen Yang
Hao Sha
spellingShingle Junping Hu
Shitu Abubakar
Shengjun Liu
Xiaobiao Dai
Gen Yang
Hao Sha
Near-Infrared Road-Marking Detection Based on a Modified Faster Regional Convolutional Neural Network
Journal of Sensors
author_facet Junping Hu
Shitu Abubakar
Shengjun Liu
Xiaobiao Dai
Gen Yang
Hao Sha
author_sort Junping Hu
title Near-Infrared Road-Marking Detection Based on a Modified Faster Regional Convolutional Neural Network
title_short Near-Infrared Road-Marking Detection Based on a Modified Faster Regional Convolutional Neural Network
title_full Near-Infrared Road-Marking Detection Based on a Modified Faster Regional Convolutional Neural Network
title_fullStr Near-Infrared Road-Marking Detection Based on a Modified Faster Regional Convolutional Neural Network
title_full_unstemmed Near-Infrared Road-Marking Detection Based on a Modified Faster Regional Convolutional Neural Network
title_sort near-infrared road-marking detection based on a modified faster regional convolutional neural network
publisher Hindawi Limited
series Journal of Sensors
issn 1687-725X
1687-7268
publishDate 2019-01-01
description Pedestrians, motorist, and cyclist remain the victims of poor vision and negligence of human drivers, especially in the night. Millions of people die or sustain physical injury yearly as a result of traffic accidents. Detection and recognition of road markings play a vital role in many applications such as traffic surveillance and autonomous driving. In this study, we have trained a nighttime road-marking detection model using NIR camera images. We have modified the VGG-16 base network of the state-of-the-art faster R-CNN algorithm by using a multilayer feature fusion technique. We have demonstrated another promising feature fusion technique of concatenating all the convolutional layers within a stage to extract image features. The modification boosts the overall detection performance of the model by utilizing the advantages of the shallow layers and the deep layers of the VGG-16 network. The training samples were augmented using random rotation and translation to enhance the heterogeneity of the detection algorithm. We have achieved a mean average precision (mAP) of 89.48% and 92.83% for the baseline faster R-CNN and our modified method, respectively.
url http://dx.doi.org/10.1155/2019/7174602
work_keys_str_mv AT junpinghu nearinfraredroadmarkingdetectionbasedonamodifiedfasterregionalconvolutionalneuralnetwork
AT shituabubakar nearinfraredroadmarkingdetectionbasedonamodifiedfasterregionalconvolutionalneuralnetwork
AT shengjunliu nearinfraredroadmarkingdetectionbasedonamodifiedfasterregionalconvolutionalneuralnetwork
AT xiaobiaodai nearinfraredroadmarkingdetectionbasedonamodifiedfasterregionalconvolutionalneuralnetwork
AT genyang nearinfraredroadmarkingdetectionbasedonamodifiedfasterregionalconvolutionalneuralnetwork
AT haosha nearinfraredroadmarkingdetectionbasedonamodifiedfasterregionalconvolutionalneuralnetwork
_version_ 1724872133134254080