An Investigation of Early Detection of Driver Drowsiness Using Ensemble Machine Learning Based on Hybrid Sensing

Drowsy driving is one of the main causes of traffic accidents. To reduce such accidents, early detection of drowsy driving is needed. In previous studies, it was shown that driver drowsiness affected driving performance, behavioral indices, and physiological indices. The purpose of this study is to...

Full description

Bibliographic Details
Main Authors: Jongseong Gwak, Akinari Hirao, Motoki Shino
Format: Article
Language:English
Published: MDPI AG 2020-04-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/10/8/2890
id doaj-331609f134cd424b9393d6daf105bd09
record_format Article
spelling doaj-331609f134cd424b9393d6daf105bd092020-11-25T02:24:43ZengMDPI AGApplied Sciences2076-34172020-04-01102890289010.3390/app10082890An Investigation of Early Detection of Driver Drowsiness Using Ensemble Machine Learning Based on Hybrid SensingJongseong Gwak0Akinari Hirao1Motoki Shino2Institute of Industrial Science, The University of Tokyo, Tokyo 153-8505, JapanNissan Motor, Co., Ltd., Kanagawa 243-0192, JapanDepartment of Human and Engineered Environment Studies, Graduate School of Frontier Sciences, The University of Tokyo, Chiba 277-8563, JapanDrowsy driving is one of the main causes of traffic accidents. To reduce such accidents, early detection of drowsy driving is needed. In previous studies, it was shown that driver drowsiness affected driving performance, behavioral indices, and physiological indices. The purpose of this study is to investigate the feasibility of classification of the alert states of drivers, particularly the slightly drowsy state, based on hybrid sensing of vehicle-based, behavioral, and physiological indicators with consideration for the implementation of these identifications into a detection system. First, we measured the drowsiness level, driving performance, physiological signals (from electroencephalogram and electrocardiogram results), and behavioral indices of a driver using a driving simulator and driver monitoring system. Next, driver alert and drowsy states were identified by machine learning algorithms, and a dataset was constructed from the extracted indices over a period of 10 s. Finally, ensemble algorithms were used for classification. The results showed that the ensemble algorithm can obtain 82.4% classification accuracy using hybrid methods to identify the alert and slightly drowsy states, and 95.4% accuracy classifying the alert and moderately drowsy states. Additionally, the results show that the random forest algorithm can obtain 78.7% accuracy when classifying the alert vs. slightly drowsy states if physiological indicators are excluded and can obtain 89.8% accuracy when classifying the alert vs. moderately drowsy states. These results represent the feasibility of highly accurate early detection of driver drowsiness and the feasibility of implementing a driver drowsiness detection system based on hybrid sensing using non-contact sensors.https://www.mdpi.com/2076-3417/10/8/2890driver drowsinesshybrid sensingmachine learningphysiological signal
collection DOAJ
language English
format Article
sources DOAJ
author Jongseong Gwak
Akinari Hirao
Motoki Shino
spellingShingle Jongseong Gwak
Akinari Hirao
Motoki Shino
An Investigation of Early Detection of Driver Drowsiness Using Ensemble Machine Learning Based on Hybrid Sensing
Applied Sciences
driver drowsiness
hybrid sensing
machine learning
physiological signal
author_facet Jongseong Gwak
Akinari Hirao
Motoki Shino
author_sort Jongseong Gwak
title An Investigation of Early Detection of Driver Drowsiness Using Ensemble Machine Learning Based on Hybrid Sensing
title_short An Investigation of Early Detection of Driver Drowsiness Using Ensemble Machine Learning Based on Hybrid Sensing
title_full An Investigation of Early Detection of Driver Drowsiness Using Ensemble Machine Learning Based on Hybrid Sensing
title_fullStr An Investigation of Early Detection of Driver Drowsiness Using Ensemble Machine Learning Based on Hybrid Sensing
title_full_unstemmed An Investigation of Early Detection of Driver Drowsiness Using Ensemble Machine Learning Based on Hybrid Sensing
title_sort investigation of early detection of driver drowsiness using ensemble machine learning based on hybrid sensing
publisher MDPI AG
series Applied Sciences
issn 2076-3417
publishDate 2020-04-01
description Drowsy driving is one of the main causes of traffic accidents. To reduce such accidents, early detection of drowsy driving is needed. In previous studies, it was shown that driver drowsiness affected driving performance, behavioral indices, and physiological indices. The purpose of this study is to investigate the feasibility of classification of the alert states of drivers, particularly the slightly drowsy state, based on hybrid sensing of vehicle-based, behavioral, and physiological indicators with consideration for the implementation of these identifications into a detection system. First, we measured the drowsiness level, driving performance, physiological signals (from electroencephalogram and electrocardiogram results), and behavioral indices of a driver using a driving simulator and driver monitoring system. Next, driver alert and drowsy states were identified by machine learning algorithms, and a dataset was constructed from the extracted indices over a period of 10 s. Finally, ensemble algorithms were used for classification. The results showed that the ensemble algorithm can obtain 82.4% classification accuracy using hybrid methods to identify the alert and slightly drowsy states, and 95.4% accuracy classifying the alert and moderately drowsy states. Additionally, the results show that the random forest algorithm can obtain 78.7% accuracy when classifying the alert vs. slightly drowsy states if physiological indicators are excluded and can obtain 89.8% accuracy when classifying the alert vs. moderately drowsy states. These results represent the feasibility of highly accurate early detection of driver drowsiness and the feasibility of implementing a driver drowsiness detection system based on hybrid sensing using non-contact sensors.
topic driver drowsiness
hybrid sensing
machine learning
physiological signal
url https://www.mdpi.com/2076-3417/10/8/2890
work_keys_str_mv AT jongseonggwak aninvestigationofearlydetectionofdriverdrowsinessusingensemblemachinelearningbasedonhybridsensing
AT akinarihirao aninvestigationofearlydetectionofdriverdrowsinessusingensemblemachinelearningbasedonhybridsensing
AT motokishino aninvestigationofearlydetectionofdriverdrowsinessusingensemblemachinelearningbasedonhybridsensing
AT jongseonggwak investigationofearlydetectionofdriverdrowsinessusingensemblemachinelearningbasedonhybridsensing
AT akinarihirao investigationofearlydetectionofdriverdrowsinessusingensemblemachinelearningbasedonhybridsensing
AT motokishino investigationofearlydetectionofdriverdrowsinessusingensemblemachinelearningbasedonhybridsensing
_version_ 1724853782737584128