Estimation of Driver Drowsiness Using Blood Perfusion Analysis of Facial Thermal Images in a Driving Simulator

Background and Objective: Driver drowsiness is a major cause of fatal driving accidents worldwide, which can be prevented by an early detection. Driver drowsiness results in reduction of blood flow and change in facial thermal patterns. In this paper, a drowsiness detection system was designed to e...

Full description

Bibliographic Details
Main Authors: Masoumeh Tashakori, Ali Nahvi, Azadeh Shahiidian, Serajeddin Ebrahimian Hadi Kiashari, Hamidreza Bakhoda
Format: Article
Language:English
Published: Tehran University of Medical Sciences 2019-06-01
Series:Journal of Sleep Sciences
Subjects:
Online Access:https://jss.tums.ac.ir/index.php/jss/article/view/122
id doaj-d597fcdd32ef47a6bdb541679a66f09c
record_format Article
spelling doaj-d597fcdd32ef47a6bdb541679a66f09c2020-12-02T05:38:56ZengTehran University of Medical SciencesJournal of Sleep Sciences2476-29382476-29462019-06-0133-4Estimation of Driver Drowsiness Using Blood Perfusion Analysis of Facial Thermal Images in a Driving SimulatorMasoumeh Tashakori0Ali Nahvi1Azadeh Shahiidian2Serajeddin Ebrahimian Hadi Kiashari3Hamidreza Bakhoda4Department of Mechanical Engineering, School of Mechanical Engineering,Khajeh Nasir Toosi University of Technology, Tehran, IranDepartment of Mechanical Engineering, School of Mechanical Engineering, Khajeh Nasir Toosi University of Technology, Tehran, IranDepartment of Mechanical Engineering, School of Mechanical Engineering, Khajeh Nasir Toosi University of Technology, Tehran, IranDepartment of Mechanical Engineering, School of Mechanical Engineering,Khajeh Nasir Toosi University of Technology, Tehran, IranDepartment of Mechanical Engineering, School of Mechanical Engineering, Khajeh Nasir Toosi University of Technology, Tehran, Iran Background and Objective: Driver drowsiness is a major cause of fatal driving accidents worldwide, which can be prevented by an early detection. Driver drowsiness results in reduction of blood flow and change in facial thermal patterns. In this paper, a drowsiness detection system was designed to estimate the level of drowsiness by analyzing facial skin temperature patterns. Materials and Methods: 12 subjects drove on a highway in a driving simulator, while their facial temperature image was captured by a thermal camera. The subjects’ drowsiness levels were independently estimated by the observer rating of drowsiness (ORD) method. Facial blood vessels were located by a four-step algorithm and tracked in each frame. The mean value of the pixel intensities of the facial blood regions formed a sequence of data. Variations of facial skin temperature signals were investigated for three main blood vessels. Results: Facial skin temperature decreased at three levels of sleepiness from wakefulness to extreme drowsiness. Temperature near the supratrochlear, angular, and facial arteries decreased by 0.54 ºC, 0.33 ºC, and 0.32 ºC from wakefulness to extreme drowsiness, respectively. All subjects except one experienced skin temperature decrease from wakefulness to extreme drowsiness. Conclusion: It was shown that the drivers’ facial blood vessels temperature decreased as the level of drowsiness increased. Driver drowsiness can be detected by monitoring the change in the facial skin temperature signal during driving. Facial thermal imaging is a promising non-intrusive method to detect driver drowsiness. https://jss.tums.ac.ir/index.php/jss/article/view/122SleepSkin temperatureThermographyDriving simulator
collection DOAJ
language English
format Article
sources DOAJ
author Masoumeh Tashakori
Ali Nahvi
Azadeh Shahiidian
Serajeddin Ebrahimian Hadi Kiashari
Hamidreza Bakhoda
spellingShingle Masoumeh Tashakori
Ali Nahvi
Azadeh Shahiidian
Serajeddin Ebrahimian Hadi Kiashari
Hamidreza Bakhoda
Estimation of Driver Drowsiness Using Blood Perfusion Analysis of Facial Thermal Images in a Driving Simulator
Journal of Sleep Sciences
Sleep
Skin temperature
Thermography
Driving simulator
author_facet Masoumeh Tashakori
Ali Nahvi
Azadeh Shahiidian
Serajeddin Ebrahimian Hadi Kiashari
Hamidreza Bakhoda
author_sort Masoumeh Tashakori
title Estimation of Driver Drowsiness Using Blood Perfusion Analysis of Facial Thermal Images in a Driving Simulator
title_short Estimation of Driver Drowsiness Using Blood Perfusion Analysis of Facial Thermal Images in a Driving Simulator
title_full Estimation of Driver Drowsiness Using Blood Perfusion Analysis of Facial Thermal Images in a Driving Simulator
title_fullStr Estimation of Driver Drowsiness Using Blood Perfusion Analysis of Facial Thermal Images in a Driving Simulator
title_full_unstemmed Estimation of Driver Drowsiness Using Blood Perfusion Analysis of Facial Thermal Images in a Driving Simulator
title_sort estimation of driver drowsiness using blood perfusion analysis of facial thermal images in a driving simulator
publisher Tehran University of Medical Sciences
series Journal of Sleep Sciences
issn 2476-2938
2476-2946
publishDate 2019-06-01
description Background and Objective: Driver drowsiness is a major cause of fatal driving accidents worldwide, which can be prevented by an early detection. Driver drowsiness results in reduction of blood flow and change in facial thermal patterns. In this paper, a drowsiness detection system was designed to estimate the level of drowsiness by analyzing facial skin temperature patterns. Materials and Methods: 12 subjects drove on a highway in a driving simulator, while their facial temperature image was captured by a thermal camera. The subjects’ drowsiness levels were independently estimated by the observer rating of drowsiness (ORD) method. Facial blood vessels were located by a four-step algorithm and tracked in each frame. The mean value of the pixel intensities of the facial blood regions formed a sequence of data. Variations of facial skin temperature signals were investigated for three main blood vessels. Results: Facial skin temperature decreased at three levels of sleepiness from wakefulness to extreme drowsiness. Temperature near the supratrochlear, angular, and facial arteries decreased by 0.54 ºC, 0.33 ºC, and 0.32 ºC from wakefulness to extreme drowsiness, respectively. All subjects except one experienced skin temperature decrease from wakefulness to extreme drowsiness. Conclusion: It was shown that the drivers’ facial blood vessels temperature decreased as the level of drowsiness increased. Driver drowsiness can be detected by monitoring the change in the facial skin temperature signal during driving. Facial thermal imaging is a promising non-intrusive method to detect driver drowsiness.
topic Sleep
Skin temperature
Thermography
Driving simulator
url https://jss.tums.ac.ir/index.php/jss/article/view/122
work_keys_str_mv AT masoumehtashakori estimationofdriverdrowsinessusingbloodperfusionanalysisoffacialthermalimagesinadrivingsimulator
AT alinahvi estimationofdriverdrowsinessusingbloodperfusionanalysisoffacialthermalimagesinadrivingsimulator
AT azadehshahiidian estimationofdriverdrowsinessusingbloodperfusionanalysisoffacialthermalimagesinadrivingsimulator
AT serajeddinebrahimianhadikiashari estimationofdriverdrowsinessusingbloodperfusionanalysisoffacialthermalimagesinadrivingsimulator
AT hamidrezabakhoda estimationofdriverdrowsinessusingbloodperfusionanalysisoffacialthermalimagesinadrivingsimulator
_version_ 1724409183873269760