A Novel Method for Estimating Free Space 3D Point-of-Regard Using Pupillary Reflex and Line-of-Sight Convergence Points
In this paper, a novel 3D gaze estimation method for a wearable gaze tracking device is proposed. This method is based on the pupillary accommodation reflex of human vision. Firstly, a 3D gaze measurement model is built. By uniting the line-of-sight convergence point and the size of the pupil, this...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2018-07-01
|
Series: | Sensors |
Subjects: | |
Online Access: | http://www.mdpi.com/1424-8220/18/7/2292 |
id |
doaj-aeaf51a9b2194def82d0f95a6548fc1d |
---|---|
record_format |
Article |
spelling |
doaj-aeaf51a9b2194def82d0f95a6548fc1d2020-11-24T22:59:02ZengMDPI AGSensors1424-82202018-07-01187229210.3390/s18072292s18072292A Novel Method for Estimating Free Space 3D Point-of-Regard Using Pupillary Reflex and Line-of-Sight Convergence PointsZijing Wan0Xiangjun Wang1Kai Zhou2Xiaoyun Chen3Xiaoqing Wang4State Key Laboratory of Precision Measurement Technology and Instruments, Tianjin University, No. 92 Weijin Road, Nankai District, Tianjin 300072, ChinaState Key Laboratory of Precision Measurement Technology and Instruments, Tianjin University, No. 92 Weijin Road, Nankai District, Tianjin 300072, ChinaState Key Laboratory of Precision Measurement Technology and Instruments, Tianjin University, No. 92 Weijin Road, Nankai District, Tianjin 300072, ChinaMOEMS Education Ministry Key Laboratory, Tianjin University, No. 92 Weijin Road, Nankai District, Tianjin 300072, ChinaMOEMS Education Ministry Key Laboratory, Tianjin University, No. 92 Weijin Road, Nankai District, Tianjin 300072, ChinaIn this paper, a novel 3D gaze estimation method for a wearable gaze tracking device is proposed. This method is based on the pupillary accommodation reflex of human vision. Firstly, a 3D gaze measurement model is built. By uniting the line-of-sight convergence point and the size of the pupil, this model can be used to measure the 3D Point-of-Regard in free space. Secondly, a gaze tracking device is described. By using four cameras and semi-transparent mirrors, the gaze tracking device can accurately extract the spatial coordinates of the pupil and eye corner of the human eye from images. Thirdly, a simple calibration process of the measuring system is proposed. This method can be sketched as follows: (1) each eye is imaged by a pair of binocular stereo cameras, and the setting of semi-transparent mirrors can support a better field of view; (2) the spatial coordinates of the pupil center and the inner corner of the eye in the images of the stereo cameras are extracted, and the pupil size is calculated with the features of the gaze estimation method; (3) the pupil size and the line-of-sight convergence point when watching the calibration target at different distances are computed, and the parameters of the gaze estimation model are determined. Fourthly, an algorithm for searching the line-of-sight convergence point is proposed, and the 3D Point-of-Regard is estimated by using the obtained line-of-sight measurement model. Three groups of experiments were conducted to prove the effectiveness of the proposed method. This approach enables people to obtain the spatial coordinates of the Point-of-Regard in free space, which has great potential in the application of wearable devices.http://www.mdpi.com/1424-8220/18/7/2292eye tracking3D Point-of-Regardpupillary reflexhead-mounted device |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Zijing Wan Xiangjun Wang Kai Zhou Xiaoyun Chen Xiaoqing Wang |
spellingShingle |
Zijing Wan Xiangjun Wang Kai Zhou Xiaoyun Chen Xiaoqing Wang A Novel Method for Estimating Free Space 3D Point-of-Regard Using Pupillary Reflex and Line-of-Sight Convergence Points Sensors eye tracking 3D Point-of-Regard pupillary reflex head-mounted device |
author_facet |
Zijing Wan Xiangjun Wang Kai Zhou Xiaoyun Chen Xiaoqing Wang |
author_sort |
Zijing Wan |
title |
A Novel Method for Estimating Free Space 3D Point-of-Regard Using Pupillary Reflex and Line-of-Sight Convergence Points |
title_short |
A Novel Method for Estimating Free Space 3D Point-of-Regard Using Pupillary Reflex and Line-of-Sight Convergence Points |
title_full |
A Novel Method for Estimating Free Space 3D Point-of-Regard Using Pupillary Reflex and Line-of-Sight Convergence Points |
title_fullStr |
A Novel Method for Estimating Free Space 3D Point-of-Regard Using Pupillary Reflex and Line-of-Sight Convergence Points |
title_full_unstemmed |
A Novel Method for Estimating Free Space 3D Point-of-Regard Using Pupillary Reflex and Line-of-Sight Convergence Points |
title_sort |
novel method for estimating free space 3d point-of-regard using pupillary reflex and line-of-sight convergence points |
publisher |
MDPI AG |
series |
Sensors |
issn |
1424-8220 |
publishDate |
2018-07-01 |
description |
In this paper, a novel 3D gaze estimation method for a wearable gaze tracking device is proposed. This method is based on the pupillary accommodation reflex of human vision. Firstly, a 3D gaze measurement model is built. By uniting the line-of-sight convergence point and the size of the pupil, this model can be used to measure the 3D Point-of-Regard in free space. Secondly, a gaze tracking device is described. By using four cameras and semi-transparent mirrors, the gaze tracking device can accurately extract the spatial coordinates of the pupil and eye corner of the human eye from images. Thirdly, a simple calibration process of the measuring system is proposed. This method can be sketched as follows: (1) each eye is imaged by a pair of binocular stereo cameras, and the setting of semi-transparent mirrors can support a better field of view; (2) the spatial coordinates of the pupil center and the inner corner of the eye in the images of the stereo cameras are extracted, and the pupil size is calculated with the features of the gaze estimation method; (3) the pupil size and the line-of-sight convergence point when watching the calibration target at different distances are computed, and the parameters of the gaze estimation model are determined. Fourthly, an algorithm for searching the line-of-sight convergence point is proposed, and the 3D Point-of-Regard is estimated by using the obtained line-of-sight measurement model. Three groups of experiments were conducted to prove the effectiveness of the proposed method. This approach enables people to obtain the spatial coordinates of the Point-of-Regard in free space, which has great potential in the application of wearable devices. |
topic |
eye tracking 3D Point-of-Regard pupillary reflex head-mounted device |
url |
http://www.mdpi.com/1424-8220/18/7/2292 |
work_keys_str_mv |
AT zijingwan anovelmethodforestimatingfreespace3dpointofregardusingpupillaryreflexandlineofsightconvergencepoints AT xiangjunwang anovelmethodforestimatingfreespace3dpointofregardusingpupillaryreflexandlineofsightconvergencepoints AT kaizhou anovelmethodforestimatingfreespace3dpointofregardusingpupillaryreflexandlineofsightconvergencepoints AT xiaoyunchen anovelmethodforestimatingfreespace3dpointofregardusingpupillaryreflexandlineofsightconvergencepoints AT xiaoqingwang anovelmethodforestimatingfreespace3dpointofregardusingpupillaryreflexandlineofsightconvergencepoints AT zijingwan novelmethodforestimatingfreespace3dpointofregardusingpupillaryreflexandlineofsightconvergencepoints AT xiangjunwang novelmethodforestimatingfreespace3dpointofregardusingpupillaryreflexandlineofsightconvergencepoints AT kaizhou novelmethodforestimatingfreespace3dpointofregardusingpupillaryreflexandlineofsightconvergencepoints AT xiaoyunchen novelmethodforestimatingfreespace3dpointofregardusingpupillaryreflexandlineofsightconvergencepoints AT xiaoqingwang novelmethodforestimatingfreespace3dpointofregardusingpupillaryreflexandlineofsightconvergencepoints |
_version_ |
1725645822649958400 |