ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays

Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is...

詳細記述

書誌詳細
出版年:Sensors
主要な著者: Sebastian Kapp, Michael Barz, Sergey Mukhametov, Daniel Sonntag, Jochen Kuhn
フォーマット: 論文
言語:英語
出版事項: MDPI AG 2021-03-01
主題:
オンライン・アクセス:https://www.mdpi.com/1424-8220/21/6/2234
_version_ 1850317774116618240
author Sebastian Kapp
Michael Barz
Sergey Mukhametov
Daniel Sonntag
Jochen Kuhn
author_facet Sebastian Kapp
Michael Barz
Sergey Mukhametov
Daniel Sonntag
Jochen Kuhn
author_sort Sebastian Kapp
collection DOAJ
container_title Sensors
description Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is interesting for applied research based on eye tracking in cognitive or educational sciences for example. While some research toolkits for VR already exist, only a few target AR scenarios. In this work, we present an open-source eye tracking toolkit for reliable gaze data acquisition in AR based on Unity 3D and the Microsoft HoloLens 2, as well as an R package for seamless data analysis. Furthermore, we evaluate the spatial accuracy and precision of the integrated eye tracker for fixation targets with different distances and angles to the user (<inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mi>n</mi><mo>=</mo><mn>21</mn></mrow></semantics></math></inline-formula>). On average, we found that gaze estimates are reported with an angular accuracy of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mn>0.83</mn></mrow></semantics></math></inline-formula> degrees and a precision of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mn>0.27</mn></mrow></semantics></math></inline-formula> degrees while the user is resting, which is on par with state-of-the-art mobile eye trackers.
format Article
id doaj-art-e2986a48aa7d45708aa922f0b5c6c9fc
institution Directory of Open Access Journals
issn 1424-8220
language English
publishDate 2021-03-01
publisher MDPI AG
record_format Article
spelling doaj-art-e2986a48aa7d45708aa922f0b5c6c9fc2025-08-19T23:23:51ZengMDPI AGSensors1424-82202021-03-01216223410.3390/s21062234ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted DisplaysSebastian Kapp0Michael Barz1Sergey Mukhametov2Daniel Sonntag3Jochen Kuhn4Department of Physics, Technische Universität Kaiserslautern, Erwin-Schrödinger-Str. 46, 67663 Kaiserslautern, GermanyGerman Research Center for Artificial Intelligence (DFKI), Interactive Machine Learning Department, Stuhlsatzenhausweg 3, Saarland Informatics Campus D3_2, 66123 Saarbrücken, GermanyDepartment of Physics, Technische Universität Kaiserslautern, Erwin-Schrödinger-Str. 46, 67663 Kaiserslautern, GermanyGerman Research Center for Artificial Intelligence (DFKI), Interactive Machine Learning Department, Stuhlsatzenhausweg 3, Saarland Informatics Campus D3_2, 66123 Saarbrücken, GermanyDepartment of Physics, Technische Universität Kaiserslautern, Erwin-Schrödinger-Str. 46, 67663 Kaiserslautern, GermanyCurrently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is interesting for applied research based on eye tracking in cognitive or educational sciences for example. While some research toolkits for VR already exist, only a few target AR scenarios. In this work, we present an open-source eye tracking toolkit for reliable gaze data acquisition in AR based on Unity 3D and the Microsoft HoloLens 2, as well as an R package for seamless data analysis. Furthermore, we evaluate the spatial accuracy and precision of the integrated eye tracker for fixation targets with different distances and angles to the user (<inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mi>n</mi><mo>=</mo><mn>21</mn></mrow></semantics></math></inline-formula>). On average, we found that gaze estimates are reported with an angular accuracy of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mn>0.83</mn></mrow></semantics></math></inline-formula> degrees and a precision of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mn>0.27</mn></mrow></semantics></math></inline-formula> degrees while the user is resting, which is on par with state-of-the-art mobile eye trackers.https://www.mdpi.com/1424-8220/21/6/2234augmented realityeye trackingtoolkitaccuracyprecision
spellingShingle Sebastian Kapp
Michael Barz
Sergey Mukhametov
Daniel Sonntag
Jochen Kuhn
ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays
augmented reality
eye tracking
toolkit
accuracy
precision
title ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays
title_full ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays
title_fullStr ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays
title_full_unstemmed ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays
title_short ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays
title_sort arett augmented reality eye tracking toolkit for head mounted displays
topic augmented reality
eye tracking
toolkit
accuracy
precision
url https://www.mdpi.com/1424-8220/21/6/2234
work_keys_str_mv AT sebastiankapp arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays
AT michaelbarz arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays
AT sergeymukhametov arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays
AT danielsonntag arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays
AT jochenkuhn arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays