ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays
Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is...
| 出版年: | Sensors |
|---|---|
| 主要な著者: | , , , , |
| フォーマット: | 論文 |
| 言語: | 英語 |
| 出版事項: |
MDPI AG
2021-03-01
|
| 主題: | |
| オンライン・アクセス: | https://www.mdpi.com/1424-8220/21/6/2234 |
| _version_ | 1850317774116618240 |
|---|---|
| author | Sebastian Kapp Michael Barz Sergey Mukhametov Daniel Sonntag Jochen Kuhn |
| author_facet | Sebastian Kapp Michael Barz Sergey Mukhametov Daniel Sonntag Jochen Kuhn |
| author_sort | Sebastian Kapp |
| collection | DOAJ |
| container_title | Sensors |
| description | Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is interesting for applied research based on eye tracking in cognitive or educational sciences for example. While some research toolkits for VR already exist, only a few target AR scenarios. In this work, we present an open-source eye tracking toolkit for reliable gaze data acquisition in AR based on Unity 3D and the Microsoft HoloLens 2, as well as an R package for seamless data analysis. Furthermore, we evaluate the spatial accuracy and precision of the integrated eye tracker for fixation targets with different distances and angles to the user (<inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mi>n</mi><mo>=</mo><mn>21</mn></mrow></semantics></math></inline-formula>). On average, we found that gaze estimates are reported with an angular accuracy of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mn>0.83</mn></mrow></semantics></math></inline-formula> degrees and a precision of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mn>0.27</mn></mrow></semantics></math></inline-formula> degrees while the user is resting, which is on par with state-of-the-art mobile eye trackers. |
| format | Article |
| id | doaj-art-e2986a48aa7d45708aa922f0b5c6c9fc |
| institution | Directory of Open Access Journals |
| issn | 1424-8220 |
| language | English |
| publishDate | 2021-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| spelling | doaj-art-e2986a48aa7d45708aa922f0b5c6c9fc2025-08-19T23:23:51ZengMDPI AGSensors1424-82202021-03-01216223410.3390/s21062234ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted DisplaysSebastian Kapp0Michael Barz1Sergey Mukhametov2Daniel Sonntag3Jochen Kuhn4Department of Physics, Technische Universität Kaiserslautern, Erwin-Schrödinger-Str. 46, 67663 Kaiserslautern, GermanyGerman Research Center for Artificial Intelligence (DFKI), Interactive Machine Learning Department, Stuhlsatzenhausweg 3, Saarland Informatics Campus D3_2, 66123 Saarbrücken, GermanyDepartment of Physics, Technische Universität Kaiserslautern, Erwin-Schrödinger-Str. 46, 67663 Kaiserslautern, GermanyGerman Research Center for Artificial Intelligence (DFKI), Interactive Machine Learning Department, Stuhlsatzenhausweg 3, Saarland Informatics Campus D3_2, 66123 Saarbrücken, GermanyDepartment of Physics, Technische Universität Kaiserslautern, Erwin-Schrödinger-Str. 46, 67663 Kaiserslautern, GermanyCurrently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is interesting for applied research based on eye tracking in cognitive or educational sciences for example. While some research toolkits for VR already exist, only a few target AR scenarios. In this work, we present an open-source eye tracking toolkit for reliable gaze data acquisition in AR based on Unity 3D and the Microsoft HoloLens 2, as well as an R package for seamless data analysis. Furthermore, we evaluate the spatial accuracy and precision of the integrated eye tracker for fixation targets with different distances and angles to the user (<inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mi>n</mi><mo>=</mo><mn>21</mn></mrow></semantics></math></inline-formula>). On average, we found that gaze estimates are reported with an angular accuracy of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mn>0.83</mn></mrow></semantics></math></inline-formula> degrees and a precision of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mn>0.27</mn></mrow></semantics></math></inline-formula> degrees while the user is resting, which is on par with state-of-the-art mobile eye trackers.https://www.mdpi.com/1424-8220/21/6/2234augmented realityeye trackingtoolkitaccuracyprecision |
| spellingShingle | Sebastian Kapp Michael Barz Sergey Mukhametov Daniel Sonntag Jochen Kuhn ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays augmented reality eye tracking toolkit accuracy precision |
| title | ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays |
| title_full | ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays |
| title_fullStr | ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays |
| title_full_unstemmed | ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays |
| title_short | ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays |
| title_sort | arett augmented reality eye tracking toolkit for head mounted displays |
| topic | augmented reality eye tracking toolkit accuracy precision |
| url | https://www.mdpi.com/1424-8220/21/6/2234 |
| work_keys_str_mv | AT sebastiankapp arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays AT michaelbarz arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays AT sergeymukhametov arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays AT danielsonntag arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays AT jochenkuhn arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays |
