Investigating the Performance of Gesture-Based Input for Mid-Air Text Entry in a Virtual Environment: A Comparison of Hand-Up versus Hand-Down Postures

Although the interaction technology for virtual reality (VR) systems has evolved significantly over the past years, the text input efficiency in the virtual environment is still an ongoing problem. We deployed a word-gesture text entry technology based on gesture recognition in the virtual environme...

詳細記述

書誌詳細
出版年:Sensors
主要な著者: Yahui Wang, Yueyang Wang, Jingzhou Chen, Yincheng Wang, Jie Yang, Ting Jiang, Jibo He
フォーマット: 論文
言語:英語
出版事項: MDPI AG 2021-02-01
主題:
オンライン・アクセス:https://www.mdpi.com/1424-8220/21/5/1582
_version_ 1852668086568615936
author Yahui Wang
Yueyang Wang
Jingzhou Chen
Yincheng Wang
Jie Yang
Ting Jiang
Jibo He
author_facet Yahui Wang
Yueyang Wang
Jingzhou Chen
Yincheng Wang
Jie Yang
Ting Jiang
Jibo He
author_sort Yahui Wang
collection DOAJ
container_title Sensors
description Although the interaction technology for virtual reality (VR) systems has evolved significantly over the past years, the text input efficiency in the virtual environment is still an ongoing problem. We deployed a word-gesture text entry technology based on gesture recognition in the virtual environment. This study aimed to investigate the performance of the word-gesture text entry technology with different input postures and VR experiences in the virtual environment. The study revealed that the VR experience (how long or how often using VR) had little effect on input performance. The hand-up posture has a better input performance when using word-gesture text entry technology in a virtual environment. In addition, the study found that the perceived exertion to complete the text input with word-gesture text entry technology was relatively high. Furthermore, the typing accuracy and perceived usability for using the hand-up posture were obviously higher than that for the hand-down posture. The hand-up posture also had less task workload than the hand-down posture. This paper supports that the word-gesture text entry technology with hand-up posture has greater application potential than hand-down posture.
format Article
id doaj-art-e51c6090decd428b9f89df2ab8b7cd1d
institution Directory of Open Access Journals
issn 1424-8220
language English
publishDate 2021-02-01
publisher MDPI AG
record_format Article
spelling doaj-art-e51c6090decd428b9f89df2ab8b7cd1d2025-08-19T21:34:26ZengMDPI AGSensors1424-82202021-02-01215158210.3390/s21051582Investigating the Performance of Gesture-Based Input for Mid-Air Text Entry in a Virtual Environment: A Comparison of Hand-Up versus Hand-Down PosturesYahui Wang0Yueyang Wang1Jingzhou Chen2Yincheng Wang3Jie Yang4Ting Jiang5Jibo He6Department of Psychology, Tsinghua University, Beijing 100084, ChinaFaculty of Psychology, Beijing Normal University, Beijing 100875, ChinaDepartment of Psychology, Tsinghua University, Beijing 100084, ChinaDepartment of Psychology, Tsinghua University, Beijing 100084, ChinaDepartment of Psychology, Tsinghua University, Beijing 100084, ChinaFaculty of Psychology, Beijing Normal University, Beijing 100875, ChinaSchool of Psychology, Northwest Normal University, Lanzhou 730070, ChinaAlthough the interaction technology for virtual reality (VR) systems has evolved significantly over the past years, the text input efficiency in the virtual environment is still an ongoing problem. We deployed a word-gesture text entry technology based on gesture recognition in the virtual environment. This study aimed to investigate the performance of the word-gesture text entry technology with different input postures and VR experiences in the virtual environment. The study revealed that the VR experience (how long or how often using VR) had little effect on input performance. The hand-up posture has a better input performance when using word-gesture text entry technology in a virtual environment. In addition, the study found that the perceived exertion to complete the text input with word-gesture text entry technology was relatively high. Furthermore, the typing accuracy and perceived usability for using the hand-up posture were obviously higher than that for the hand-down posture. The hand-up posture also had less task workload than the hand-down posture. This paper supports that the word-gesture text entry technology with hand-up posture has greater application potential than hand-down posture.https://www.mdpi.com/1424-8220/21/5/1582word-gesture text entry technologygesture recognitionvirtual realitytyping performancesubjective experiencetask workload
spellingShingle Yahui Wang
Yueyang Wang
Jingzhou Chen
Yincheng Wang
Jie Yang
Ting Jiang
Jibo He
Investigating the Performance of Gesture-Based Input for Mid-Air Text Entry in a Virtual Environment: A Comparison of Hand-Up versus Hand-Down Postures
word-gesture text entry technology
gesture recognition
virtual reality
typing performance
subjective experience
task workload
title Investigating the Performance of Gesture-Based Input for Mid-Air Text Entry in a Virtual Environment: A Comparison of Hand-Up versus Hand-Down Postures
title_full Investigating the Performance of Gesture-Based Input for Mid-Air Text Entry in a Virtual Environment: A Comparison of Hand-Up versus Hand-Down Postures
title_fullStr Investigating the Performance of Gesture-Based Input for Mid-Air Text Entry in a Virtual Environment: A Comparison of Hand-Up versus Hand-Down Postures
title_full_unstemmed Investigating the Performance of Gesture-Based Input for Mid-Air Text Entry in a Virtual Environment: A Comparison of Hand-Up versus Hand-Down Postures
title_short Investigating the Performance of Gesture-Based Input for Mid-Air Text Entry in a Virtual Environment: A Comparison of Hand-Up versus Hand-Down Postures
title_sort investigating the performance of gesture based input for mid air text entry in a virtual environment a comparison of hand up versus hand down postures
topic word-gesture text entry technology
gesture recognition
virtual reality
typing performance
subjective experience
task workload
url https://www.mdpi.com/1424-8220/21/5/1582
work_keys_str_mv AT yahuiwang investigatingtheperformanceofgesturebasedinputformidairtextentryinavirtualenvironmentacomparisonofhandupversushanddownpostures
AT yueyangwang investigatingtheperformanceofgesturebasedinputformidairtextentryinavirtualenvironmentacomparisonofhandupversushanddownpostures
AT jingzhouchen investigatingtheperformanceofgesturebasedinputformidairtextentryinavirtualenvironmentacomparisonofhandupversushanddownpostures
AT yinchengwang investigatingtheperformanceofgesturebasedinputformidairtextentryinavirtualenvironmentacomparisonofhandupversushanddownpostures
AT jieyang investigatingtheperformanceofgesturebasedinputformidairtextentryinavirtualenvironmentacomparisonofhandupversushanddownpostures
AT tingjiang investigatingtheperformanceofgesturebasedinputformidairtextentryinavirtualenvironmentacomparisonofhandupversushanddownpostures
AT jibohe investigatingtheperformanceofgesturebasedinputformidairtextentryinavirtualenvironmentacomparisonofhandupversushanddownpostures