Development of a Hybrid Haptic Feedback Virtual Assembly System with Natural User Interface

• Main Authors: Fang-Yun Yang, 楊芳雲
• Other Authors: Shana Smith
• Format: Others
• Language: zh-TW
• Published: 2015
• Online Access: http://ndltd.ncl.edu.tw/handle/84990486986645409965

碩士 === 國立臺灣大學 === 機械工程學研究所 === 103 === Applications of assembly in virtual reality are increasingly discussed and implemented in recent years. Compared to real world assembly, users can complete necessary tasks in virtual reality with lowered cost, less potential hazards, and the ability of repeat manipulation. Thanks to the development of technologies, many human-computer interfaces with novel technologies have been born. Therefore, how to manage and combine these technologies into a virtual assembly system and also design it according to user’s daily habits, trying to achieve the design of natural user interface becoming a goal for this research. A virtual assembly system with realistic operating modes were proposed by us, which can provide users directly using their hands or using assembly tools to assemble, and it also equipped two different haptic feedbacks providing users with not only visual feedback but also haptic feedback. A pair of gloves developed by Chang(2015) were tracked by Leap Motion were served as users hands simulation providing users with vibrio-tactile feedback, and the PHANToM OmniR was used to provide kinesthetic force feedback to simulate assembly tools in VR. In order to provide users with a more realistic VR environment, Dual-handed manipulation was designed and 3D mouse was used for changing viewpoints. At the end, two case studies were designed. The result shows that users tend to use gloves to grab large objects, and use PHANToM OmniR to grab small objects. Considering of the task completion time, the hybrid mode, which combined gloves and PHANToM OmniR, was the most efficient mode. As a result, the virtual assembly system with hybrid mode developed by us was confirmed to be efficient and has natural user interface.