Design and Application of Augmented Reality and Motion Sensing System

碩士 === 國立高雄科技大學 === 資訊管理系 === 107 === This thesis will develop a combination of person keypoint detection and augmented reality, combining virtual object with the real world. Using the OpenPose method, the keypoints of the characters can be detected in real time through the webcam to compensate...

Full description

Bibliographic Details
Main Authors: YAO, SHENG-YI, 姚勝翊
Other Authors: HOU, YI-YOU
Format: Others
Language:zh-TW
Published: 2019
Online Access:http://ndltd.ncl.edu.tw/handle/mwmx7j
Description
Summary:碩士 === 國立高雄科技大學 === 資訊管理系 === 107 === This thesis will develop a combination of person keypoint detection and augmented reality, combining virtual object with the real world. Using the OpenPose method, the keypoints of the characters can be detected in real time through the webcam to compensate for the difference in user experience in the virtual and real world, so that the user experience is more abundant on the system. The system completed in this thesis is applied to the costume wearing scene using keypoints to detect the coordinates of the shoulder, elbow, neck, and other parts of the user in real time. Integrating the augmented reality to display the three-dimensional model of the costume to the user. Real-time change of clothes size, rotate clothes, control clothes deformation, and change color. Increase the authenticity of the virtual fitting. Simulation of what it looks like, and reduce the drop between reality and virtual clothing. In the system combines self-made hardware device. Control the microcontroller through the serial communication port, and write instructions to run the stepper motor. After the user select the clothes, and use the concept of vending machines to transport clothes from the freight lane. Provide users with more convenient and technical services. Finally, use the Questionnaire for User Interface Satisfaction (QUIS) as the reference basis for the questionnaire items. Thirty subjects filled out the questionnaire after experiencing the system. And using the Importance-Performance Analysis (IPA) to analyze questionnaire items, it can understand the user satisfaction and future direction of improvement.