Investigation of Auxiliary Sensory Integration Training by using Augmented Reality

• Main Authors: Luo,Huai-Syuan, 羅懷軒
• Other Authors: Tsai Pu-Sheng
• Format: Others
• Language: zh-TW
• Published: 2014
• Online Access: http://ndltd.ncl.edu.tw/handle/90148203348035320020

碩士 === 中華科技大學 === 電子工程研究所碩士班 === 102 === The paper aims at expanding application of augmented reality, to assist physiotherapists in training children of sensory integration problem, where with sound-light effects of augmented reality, children attention can be attracted, and becomes interested, thus able to actively participate in activities, thereby physiotherapists workload can be reduced, and therapeutic effect enhanced. Sensory integration means children at infantile stage will transmit information to brain through various sensory organs, whereby explore and adapt to surrounding environment, and able to effectively use their limbs and body to generate interaction with environment. If sensory integration impairment occurred, then problems of cognition, language, perception, mood, and behavioral control etc. will be generated, hence unable to inter-response with external matters. In the case of augmented reality, it means to integrate computer generated virtual objects and real world scenario, so that the image of computer generated virtual objects blended in real-time living scenario.In the article, specific to sensory integration impaired children, three game software related to augmented reality are designed, where it includes current rush-rush rod, fruits link-link see, bubbles rub-rub fun, to assist physiotherapists in process of training sensory integration. With Webcam, images of real world players are filmed, whereby composite with virtual objects in the game through image composition technique, so that players have more feeling of personally on the scene.Then, with skin color detection algorithm to extract blocks of skin color in the image, and with fingertip detection algorithm to determine coordinates of fingertips in the image. Current rush-rush rod is to let children’s fingertip move according to virtual track in the game, once track range exceeded, sound-light effect like explosion will be triggered, to reach objectives of stimulating the senses.Fruits link-link see is to let children’s fingertip to click a fruit among five different fruits, and move the fruit to a relative position, to train abilities of determination and cognition. Bubble rub-rub fun is to let fingertip to click various bubbles in the game and rubs to broken, to train children’s eyes and hands coordination. The games designed in the article are mainly to train children’s brain, coordination of body sensory to external stimulations and reaction of proper response. By use of Webcam of a few hundred NT dollars in the market, matched up with augmented reality system software, thereby a new training solution can be provided for physiotherapists, providing game elements to enhance efficacy of sensory integration training.