Study on Application of Kinect Technology to Guide Blindness

• Main Authors: Chen,Jiang-Ming, 陳江銘
• Other Authors: Chen,Wei-Ming
• Format: Others
• Language: zh-TW
• Published: 2019
• Online Access: http://ndltd.ncl.edu.tw/handle/3v9d3j

碩士 === 國立宜蘭大學 === 多媒體網路通訊數位學習碩士在職專班 === 107 === With the development of science and technology, people’s life and work have also changed. It is no longer like the lifestyle of the past in the agricultural society. The eye is one of the important senses of human beings, and it has the title of the window to the soul. In the process of dealing with cognitive messages, about 80% of the information is received by human eye, so if the vision is damaged or lost, people with disabilities will have great inconvenience in their actions. In view of the inconvenience of movement in daily life of visually impaired people, there are traditional guide canes, guide dogs, or hardware devices such as tactile floor tiles outdoors, but guide dogs are not suitable for many indoor places. Therefore, this study will propose an electronic assistant system suitable for indoor guiding. Electronic guiding requires a fast three-dimensional space detection capability, and Microsoft’s Kinect is equipped with infrared sensor capable of tracking human skeleton quickly and scanning image deep, and it has color cameras and voice microphones. Consequently, this study uses Kinect to determine the range and location of obstacles based on the grayscale value of the image and the distance between the detected objects, and provide a warning voice in conjunction with the voice system, such as reminding the visually impaired people that there are obstacles in the road ahead and detouring is recommended, and the warning will continue until they avoid obstacles. Take advantage of fast calculation of integral matrix to determine whether the position of the obstacle is within the preset warning range, and timely issuing a voice warning and suggestion, so that the visually impaired people can know the situation ahead and deal with it accordingly. Considering that Kinect needs to use power equipment, the system is built on a cart, equipped with a portable charger that can provide utility power, and a microcomputer is used to process the program to save power. In the future, upgrading to a portable version can be achieved by reducing the size and weight of each device. Additionally, in order to overcome the interference of the infrared camera by the sunlight, the color lens can be used to assist in identifying obstacles, or the ultrasonic sensor can be added to improve the error situation detected by the infrared camera to enhance the function of the electronic guiding system.