Implementation Motion Recognition and Imitate in Humanoid Robot Based on KINECT Sensor

碩士 === 中華科技大學 === 電子工程研究所碩士班 === 101 === Before KINECT was on the market, the tools of playing video games were joysticks, keyboards, and mice. In 2006, Nintendo released its home video game console, Wii---a revolutionary product at that time. It was the latest way to use Wii Remote to operate games...

Full description

Bibliographic Details
Main Authors: Lai,Jyong-Yu, 賴炯宇
Other Authors: Pu-Sheng Tsai
Format: Others
Language:zh-TW
Published: 2013
Online Access:http://ndltd.ncl.edu.tw/handle/60971127881083316961
Description
Summary:碩士 === 中華科技大學 === 電子工程研究所碩士班 === 101 === Before KINECT was on the market, the tools of playing video games were joysticks, keyboards, and mice. In 2006, Nintendo released its home video game console, Wii---a revolutionary product at that time. It was the latest way to use Wii Remote to operate games. As the peripheral of XBOX360, KINECT, a brand-new product unfolded by Microsoft in 2010 at E3 Toy Exhibition, could control games by body movements or voice orders. The key feature of KINECT was to let the controllers to play the games freely in the space of the house. This changed the image that people could only play video games by keyboards, mice, and joysticks at their tables. The motion-based games were designed mostly and related to sports as their main selling points. The players could play the games in the broad living room by their body actions. For example, the boxing PK match could make you sweat a lot in fifteen minutes to achieve the sports effects completely. The marathon competition could give you the same effect just like running on the treadmill. The main concept of this essay was to conform the KINECT sensor, the personal computer image interface, the wireless blue tooth transition mode and ROBO-BUILDER human robot to set KINECT core system, which can identify and imitate. The human robot body joints were driven by 17 AI motors. The hand joints and the foot ones were formed by 16 AI motors. Moreover, another AI motor could steer the actions of the head. The back control panel was ATMega128 manipulating all the AI motors’ angles and positions to let the robot make different kinds of movements. Developed by Microsoft, the KINECT sensor could catch the user’s body movements or carry on the face identification. The microphone was built in to recognize voice orders so that the players can have the whole new experience to manipulate the games by voice orders without joysticks and keyboards. The computer system used Visual C# as GUI interface platform. When the KINECT sensor detects players’ body movements, the KINECT function data will proceed the images to recognize the movements by action procession calculations. The wireless blue tooth transition mode will transit the control orders to the back panel of the robot to drive AI motors to realize the goal of human robots imitations.