3-D Object Model Reconstruction and Immersive Interaction using Kinect Sensor

• Main Authors: Chan, Iok-Long, 陳旭龍
• Other Authors: Chen, Yong-Sheng
• Format: Others
• Language: en_US
• Published: 2012
• Online Access: http://ndltd.ncl.edu.tw/handle/09913402355972518564

碩士 === 國立交通大學 === 資訊科學與工程研究所 === 101 === In this study we developed a 3-D object reconstruction and immersive interaction system using Microsoft Kinect sensor. This system can construct a three-dimensional model of the object, and provide users with vivid visualization experience. The advantages of Microsoft Kinect sensor are their low prices and high accuracy. The system contains three parts. The first part is foreground segmentation and point clouds registration. The second part is model reconstruction of three-dimensional objects. The third one is immersive human-computer interaction system. Background subtraction algorithm is used to segment the foreground object from background scene. We proposed a the modified iterative closest point algorithm to estimate the transformation between adjacent point clouds. Color similarity of corresponding points is considered in this algorithm. Data integration and color correction are applied for maintaining point cloud density and removing of the color difference between corresponding point clouds. Then we apply Poisson surface reconstruction algorithm to reconstruct 3-D surface model. Furthermore, we estimate the off-axis perspective projection matrix from the user position captured by Kinect sensor. A simple gesture is used to rotate object model. In this work, we have developed a 3-D object reconstruction and immersive interaction system which can reconstruct a three-dimensional object model with immersive interaction experience. According to our experimental results, the modified iterative closest point algorithm is more reliable and accurate than the original iterative closest point algorithm.