MULTIVIEW SYNTHESIS FROM MONOCULAR IMAGE SEQUENCES

• Main Authors: Yi-Wei Liu, 劉毅維
• Other Authors: Jia-Ching Cheng
• Format: Others
• Language: zh-TW
• Published: 2010
• Online Access: http://ndltd.ncl.edu.tw/handle/70572810534378989890

碩士 === 大同大學 === 通訊工程研究所 === 98 === Due to the development and progress in digital and display technologies, traditional television broadcasting is experiencing a profound change. Under the trend that high-definition video is becoming as the new mainstream of digital broadcasting, the next emerging technology will be multiview video broadcasting. The technology of 3D display is gradually mature; however, video content suitable for 3D displays are rather rare. Since most of the current existing video films including movies, news, documentaries, were captured by monocular cameras, technology capable of generating 3D video monocular should meet the demand of 3D displays. In the thesis, applying the stationary constraint to objects in the scene, we have developed technologies that convert a monocular video to a 3D stereoscopic video. In this research, we adopt the DIBR (Depth Image-Based Rendering) approach to generate multiview images. The major challenge of DIBR-based 3D view synthesis technique is the annoying disocclusion problem. We have proposed an effective algorithm to remove the disocclusion regions in the view synthesis images. First, we have to estimate the disparity map for every two consecutive images and then determine the horizontal displacement for each consecutive frame using the disparity map. The disparity maps provide the depth information for synthesizing the multiview images, while the horizontal displacements provide the relative position between images. We utilize a two stage inpainting to remove the disocclusion areas. The first stage is referred to as inter-frame inpainting which fills in the disocclusion regions using the data from the neighboring frames of the reference image. In subsequent, the second stage referred to as the intra-frame inpainting is applied to fill in the remained disocclusion areas. The experimental results show that our proposed disocclusion removal algorithm indeed is capable of taking good care of unpleasant disocclusion effect in the view-synthesis images.