Video Caption Region Detection and Completion

• Main Authors: Wan-Hung Chen, 陳萬鴻
• Other Authors: 郭天穎
• Format: Others
• Language: zh-TW
• Published: 2011
• Online Access: http://ndltd.ncl.edu.tw/handle/7p7444

碩士 === 國立臺北科技大學 === 電機工程系研究所 === 99 === This paper proposed a video text detection and completion method to remove embedded captions in broadcasting programs. One may remove captions manually frame by frame using image editing tools, but it takes a considerable amount of time and efforts. Many automatic text detection methods have been proposed to solve this problem, but none of existing methods considered real scenarios where captions suffer from caption transition and complicated background. This work develops a real time caption detection algorithm by making use of the temporal relation observed in caption transition, and improves the caption detection rate in complicated background using high contrast property found in spatial domain. To complete the detected caption region, we extend an exemplar-based image inpainting algorithm by incorporating motion vectors to the completion priority for video inpainting, so as to maintain spatial consistency and temporal continuity in playback. Experiments are performed on real television broadcast video clips, and shows that the proposed text detection and completion method is superior to other methods.