Summary: | 碩士 === 輔仁大學 === 資訊工程學系 === 93 === In this paper, a novel approach is proposed for video clip (containing more than one shot) matching and retrieval. In contrast to the traditional key-frame based shot matching approach and frame sequence matching approach, our method analyzes all frames within a shot to fully exploit the spatio-temporal information, while generating only one representation for each visual feature used in each shot. The visual features utilized in our scheme are color fused with spatial distribution information, and motion. Video clip matching is performed at two levels, first at the shot level, then at the sequence level. A set of similarity measures are defined to evaluate the similarity between the query and the database video. Experimental results show that the proposed approach is effective and feasible in retrieving and ranking similar video clips with a variety of video contents. Our approach is also able to achieve a superior performance in comparison to a key-framed based retrieval system using only color histogram for feature representation and matching. Furthermore, to refine the search results, a technique called relevance feedback is implemented that takes into account the user’s own opinion on whether two clips are similar during the retrieval process. In some cases, improvement on the retrieval performance is observed.
|