Implementation of Multiresolution and Multi Refresh Rates Remote Video Streaming System Applying on Mobile Telepresence

• Main Authors: Chia-Cheng Tseng, 曾嘉程
• Other Authors: Wei-Chung Teng
• Format: Others
• Language: zh-TW
• Published: 2012
• Online Access: http://ndltd.ncl.edu.tw/handle/8yxk3s

碩士 === 國立臺灣科技大學 === 資訊工程系 === 100 === Clear, wide angle, low distortion yet real time video feedback in telepresence systems plays critical role on helping human operators recognize remote environment instantly and effectively. However, the required bandwidth for this kind of streaming video is not affordable to many practical implementations. Some past researches use multiresolutional image compression on gaze-contingent display to solve this problem, and this study extends their work by implementing a multiresolutional, multi refresh rate video streaming system on a telepresence system with video partitioning technique. This system equips one Point Grey Research’s Ladybug2 omnidirectional camera on a Pioneer DX3 mobile robot. We use OpenGL for image processing, Mipmap technique for building up multiresoutional image, video partitioning for supporting multi refresh rate function, and finally H.264 for transmitting video streams. This system may provide at most 180 degree image of remote environment with one specific gaze position, and multiresolutional image of wide viewing angle is considered to give human operators better user experience. One experiment is performed to compare the performance between the multiresolutional image and the original image on remote navigation. Experiment results show that though our approach suffers lower score on user experiment, there is no specific difference on operation performance. Consider that only less than 10% bandwidth is necessary comparing to the classic video streaming, our system has advantage even on environments which only provide low transmission bandwidth.