A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps
In this paper, we propose a novel 2D-to-3D video conversion method for 3D entertainment applications. 3D entertainment is getting more and more popular and can be found in many contexts, such as TV and home gaming equipment. 3D image sensors are a new method to produce stereoscopic video content co...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2015-06-01
|
Series: | Sensors |
Subjects: | |
Online Access: | http://www.mdpi.com/1424-8220/15/7/15246 |
id |
doaj-50b2d8a26fdb46b3a13c3028aa552fe0 |
---|---|
record_format |
Article |
spelling |
doaj-50b2d8a26fdb46b3a13c3028aa552fe02020-11-25T01:48:49ZengMDPI AGSensors1424-82202015-06-01157152461526410.3390/s150715246s150715246A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth MapsShouyi Yin0Hao Dong1Guangli Jiang2Leibo Liu3Shaojun Wei4Institute of Microelectronics, Tsinghua University, Beijing 100084, ChinaInstitute of Microelectronics, Tsinghua University, Beijing 100084, ChinaInstitute of Microelectronics, Tsinghua University, Beijing 100084, ChinaInstitute of Microelectronics, Tsinghua University, Beijing 100084, ChinaInstitute of Microelectronics, Tsinghua University, Beijing 100084, ChinaIn this paper, we propose a novel 2D-to-3D video conversion method for 3D entertainment applications. 3D entertainment is getting more and more popular and can be found in many contexts, such as TV and home gaming equipment. 3D image sensors are a new method to produce stereoscopic video content conveniently and at a low cost, and can thus meet the urgent demand for 3D videos in the 3D entertaiment market. Generally, 2D image sensor and 2D-to-3D conversion chip can compose a 3D image sensor. Our study presents a novel 2D-to-3D video conversion algorithm which can be adopted in a 3D image sensor. In our algorithm, a depth map is generated by combining global depth gradient and local depth refinement for each frame of 2D video input. Global depth gradient is computed according to image type while local depth refinement is related to color information. As input 2D video content consists of a number of video shots, the proposed algorithm reuses the global depth gradient of frames within the same video shot to generate time-coherent depth maps. The experimental results prove that this novel method can adapt to different image types, reduce computational complexity and improve the temporal smoothness of generated 3D video.http://www.mdpi.com/1424-8220/15/7/15246TV and home gaming equipmentstereoscopic video2D-to-3D video conversiontime-coherent depth maps |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Shouyi Yin Hao Dong Guangli Jiang Leibo Liu Shaojun Wei |
spellingShingle |
Shouyi Yin Hao Dong Guangli Jiang Leibo Liu Shaojun Wei A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps Sensors TV and home gaming equipment stereoscopic video 2D-to-3D video conversion time-coherent depth maps |
author_facet |
Shouyi Yin Hao Dong Guangli Jiang Leibo Liu Shaojun Wei |
author_sort |
Shouyi Yin |
title |
A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps |
title_short |
A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps |
title_full |
A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps |
title_fullStr |
A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps |
title_full_unstemmed |
A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps |
title_sort |
novel 2d-to-3d video conversion method using time-coherent depth maps |
publisher |
MDPI AG |
series |
Sensors |
issn |
1424-8220 |
publishDate |
2015-06-01 |
description |
In this paper, we propose a novel 2D-to-3D video conversion method for 3D entertainment applications. 3D entertainment is getting more and more popular and can be found in many contexts, such as TV and home gaming equipment. 3D image sensors are a new method to produce stereoscopic video content conveniently and at a low cost, and can thus meet the urgent demand for 3D videos in the 3D entertaiment market. Generally, 2D image sensor and 2D-to-3D conversion chip can compose a 3D image sensor. Our study presents a novel 2D-to-3D video conversion algorithm which can be adopted in a 3D image sensor. In our algorithm, a depth map is generated by combining global depth gradient and local depth refinement for each frame of 2D video input. Global depth gradient is computed according to image type while local depth refinement is related to color information. As input 2D video content consists of a number of video shots, the proposed algorithm reuses the global depth gradient of frames within the same video shot to generate time-coherent depth maps. The experimental results prove that this novel method can adapt to different image types, reduce computational complexity and improve the temporal smoothness of generated 3D video. |
topic |
TV and home gaming equipment stereoscopic video 2D-to-3D video conversion time-coherent depth maps |
url |
http://www.mdpi.com/1424-8220/15/7/15246 |
work_keys_str_mv |
AT shouyiyin anovel2dto3dvideoconversionmethodusingtimecoherentdepthmaps AT haodong anovel2dto3dvideoconversionmethodusingtimecoherentdepthmaps AT guanglijiang anovel2dto3dvideoconversionmethodusingtimecoherentdepthmaps AT leiboliu anovel2dto3dvideoconversionmethodusingtimecoherentdepthmaps AT shaojunwei anovel2dto3dvideoconversionmethodusingtimecoherentdepthmaps AT shouyiyin novel2dto3dvideoconversionmethodusingtimecoherentdepthmaps AT haodong novel2dto3dvideoconversionmethodusingtimecoherentdepthmaps AT guanglijiang novel2dto3dvideoconversionmethodusingtimecoherentdepthmaps AT leiboliu novel2dto3dvideoconversionmethodusingtimecoherentdepthmaps AT shaojunwei novel2dto3dvideoconversionmethodusingtimecoherentdepthmaps |
_version_ |
1725009955653681152 |