A Novel 2D-to-3D Video Conversion Method Using Time-Coherent Depth Maps
Open Access
- 29 June 2015
- Vol. 15 (7), 15246-15264
- https://doi.org/10.3390/s150715246
Abstract
In this paper, we propose a novel 2D-to-3D video conversion method for 3D entertainment applications. 3D entertainment is getting more and more popular and can be found in many contexts, such as TV and home gaming equipment. 3D image sensors are a new method to produce stereoscopic video content conveniently and at a low cost, and can thus meet the urgent demand for 3D videos in the 3D entertaiment market. Generally, 2D image sensor and 2D-to-3D conversion chip can compose a 3D image sensor. Our study presents a novel 2D-to-3D video conversion algorithm which can be adopted in a 3D image sensor. In our algorithm, a depth map is generated by combining global depth gradient and local depth refinement for each frame of 2D video input. Global depth gradient is computed according to image type while local depth refinement is related to color information. As input 2D video content consists of a number of video shots, the proposed algorithm reuses the global depth gradient of frames within the same video shot to generate time-coherent depth maps. The experimental results prove that this novel method can adapt to different image types, reduce computational complexity and improve the temporal smoothness of generated 3D video.Keywords
This publication has 10 references indexed in Scilit:
- A real-time 1080p 2D-to-3D video conversion systemIEEE Transactions on Consumer Electronics, 2011
- A novel 2Dd-to-3D conversion system using edge informationIEEE Transactions on Consumer Electronics, 2010
- 51.3: An Ultra-Low-Cost 2-D/3-D Video-Conversion SystemSID Symposium Digest of Technical Papers, 2010
- A novel 2D-to-3D conversion technique based on relative height-depth cuePublished by SPIE-Intl Soc Optical Eng ,2009
- Real-time 2D to 3D video conversionJournal of Real-Time Image Processing, 2007
- 3D from compressed 2D videoPublished by SPIE-Intl Soc Optical Eng ,2007
- Stereoscopic Image Generation Based on Depth Images for 3D TVIEEE Transactions on Broadcasting, 2005
- Depth map generation by image classificationPublished by SPIE-Intl Soc Optical Eng ,2004
- Comparison of video shot boundary detection techniquesJournal of Electronic Imaging, 1996
- Automatic partitioning of full-motion videoMultimedia Systems, 1993