Depth from shading, defocus, and correspondence using light-field angular coherence
- 1 June 2015
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1940-1948
- https://doi.org/10.1109/cvpr.2015.7298804
Abstract
Light-field cameras are now used in consumer and industrial applications. Recent papers and products have demonstrated practical depth recovery algorithms from a passive single-shot capture. However, current light-field capture devices have narrow baselines and constrained spatial resolution; therefore, the accuracy of depth recovery is limited, requiring heavy regularization and producing planar depths that do not resemble the actual geometry. Using shading information is essential to improve the shape estimation. We develop an improved technique for local shape estimation from defocus and correspondence cues, and show how shading can be used to further refine the depth. Light-field cameras are able to capture both spatial and angular data, suitable for refocusing. By locally refocusing each spatial pixel to its respective estimated depth, we produce an all-in-focus image where all viewpoints converge onto a point in the scene. Therefore, the angular pixels have angular coherence, which exhibits three properties: photo consistency, depth consistency, and shading consistency. We propose a new framework that uses angular coherence to optimize depth and shading. The optimization framework estimates both general lighting in natural scenes and shading to improve depth regularization. Our method outperforms current state-of-the-art light-field depth estimation algorithms in multiple scenarios, including real images.Keywords
This publication has 24 references indexed in Scilit:
- Real-time shading-based refinement for consumer depth camerasACM Transactions on Graphics, 2014
- Depth from Combining Defocus and Correspondence Using Light-Field CamerasPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Shading-Based Shape Refinement of RGB-D ImagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Globally consistent depth labeling of 4D light fieldsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Light fields and shape from shadingJournal of Vision, 2011
- Numerical methods for shape-from-shading: A new survey with benchmarksComputer Vision and Image Understanding, 2008
- Shape-from-shading: a surveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 1999
- Photorealistic Scene Reconstruction by Voxel ColoringInternational Journal of Computer Vision, 1999
- Gradient and curvature from the photometric-stereo method, including local confidence estimationJournal of the Optical Society of America A, 1994
- Photometric Method For Determining Surface Orientation From Multiple ImagesOptical Engineering, 1980