Globally consistent depth labeling of 4D light fields
Top Cited Papers
- 1 June 2012
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
We present a novel paradigm to deal with depth reconstruction from 4D light fields in a variational framework. Taking into account the special structure of light field data, we reformulate the problem of stereo matching to a constrained labeling problem on epipolar plane images, which can be thought of as vertical and horizontal 2D cuts through the field. This alternative formulation allows to estimate accurate depth values even for specular surfaces, while simultaneously taking into account global visibility constraints in order to obtain consistent depth maps for all views. The resulting optimization problems are solved with state-of-the-art convex relaxation techniques. We test our algorithm on a number of synthetic and real-world examples captured with a light field gantry and a plenoptic camera, and compare to ground truth where available. All data sets as well as source code are provided online for additional evaluation.Keywords
This publication has 14 references indexed in Scilit:
- Generalized ordering constraints for multilabel optimizationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Generating EPI Representations of 4D Light Fields with a Single Lens Focused Plenoptic CameraLecture Notes in Computer Science, 2011
- Global Solutions of Variational Models with Convex RegularizationSIAM Journal on Imaging Sciences, 2010
- Segmentation of Epipolar-Plane Image Volumes with Occlusion and Disocclusion CompetitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Light Fields and Computational ImagingComputer, 2006
- Using plane + parallax for calibrating dense camera arraysPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Physically-valid view synthesis by image interpolationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Image-based modeling, rendering, and lightingIEEE Computer Graphics and Applications, 2002
- Light field renderingPublished by Association for Computing Machinery (ACM) ,1996
- Viewpoint-dependent stereoscopic display using interpolation of multiviewpoint imagesPublished by SPIE-Intl Soc Optical Eng ,1995