Multiview Stereo via Volumetric Graph-Cuts and Occlusion Robust Photo-Consistency
- 5 November 2007
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 29 (12), 2241-2246
- https://doi.org/10.1109/tpami.2007.70712
Abstract
This paper presents a volumetric formulation for the multiview stereo problem which is amenable to a computationally tractable global optimization using Graph-cuts. Our approach is to seek the optimal partitioning of 3D space into two regions labeled as "object" and "empty" under a cost functional consisting of the following two terms: 1) A term that forces the boundary between the two regions to pass through photo-consistent locations; and 2) a ballooning term that inflates the "object" region. To take account of the effect of occlusion on the first term, we use an occlusion robust photo-consistency metric based on normalized cross correlation, which does not assume any geometric knowledge about the reconstructed object. The globally optimal 3D partitioning can be obtained as the minimum cut solution of a weighted graph.Keywords
This publication has 24 references indexed in Scilit:
- Silhouette Coherence for Camera Calibration under Circular MotionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- A Comparison and Evaluation of Multi-View Stereo Reconstruction AlgorithmsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Multi-View Stereo Reconstruction and Scene Flow Estimation with a Global Image-Based Matching ScoreInternational Journal of Computer Vision, 2006
- Hierarchical Volumetric Multi-view Stereo Reconstruction of Manifold Surfaces based on Dual Graph EmbeddingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Volumetric stereo with silhouette and feature constraintsPublished by British Machine Vision Association and Society for Pattern Recognition ,2006
- Multi-view reconstruction using photo-consistency and exact silhouette constraints: a maximum-flow formulationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Silhouette and stereo fusion for 3D object modelingComputer Vision and Image Understanding, 2004
- What energy functions can be minimized via graph cuts?Ieee Transactions On Pattern Analysis and Machine Intelligence, 2004
- Dense matching of multiple wide-baseline viewsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- A maximum-flow formulation of the N-camera stereo correspondence problemPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002