Coherent intrinsic images from photo collections
- 1 November 2012
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 31 (6), 1-11
- https://doi.org/10.1145/2366145.2366221
Abstract
An intrinsic image is a decomposition of a photo into an illumination layer and a reflectance layer, which enables powerful editing such as the alteration of an object's material independently of its illumination. However, decomposing a single photo is highly under-constrained and existing methods require user assistance or handle only simple scenes. In this paper, we compute intrinsic decompositions using several images of the same scene under different viewpoints and lighting conditions. We use multi-view stereo to automatically reconstruct 3D points and normals from which we derive relationships between reflectance values at different locations, across multiple views and consequently different lighting conditions. We use robust estimation to reliably identify reflectance ratios between pairs of points. From these, we infer constraints for our optimization and enforce a coherent solution across multiple views and illuminations. Our results demonstrate that this constrained optimization yields high-quality and coherent intrinsic decompositions of complex scenes. We illustrate how these decompositions can be used for image-based illumination transfer and transitions between views with consistent lighting.Keywords
This publication has 27 references indexed in Scilit:
- Silhouette‐Aware Warping for Image‐Based RenderingComputer Graphics Forum, 2011
- User-assisted intrinsic imagesACM Transactions on Graphics, 2009
- Intrinsic colorizationACM Transactions on Graphics, 2008
- Finding paths through the world's photosACM Transactions on Graphics, 2008
- Building Illumination Coherent 3D Models of Large-Scale Outdoor ScenesInternational Journal of Computer Vision, 2007
- Scene completion using millions of photographsACM Transactions on Graphics, 2007
- Factored time-lapse videoACM Transactions on Graphics, 2007
- Photo tourismACM Transactions on Graphics, 2006
- Automatic photo pop-upACM Transactions on Graphics, 2005
- Surface reconstruction from unorganized pointsACM SIGGRAPH Computer Graphics, 1992