Interactive virtual relighting of real scenes
- 1 January 2000
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 6 (4), 289-305
- https://doi.org/10.1109/2945.895874
Abstract
Computer augmented reality (CAR) is a rapidly emerging field which enables users to mix real and virtual worlds. Our goal is to provide interactive tools to perform common illumination, i.e., light interactions between real and virtual objects, including shadows and relighting (real and virtual light source modification). In particular, we concentrate on virtually modifying real light source intensities and inserting virtual lights and objects into a real scene; such changes can be very useful for virtual lighting design and prototyping. To achieve this, we present a three-step method. We first reconstruct a simplified representation of real scene geometry using semiautomatic vision-based techniques. With the simplified geometry, and by adapting recent hierarchical radiosity algorithms, we construct an approximation of real scene light exchanges. We next perform a preprocessing step, based on the radiosity system, to create unoccluded illumination textures. These replace the original scene textures which contained real light effects such as shadows from real lights. This texture is then modulated by a ratio of the radiosity (which can be changed) over a display factor which corresponds to the radiosity for which occlusion has been ignored. Since our goal is to achieve a convincing relighting effect, rather than an accurate solution, we present a heuristic correction process which results in visually plausible renderings. Finally, we perform an interactive process to compute new illumination with modified real and virtual light intensities.Keywords
This publication has 22 references indexed in Scilit:
- Using geometric corners to build a 2D mosaic from a set of imagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Inverse global illuminationPublished by Association for Computing Machinery (ACM) ,1999
- Recovering photometric properties of architectural scenes from photographsPublished by Association for Computing Machinery (ACM) ,1998
- Automatic Calculation of Soft Shadow Textures for Fast, High Quality RadiosityPublished by Springer Science and Business Media LLC ,1998
- A Survey of Augmented RealityPRESENCE: Virtual and Augmented Reality, 1997
- Superior augmented reality registration by integrating landmark tracking and magnetic trackingPublished by Association for Computing Machinery (ACM) ,1996
- A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometryArtificial Intelligence, 1995
- A clustering algorithm for radiosity in complex environmentsPublished by Association for Computing Machinery (ACM) ,1994
- The RADIANCE lighting simulation and rendering systemPublished by Association for Computing Machinery (ACM) ,1994
- A progressive refinement approach to fast radiosity image generationACM SIGGRAPH Computer Graphics, 1988