Eyes for relighting
- 1 August 2004
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
- Vol. 23 (3), 704-711
- https://doi.org/10.1145/1186562.1015783
Abstract
The combination of the cornea of an eye and a camera viewing the eye form a catadioptric (mirror + lens) imaging system with a very wide field of view. We present a detailed analysis of the characteristics of this corneal imaging system. Anatomical studies have shown that the shape of a normal cornea (without major defects) can be approximated with an ellipsoid of fixed eccentricity and size. Using this shape model, we can determine the geometric parameters of the corneal imaging system from the image. Then, an environment map of the scene with a large field of view can be computed from the image. The environment map represents the illumination of the scene with respect to the eye. This use of an eye as a natural light probe is advantageous in many relighting scenarios. For instance, it enables us to insert virtual objects into an image such that they appear consistent with the illumination of the scene. The eye is a particularly useful probe when relighting faces. It allows us to reconstruct the geometry of a face by simply waving a light source in front of the face. Finally, in the case of an already captured image, eyes could be the only direct means for obtaining illumination information. We show how illumination computed from eyes can be used to replace a face in an image with another one. We believe that the eye not only serves as a useful tool for relighting but also makes relighting possible in situations where current approaches are hard to use.Keywords
This publication has 27 references indexed in Scilit:
- An ocularist's approach to human iris synthesisIEEE Computer Graphics and Applications, 2003
- Structured importance sampling of environment mapsPublished by Association for Computing Machinery (ACM) ,2003
- Illumination from shadowsIeee Transactions On Pattern Analysis and Machine Intelligence, 2003
- Acquiring the reflectance field of a human facePublished by Association for Computing Machinery (ACM) ,2000
- Virtual Eye: retinal image visualization of the human eyeIEEE Computer Graphics and Applications, 1997
- High confidence visual recognition of persons by a test of statistical independenceIeee Transactions On Pattern Analysis and Machine Intelligence, 1993
- A method for enforcing integrability in shape from shading algorithmsIeee Transactions On Pattern Analysis and Machine Intelligence, 1988
- Flux density for ray propagation in geometrical optics*Journal of the Optical Society of America, 1973
- Theory for Off-Specular Reflection From Roughened Surfaces*Journal of the Optical Society of America, 1967
- Ray tracing through non-spherical surfacesProceedings of the Physical Society, 1943