Parameterized environment maps

Abstract

Static environment maps fail to capture local reflections including effects like self- reflections and parallax in the reflected imagery. We in- stead propose parameterized environment maps (PEMs), a set of per-view environment maps which accurately repro- duce local reflections at each viewpoint as computed by an offline ray tracer. Even with a small set of viewpoint sam- ples, PEMs support plausible movement away from and between the pre-rendered viewpoint samples while maintaining local reflections. They also make use of environment maps supported in graphics hardware to provide real-time explo- ration of the pre-rendered space. In addition to parameterization by viewpoint, our notion of PEMextends to general, multidimen- sional parameterizations of the scene, including relative motions of objects and lighting changes. Our contributions include a technique for inferring environment maps providing a close match to ray-traced imagery. We also explicitly infer and encode all MIPMAP levels of the PEMs to achieve higher accuracy. We propose layered environment maps that separate local and distant reflected geometry. We explore several types of environment maps including finite spheres, ellip- soids, and boxes that better approximate the environmental geometry. We demonstrate results showing faithful local reflec- tions in an interactive viewer. Additional Keywords: ray tracing, reflections, Fresnel modulation, pa- rameterized texture maps, surface light fields, IBR.