Natural shadow matting
- 1 June 2007
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 26 (2)
- https://doi.org/10.1145/1243980.1243982
Abstract
This article addresses the problem of natural shadow matting, the removal or extraction of natural shadows from a single image. Because textures are maintained in the shadowless image after the extraction process, our approach produces some of the best results to date among shadow removal techniques. Using the image formation equation typical of computer vision, we advocate a new model for shadow formation where shadow effect is understood as light attenuation instead of a mixture of two colors governed by the conventional matting equation. This leads to a new shadow equation with fewer unknowns to solve, where a three-channel shadow matte and a shadowless image are considered in our optimization. Our problem is formulated as one of energy minimization guided by user-supplied hints in the form of a quadmap which can be specified easily by the user. This formulation allows for robust shadow matte extraction while maintaining texture in the shadowed region by considering color transfer, texture gradient, and shadow smoothness. We demonstrate the usefulness of our approach in shadow removal, image matting, and compositing.Keywords
This publication has 17 references indexed in Scilit:
- Poisson mattingACM Transactions on Graphics, 2004
- "GrabCut"ACM Transactions on Graphics, 2004
- Lazy snappingACM Transactions on Graphics, 2004
- Inference of segmented color and texture description by tensor votingIeee Transactions On Pattern Analysis and Machine Intelligence, 2004
- Shadow removal from a real image based on shadow densityPublished by Association for Computing Machinery (ACM) ,2004
- Fragment-based image completionACM Transactions on Graphics, 2003
- Shadow matting and compositingACM Transactions on Graphics, 2003
- Transferring color to greyscale imagesACM Transactions on Graphics, 2002
- Color transfer between imagesIEEE Computer Graphics and Applications, 2001
- Lightness and Retinex TheoryJournal of the Optical Society of America, 1971