Domain transform for edge-aware image and video processing
Top Cited Papers
- 25 July 2011
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 30 (4), 1-12
- https://doi.org/10.1145/2010324.1964964
Abstract
We present a new approach for performing high-quality edge-preserving filtering of images and videos in real time. Our solution is based on a transform that defines an isometry between curves on the 2D image manifold in 5D and the real line. This transform preserves the geodesic distance between points on these curves, adaptively warping the input signal so that 1D edge-preserving filtering can be efficiently performed in linear time. We demonstrate three realizations of 1D edge-preserving filters, show how to produce high-quality 2D edge-preserving filters by iterating 1D-filtering operations, and empirically analyze the convergence of this process. Our approach has several desirable features: the use of 1D operations leads to considerable speedups over existing techniques and potential memory savings; its computational cost is not affected by the choice of the filter parameters; and it is the first edge-preserving filter to work on color images at arbitrary scales in real time, without resorting to subsampling or quantization. We demonstrate the versatility of our domain transform and edge-preserving filters on several real-time image and video processing tasks including edge-preserving filtering, depth-of-field effects, stylization, recoloring, colorization, detail enhancement, and tone mapping.Keywords
Funding Information
- Conselho Nacional de Desenvolvimento Científico e Tecnológico (557814/2010-3200284/2009-6308936/2010-8480485/2010-0)
This publication has 27 references indexed in Scilit:
- Diffusion maps for edge-aware image editingACM Transactions on Graphics, 2010
- Geodesic image and video editingACM Transactions on Graphics, 2010
- Fast High‐Dimensional Filtering Using the Permutohedral LatticeComputer Graphics Forum, 2010
- Shared Sampling for Real‐Time Alpha MattingComputer Graphics Forum, 2010
- Edge-avoiding wavelets and their applicationsACM Transactions on Graphics, 2009
- Gaussian KD-trees for fast high-dimensional filteringPublished by Association for Computing Machinery (ACM) ,2009
- Edge-preserving decompositions for multi-scale tone and detail manipulationACM Transactions on Graphics, 2008
- Real-time edge-aware image processing with the bilateral gridACM Transactions on Graphics, 2007
- Laplacian Eigenmaps for Dimensionality Reduction and Data RepresentationNeural Computation, 2003
- Fundamental relationship between bilateral filtering, adaptive smoothing, and the nonlinear diffusion equationIeee Transactions On Pattern Analysis and Machine Intelligence, 2002