Deep Colorization
Top Cited Papers
- 1 December 2015
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 415-423
- https://doi.org/10.1109/iccv.2015.55
Abstract
This paper investigates into the colorization problem which converts a grayscale image to a colorful version. This is a very difficult problem and normally requires manual adjustment to achieve artifact-free quality. For instance, it normally requires human-labelled color scribbles on the grayscale target image or a careful selection of colorful reference images (e.g., capturing the same scene in the grayscale target image). Unlike the previous methods, this paper aims at a high-quality fully-automatic colorization method. With the assumption of a perfect patch matching technique, the use of an extremely large-scale reference database (that contains sufficient color images) is the most reliable solution to the colorization problem. However, patch matching noise will increase with respect to the size of the reference database in practice. Inspired by the recent success in deep learning techniques which provide amazing modeling of large-scale data, this paper re-formulates the colorization problem so that deep learning techniques can be directly employed. To ensure artifact-free quality, a joint bilateral filtering based post-processing step is proposed. Numerous experiments demonstrate that our method outperforms the state-of-art algorithms both in terms of quality and speed.Keywords
This publication has 21 references indexed in Scilit:
- Joint Deep Learning for Pedestrian DetectionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Image colorization using similar imagesPublished by Association for Computing Machinery (ACM) ,2012
- SUN attribute database: Discovering, annotating, and recognizing scene attributesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Domain transform for edge-aware image and video processingPublished by Association for Computing Machinery (ACM) ,2011
- Detecting object boundaries using low-, mid-, and high-level informationComputer Vision and Image Understanding, 2010
- Intrinsic colorizationPublished by Association for Computing Machinery (ACM) ,2008
- An adaptive edge detection based colorization algorithm and its applicationsPublished by Association for Computing Machinery (ACM) ,2005
- Colorization using optimizationPublished by Association for Computing Machinery (ACM) ,2004
- Digital photography with flash and no-flash image pairsACM Transactions on Graphics, 2004
- Mean shift: a robust approach toward feature space analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002