Richer Convolutional Features for Edge Detection
- 31 October 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 41 (8), 1939-1946
- https://doi.org/10.1109/tpami.2018.2878849
Abstract
Edge detection is a fundamental problem in computer vision. Recently, convolutional neural networks (CNNs) have pushed forward this field significantly. Existing methods which adopt specific layers of deep CNNs may fail to capture complex data structures caused by variations of scales and aspect ratios. In this paper, we propose an accurate edge detector using richer convolutional features (RCF). RCF encapsulates all convolutional features into more discriminative representation, which makes good usage of rich feature hierarchies, and is amenable to training via backpropagation. RCF fully exploits multiscale and multilevel information of objects to perform the image-to-image prediction holistically. Using VGG16 network, we achieve state-of-the-art performance on several available datasets. When evaluating on the well-known BSDS500 benchmark, we achieve ODS F-measure of 0.811 while retaining a fast speed (8 FPS). Besides, our fast version of RCF achieves ODS F-measure of 0.806 with 30 FPS. We also demonstrate the versatility of the proposed method by applying RCF edges for classical image segmentation.Keywords
Funding Information
- National Natural Science Foundation of China (61620106008, 61572264)
- National Youth Talent Support Program
- Natural Science Foundation of Tianjin City (17JCJQJC43700)
- Huawei Innovation Research Program
This publication has 39 references indexed in Scilit:
- $$N^4$$-Fields: Neural Network Nearest Neighbor Fields for Image TransformsPublished by Springer Science and Business Media LLC ,2015
- Eddy current measurement of the thickness of top Cu film of the multilayer interconnects in the integrated circuit (IC) manufacturing processFrontiers of Mechanical Engineering, 2015
- Fast Edge Detection Using Structured ForestsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- CaffePublished by Association for Computing Machinery (ACM) ,2014
- Perceptual Organization and Recognition of Indoor Scenes from RGB-D ImagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Efficient Graph-Based Image SegmentationInternational Journal of Computer Vision, 2004
- Learning to detect natural image boundaries using local brightness, color, and texture cuesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Mean shift: a robust approach toward feature space analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Normalized cuts and image segmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Recognition by linear combinations of modelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1991