Mask R-CNN
- 1 October 2017
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2980-2988
- https://doi.org/10.1109/iccv.2017.322
Abstract
We present a conceptually simple, flexible, and general framework for object instance segmentation. Our approach efficiently detects objects in an image while simultaneously generating a high-quality segmentation mask for each instance. The method, called Mask R-CNN, extends Faster R-CNN by adding a branch for predicting an object mask in parallel with the existing branch for bounding box recognition. Mask R-CNN is simple to train and adds only a small overhead to Faster R-CNN, running at 5 fps. Moreover, Mask R-CNN is easy to generalize to other tasks, e.g., allowing us to estimate human poses in the same framework. We show top results in all three tracks of the COCO suite of challenges, including instance segmentation, bounding-box object detection, and person keypoint detection. Without tricks, Mask R-CNN outperforms all existing, single-model entries on every task, including the COCO 2016 challenge winners. We hope our simple and effective approach will serve as a solid baseline and help ease future research in instance-level recognition. Code will be made available.Keywords
This publication has 18 references indexed in Scilit:
- Aggregated Residual Transformations for Deep Neural NetworksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2017
- Instance-Sensitive Fully Convolutional NetworksPublished by Springer Science and Business Media LLC ,2016
- Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural NetworksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- Deep Residual Learning for Image RecognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- Convolutional Pose MachinesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- Training Region-Based Object Detectors with Online Hard Example MiningPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- Convolutional feature masking for joint object and stuff segmentationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Deformable part models are convolutional neural networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic SegmentationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2014
- Selective Search for Object RecognitionInternational Journal of Computer Vision, 2013