Robust higher order potentials for enforcing label consistency
- 1 June 2008
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
This paper proposes a novel framework for labelling problems which is able to combine multiple segmentations in a principled manner. Our method is based on higher order conditional random fields and uses potentials defined on sets of pixels (image segments) generated using unsupervised segmentation algorithms. These potentials enforce label consistency in image regions and can be seen as a strict generalization of the commonly used pairwise contrast sensitive smoothness potentials. The higher order potential functions used in our framework take the form of the robust Pn model. This enables the use of powerful graph cut based move making algorithms for performing inference in the framework [14 ]. We test our method on the problem of multi-class object segmentation by augmenting the conventional CRF used for object segmentation with higher order potentials defined on image regions. Experiments on challenging data sets show that integration of higher order potentials quantitatively and qualitatively improves results leading to much better definition of object boundaries. We believe that this method can be used to yield similar improvements for many other labelling problems.Keywords
This publication has 20 references indexed in Scilit:
- MAP Estimation Via Agreement on Trees: Message-Passing and Linear ProgrammingIEEE Transactions on Information Theory, 2005
- Interactive video cutoutACM Transactions on Graphics, 2005
- Automatic photo pop-upACM Transactions on Graphics, 2005
- Efficient Graph-Based Image SegmentationInternational Journal of Computer Vision, 2004
- "GrabCut"Published by Association for Computing Machinery (ACM) ,2004
- Image segmentation by data-driven markov chain monte carloIeee Transactions On Pattern Analysis and Machine Intelligence, 2002
- Mean shift: a robust approach toward feature space analysisIeee Transactions On Pattern Analysis and Machine Intelligence, 2002
- Fast approximate energy minimization via graph cutsIeee Transactions On Pattern Analysis and Machine Intelligence, 2001
- Normalized cuts and image segmentationIeee Transactions On Pattern Analysis and Machine Intelligence, 2000
- Texture synthesis via a noncausal nonparametric multiscale Markov random fieldIEEE Transactions on Image Processing, 1998