Image Co-segmentation via Consistent Functional Maps
- 1 December 2013
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in 2013 IEEE International Conference on Computer Vision
- p. 849-856
- https://doi.org/10.1109/iccv.2013.110
Abstract
Joint segmentation of image sets has great importance for object recognition, image classification, and image retrieval. In this paper, we aim to jointly segment a set of images starting from a small number of labeled images or none at all. To allow the images to share segmentation information with each other, we build a network that contains segmented as well as unsegmented images, and extract functional maps between connected image pairs based on image appearance features. These functional maps act as general property transporters between the images and, in particular, are used to transfer segmentations. We define and operate in a reduced functional space optimized so that the functional maps approximately satisfy cycle-consistency under composition in the network. A joint optimization framework is proposed to simultaneously generate all segmentation functions over the images so that they both align with local segmentation cues in each particular image, and agree with each other under network transportation. This formulation allows us to extract segmentations even with no training data, but can also exploit such data when available. The collective effect of the joint processing using functional maps leads to accurate information sharing among images and yields superior segmentation results, as shown on the iCoseg, MSRC, and PASCAL data sets.Keywords
This publication has 18 references indexed in Scilit:
- Stress reliefACM Transactions on Graphics, 2012
- Unsupervised co-segmentation through region matchingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Figure-ground segmentation by transferring window masksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Vector diffusion maps and the connection LaplacianCommunications on Pure and Applied Mathematics, 2012
- Scale invariant cosegmentation for image groupsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Object cosegmentationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Structure from motion for scenes with large duplicate structuresPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- A spectral technique for correspondence problems using pairwise constraintsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Modeling the Shape of the Scene: A Holistic Representation of the Spatial EnvelopeInternational Journal of Computer Vision, 2001
- Normalized cuts and image segmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000