Cast indexing for videos by NCuts and page ranking
- 9 July 2007
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM) in Proceedings of the 6th ACM international conference on Image and video retrieval - CIVR '07
- p. 441-447
- https://doi.org/10.1145/1282280.1282345
Abstract
Cast indexing is an important video mining technique which provides audience the capability to efficiently retrieve interested scenes, events, and stories from a long video. This paper proposes a novel cast indexing approach based on Normalized Graph Cuts (NCuts) and Page Ranking. The system first adopts face tracker to group face images in each shot into face sets, and then extract local SIFT feature as the feature representation. There are two key problems for cast indexing. One is to find an optimal partition to cluster face sets into main cast. The other is how to exploit the latent relationships among characters to provide a more accurate cast ranking. For the first problem, we model each face set as a graph node, and adopt Normalized Graph Cuts (NCuts) to realize an optimal graph partition. A novel local neighborhood distance is proposed to measure the distance between face sets for NCuts, which is robust to outliers. For the second problem, we build a relation graph for characters by their co-occurrence information, and then adopt the PageRank algorithm to estimate the Important Factor (IF) of each character. The PageRank IF is fused with the content based retrieval score for final ranking. Extensive experiments are carried out on movies, TV series and home videos. Promising results demonstrate the effectiveness of proposed methods.Keywords
This publication has 10 references indexed in Scilit:
- Robust Head Tracking with Particles Based on Multiple Cues FusionLecture Notes in Computer Science, 2006
- Robust Face Alignment Based on Hierarchical Classifier NetworkLecture Notes in Computer Science, 2006
- Semi-supervised Cast Indexing for Feature-Length FilmsLecture Notes in Computer Science, 2006
- Detection and representation of scenes in videosIEEE Transactions on Multimedia, 2005
- Online Learning of Probabilistic Appearance Manifolds for Video-Based Recognition and TrackingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Face Recognition with Image Sets Using Manifold Density DivergencePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Automatic Face Recognition for Film Character Retrieval in Feature-Length FilmsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Identifying individuals in video by combining 'generative' and discriminative head modelsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Normalized cuts and image segmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000