Shot-boundary detection: unraveled and resolved?
- 7 August 2002
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 12 (2), 90-105
- https://doi.org/10.1109/76.988656
Abstract
Partitioning a video sequence into shots is the first step toward video-content analysis and content-based video browsing and retrieval. A video shot is defined as a series of interrelated consecutive frames taken contiguously by a single camera and representing a continuous action in time and space. As such, shots are considered to be the primitives for higher level content analysis, indexing, and classification. The objective of this paper is twofold. First, we analyze the shot-boundary detection problem in detail and identify major issues that need to be considered in order to solve this problem successfully. Then, we present a conceptual solution to the shot-boundary detection problem in which all issues identified in the previous step are considered. This solution is provided in the form of a statistical detector that is based on minimization of the average detection-error probability. We model the required statistical functions using a robust metric for visual content discontinuities (based on motion compensation) and take into account all (a priori) knowledge that we found relevant to shot-boundary detection. This knowledge includes the shot-length distribution, visual discontinuity patterns at shot boundaries, and characteristic temporal changes of visual features around a boundary. Major advantages of the proposed detector are its robust and sequence-independent performance, while there is also the possibility to detect different types of shot boundaries simultaneously. We demonstrate the performance of our detector regarding two most widely used types of shot boundaries: hard cuts and dissolves.Keywords
This publication has 21 references indexed in Scilit:
- RELIABLE TRANSITION DETECTION IN VIDEOS: A SURVEY AND PRACTITIONER'S GUIDEInternational Journal of Image and Graphics, 2001
- Statistical models of video structure for content analysis and characterizationIEEE Transactions on Image Processing, 2000
- A Survey of Technologies for Parsing and Indexing Digital Video1Journal of Visual Communication and Image Representation, 1996
- Comparison of video shot boundary detection techniquesPublished by SPIE-Intl Soc Optical Eng ,1996
- Rapid scene analysis on compressed videoIEEE Transactions on Circuits and Systems for Video Technology, 1995
- Feature management for large video databasesPublished by SPIE-Intl Soc Optical Eng ,1993
- Automatic partitioning of full-motion videoMultimedia Systems, 1993
- IMPACTPublished by Association for Computing Machinery (ACM) ,1991
- Image Activity Characteristics in Broadcast TelevisionIEEE Transactions on Communications, 1976
- Statistical Style Analysis of Motion PicturesFilm Quarterly, 1974