Temporal segmentation of video using frame and histogram space

Abstract

Two algorithms are presented for the detection of gradual transitions in video sequences. The first is a dissolve detection algorithm utilizing certain properties of a dissolve's trajectory in image-space. It is implemented both as a simple threshold-based detector, and as a parametric detector by modeling the error properties of the extracted statistics. The second is an algorithm to detect a wide variety of wipes based on image histogram characteristics during such transitions. Both algorithms operate in the compressed domain, requiring only partial decoding of the compressed video stream. Experiments show the algorithms perform as well as-and in some cases, better than-full-frame methods, on a wide variety of gradual transitions, and can operate significantly faster than real-time.