Constrained utility maximization for generating visual skims
- 14 November 2002
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 124-131
- https://doi.org/10.1109/ivl.2001.990866
Abstract
We present a novel algorithm to generate visual skims that do not contain audio, from computable scenes. Visual skims are useful for browsing digital libraries, and for on-demand summaries in set-top boxes. A computable scene is a chunk of data that exhibits consistencies with respect to chromaticity, lighting and sound. First, we define the visual complexity of a shot to be its Kolmogorov complexity. Then, we conduct experiments that help us map the complexity of a shot into the minimum time required for its comprehension. Second, we analyze the grammar of the film language, since it makes the shot sequence meaningful. We achieve a target skim time by minimizing a sequence utility function. It is subject to shot duration constraints, and penalty functions based on sequence rhythm and information loss. This helps us determine individual shot durations as well as the shots to drop. Our user studies show good results on skims with compression rates up to 80%.Keywords
This publication has 4 references indexed in Scilit:
- Elements of Information TheoryPublished by Wiley ,2001
- Video MangaPublished by Association for Computing Machinery (ACM) ,1999
- An Introduction to Kolmogorov Complexity and Its ApplicationsPublished by Springer Science and Business Media LLC ,1997
- Abstracting Digital Movies AutomaticallyJournal of Visual Communication and Image Representation, 1996