Video summarization by learning submodular mixtures of objectives
Top Cited Papers
- 1 June 2015
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3090-3098
- https://doi.org/10.1109/cvpr.2015.7298928
Abstract
We present a novel method for summarizing raw, casually captured videos. The objective is to create a short summary that still conveys the story. It should thus be both, interesting and representative for the input video. Previous methods often used simplified assumptions and only optimized for one of these goals. Alternatively, they used handdefined objectives that were optimized sequentially by making consecutive hard decisions. This limits their use to a particular setting. Instead, we introduce a new method that (i) uses a supervised approach in order to learn the importance of global characteristics of a summary and (ii) jointly optimizes for multiple objectives and thus creates summaries that posses multiple properties of a good summary. Experiments on two challenging and very diverse datasets demonstrate the effectiveness of our method, where we outperform or match current state-of-the-art.Keywords
This publication has 23 references indexed in Scilit:
- First-person hyper-lapse videosACM Transactions on Graphics, 2014
- Quasi Real-Time Summarization for Consumer VideosPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2014
- Joint Summarization of Large-Scale Collections of Web Images and Videos for Storyline ReconstructionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2014
- What makes an image popular?Published by Association for Computing Machinery (ACM) ,2014
- Salient Montages from Unconstrained VideosLecture Notes in Computer Science, 2014
- Large-Scale Video Summarization Using Web-Image PriorsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Nonchronological Video Synopsis and IndexingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Video abstraction: A systematic review and classificationACM Transactions on Multimedia Computing, Communications, and Applications, 2007
- Scene Summarization for Online Image CollectionsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Key frame selection by motion analysisPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002