Reconstructing Storyline Graphs for Image Recommendation from Web Community Photos
- 1 June 2014
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3882-3889
- https://doi.org/10.1109/cvpr.2014.496
Abstract
In this paper, we investigate an approach for reconstructing storyline graphs from large-scale collections of Internet images, and optionally other side information such as friendship graphs. The storyline graphs can be an effective summary that visualizes various branching narrative structure of events or activities recurring across the input photo sets of a topic class. In order to explore further the usefulness of the storyline graphs, we leverage them to perform the image sequential prediction tasks, from which photo recommendation applications can benefit. We formulate the storyline reconstruction problem as an inference of sparse time-varying directed graphs, and develop an optimization algorithm that successfully addresses a number of key challenges of Web-scale problems, including global optimality, linear complexity, and easy parallelization. With experiments on more than 3.3 millions of images of 24 classes and user studies via Amazon Mechanical Turk, we show that the proposed algorithm improves other candidate methods for both storyline reconstruction and image prediction tasks.Keywords
This publication has 20 references indexed in Scilit:
- Jointly Aligning and Segmenting Multiple Web Photo Streams for the Inference of Collective Photo StorylinesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Supporting personal photo storytelling for social albumsPublished by Association for Computing Machinery (ACM) ,2010
- Connecting the dots between news articlesPublished by Association for Computing Machinery (ACM) ,2010
- Estimating time-varying networksThe Annals of Applied Statistics, 2010
- TV News Story Segmentation Based on Semantic Coherence and Content SimilarityLecture Notes in Computer Science, 2010
- Modeling and Analysis of Dynamic Behaviors of Web Image CollectionsLecture Notes in Computer Science, 2010
- High-dimensional graphs and variable selection with the LassoThe Annals of Statistics, 2006
- Penalized regressions: The bridge versus the lassoJournal of Computational and Graphical Statistics, 1998
- Sparse coding with an overcomplete basis set: A strategy employed by V1?Vision Research, 1997
- Remembrance of things parsed: Story structure and recallCognitive Psychology, 1977