Content-preserving warps for 3D video stabilization
Top Cited Papers
- 27 July 2009
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 28 (3), 1-9
- https://doi.org/10.1145/1531326.1531350
Abstract
We describe a technique that transforms a video from a hand-held video camera so that it appears as if it were taken with a directed camera motion. Our method adjusts the video to appear as if it were taken from nearby viewpoints, allowing 3D camera movements to be simulated. By aiming only for perceptual plausibility, rather than accurate reconstruction, we are able to develop algorithms that can effectively recreate dynamic scenes from a single source video. Our technique first recovers the original 3D camera motion and a sparse set of 3D, static scene points using an off-the-shelf structure-from-motion system. Then, a desired camera path is computed either automatically (e.g., by fitting a linear or quadratic path) or interactively. Finally, our technique performs a least-squares optimization that computes a spatially-varying warp from each input video frame into an output frame. The warp is computed to both follow the sparse displacements suggested by the recovered 3D structure, and avoid deforming the content in the video frame. Our experiments on stabilizing challenging videos of dynamic scenes demonstrate the effectiveness of our technique.Keywords
Funding Information
- Division of Information and Intelligent Systems (IIS-0416284)
This publication has 23 references indexed in Scilit:
- Optimized scale-and-stretch for image resizingACM Transactions on Graphics, 2008
- Re-cinematographyACM Transactions on Multimedia Computing, Communications, and Applications, 2008
- Improved seam carving for video retargetingACM Transactions on Graphics, 2008
- 3D-modeling by ortho-image generation from image sequencesACM Transactions on Graphics, 2008
- Seam carving for content-aware image resizingACM Transactions on Graphics, 2007
- VideoTraceACM Transactions on Graphics, 2007
- As-rigid-as-possible shape manipulationACM Transactions on Graphics, 2005
- Automatic photo pop-upACM Transactions on Graphics, 2005
- General construction of time-domain filters for orientation dataIEEE Transactions on Visualization and Computer Graphics, 2002
- Through-the-lens camera controlACM SIGGRAPH Computer Graphics, 1992