Secrets of optical flow estimation and their principles
Top Cited Papers
- 1 June 2010
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2432-2439
- https://doi.org/10.1109/cvpr.2010.5539939
Abstract
The accuracy of optical flow estimation algorithms has been improving steadily as evidenced by results on the Middlebury optical flow benchmark. The typical formulation, however, has changed little since the work of Horn and Schunck. We attempt to uncover what has made recent advances possible through a thorough analysis of how the objective function, the optimization method, and modern implementation practices influence accuracy. We discover that “classical” flow formulations perform surprisingly well when combined with modern optimization and implementation techniques. Moreover, we find that while median filtering of intermediate flow fields during optimization is a key to recent performance gains, it leads to higher energy solutions. To understand the principles behind this phenomenon, we derive a new objective that formalizes the median filtering heuristic. This objective includes a nonlocal term that robustly integrates flow estimates over large spatial neighborhoods. By modifying this new term to include information about flow and image boundaries we develop a method that ranks at the top of the Middlebury benchmark.Keywords
This publication has 21 references indexed in Scilit:
- A new median formula with applications to PDE based denoisingCommunications in Mathematical Sciences, 2009
- Nonlocal Operators with Applications to Image ProcessingMultiscale Modeling & Simulation, 2009
- Particle Video: Long-Range Motion Estimation Using Point TrajectoriesInternational Journal of Computer Vision, 2008
- Lucas/Kanade Meets Horn/Schunck: Combining Local and Global Optic Flow MethodsInternational Journal of Computer Vision, 2005
- Estimating optical flow in segmented images using variable-order parametric models with local deformationsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1996
- The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow FieldsComputer Vision and Image Understanding, 1996
- Performance of optical flow techniquesInternational Journal of Computer Vision, 1994
- Nonlinear total variation based noise removal algorithmsPhysica D: Nonlinear Phenomena, 1992
- Cubic convolution interpolation for digital image processingIEEE Transactions on Acoustics, Speech, and Signal Processing, 1981
- DETERMINING OPTICAL-FLOWArtificial Intelligence, 1980