Closed-form connectivity-preserving solutions for motion compensation using 2-D meshes
- 1 September 1997
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 6 (9), 1255-1269
- https://doi.org/10.1109/83.623189
Abstract
Motion compensation using two-dimensional (2-D) mesh models requires computation of the parameters of a spatial transformation for each mesh element (patch). It is well known that the parameters of an affine (bilinear or perspective) mapping can be uniquely estimated from three (four) point correspondences (at the vertices of a triangular or quadrilateral mesh element). On the other hand, overdetermined solutions using more than the required minimum number of point correspondences provide increased robustness against correspondence-estimation errors, however, this necessitates special consideration to preserve mesh-connectivity. This paper presents closed-form, overdetermined solutions for least squares estimation of affine motion parameters for a triangular mesh, which preserve mesh-connectivity using patch-based or node-based connectivity constraints. In particular, four new algorithms are presented: patch-constrained methods using point correspondences or spatio-temporal intensity gradients, and node-constrained methods using point correspondences or spatio-temporal intensity gradients. The methods using point correspondences can be viewed as postprocessing of a dense motion field for best representation in terms of a set of irregularly spaced samples. The methods that are based on spatio-temporal intensity gradients offer closed-form solutions for direct estimation of the best node-point motion vectors (equivalently the best transformation parameters). We show that the performance of the proposed closed-form solutions are comparable to those of the alternative search-based solutions at a fraction of the computational cost.Keywords
This publication has 13 references indexed in Scilit:
- Two-dimensional object-based coding using a content-based mesh and affine motion parameterizationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Object-Scalable Content-Based 2-D Mesh Design for Object-Based Video CodingPublished by Springer Science and Business Media LLC ,1996
- A new motion compensation method for image sequence coding using hierarchical grid interpolationIEEE Transactions on Circuits and Systems for Video Technology, 1994
- Overlapped block motion compensation: an estimation-theoretic approachIEEE Transactions on Image Processing, 1994
- Representing moving images with layersIEEE Transactions on Image Processing, 1994
- General approach to block-matching motion estimationOptical Engineering, 1993
- An adaptive method for image registrationPattern Recognition, 1992
- Motion compensation for video compression using control grid interpolationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1991
- Model-based analysis synthesis image coding (MBASIC) system for a person's faceSignal Processing: Image Communication, 1989
- Determining optical flowArtificial Intelligence, 1981