A survey of image registration techniques
- 1 December 1992
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 24 (4), 325-376
- https://doi.org/10.1145/146370.146374
Abstract
Registration is a fundamental task in image processing used to match two or more pictures taken, for example, at different times, from different sensors, or from different viewpoints. Virtually all large systems which evaluate images require the registration of images, or a closely related operation, as an intermediate step. Specific examples of systems where image registration is a significant component include matching a target with a real-time image of a scene for target recognition, monitoring global land usage using satellite images, matching stereo images to recover shape for autonomous navigation, and aligning images from different medical modalities for diagnosis. Over the years, a broad range of techniques has been developed for various types of data and problems. These techniques have been independently studied for several different applications, resulting in a large body of research. This paper organizes this material by establishing the relationship between the variations in the images and the type of registration techniques which can most appropriately be applied. Three major types of variations are distinguished. The first type are the variations due to the differences in acquisition which cause the images to be misaligned. To register images, a spatial transformation is found which will remove these variations. The class of transformations which must be searched to find the optimal transformation is determined by knowledge about the variations of this type. The transformation class in turn influences the general technique that should be taken. The second type of variations are those which are also due to differences in acquisition, but cannot be modeled easily such as lighting and atmospheric conditions. This type usually effects intensity values, but they may also be spatial, such as perspective distortions. The third type of variations are differences in the images that are of interest such as object movements, growths, or other scene changes. Variations of the second and third type are not directly removed by registration, but they make registration more difficult since an exact match is no longer possible. In particular, it is critical that variations of the third type are not removed. Knowledge about the characteristics of each type of variation effect the choice of feature space, similarity measure, search space, and search strategy which will make up the final technique. All registration techniques can be viewed as different combinations of these choices. This framework is useful for understanding the merits and relationships between the wide variety of existing techniques and for assisting in the selection of the most suitable technique for a specific problem.Keywords
This publication has 52 references indexed in Scilit:
- Computational strategies for object recognitionACM Computing Surveys, 1992
- An adaptive method for image registrationPattern Recognition, 1992
- Automated registration of dissimilar images: Application to medical imageryComputer Vision, Graphics, and Image Processing, 1989
- Multiresolution elastic matchingComputer Vision, Graphics, and Image Processing, 1989
- Image registration by local approximation methodsImage and Vision Computing, 1988
- Piecewise cubic mapping functions for image registrationPattern Recognition, 1987
- Improving dynamic programming to solve image registrationPattern Recognition, 1987
- A new class of similarity measures for robust image registrationComputer Vision, Graphics, and Image Processing, 1984
- Contour registration by shape-specific points for shape matchingComputer Vision, Graphics, and Image Processing, 1983
- Hierarchical generalized Hough transforms and line-segment based generalized Hough transformsPattern Recognition, 1982