Generalized Low-Rank Approximations of Matrices Revisited
- 17 February 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 21 (4), 621-632
- https://doi.org/10.1109/tnn.2010.2040290
Abstract
Compared to singular value decomposition (SVD), generalized low-rank approximations of matrices (GLRAM) can consume less computation time, obtain higher compression ratio, and yield competitive classification performance. GLRAM has been successfully applied to applications such as image compression and retrieval, and quite a few extensions have been successively proposed. However, in literature, some basic properties and crucial problems with regard to GLRAM have not been explored or solved yet. For this sake, we revisit GLRAM in this paper. First, we reveal such a close relationship between GLRAM and SVD that GLRAM's objective function is identical to SVD's objective function except the imposed constraints. Second, we derive a lower bound of GLRAM's objective function, and discuss when the lower bound can be touched. Moreover, from the viewpoint of minimizing the lower bound, we answer one open problem raised by Ye (Machine Learning, 2005), i.e., a theoretical justification of the experimental phenomenon that, under given number of reduced dimension, the lowest reconstruction error is obtained when the left and right transformations have equal number of columns. Third, we explore when and why GLRAM can perform well in terms of compression, which is a fundamental problem concerning the usability of GLRAM.Keywords
This publication has 23 references indexed in Scilit:
- Fractional order singular value decomposition representation for face recognitionPattern Recognition, 2008
- DSVD: A Tensor-Based Image Compression and Recognition MethodPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- 2-Dimensional Singular Value Decomposition for 2D Maps and ImagesPublished by Society for Industrial & Applied Mathematics (SIAM) ,2005
- Representing Image Matrices: Eigenimages Versus EigenvectorsLecture Notes in Computer Science, 2005
- Fast monte-carlo algorithms for finding low-rank approximationsJournal of the ACM, 2004
- Two-dimensional pca: a new approach to appearance-based face representation and recognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Generalized low rank approximations of matricesPublished by Association for Computing Machinery (ACM) ,2004
- Fast computation of low rank matrix approximationsPublished by Association for Computing Machinery (ACM) ,2001
- A Multilinear Singular Value DecompositionSIAM Journal on Matrix Analysis and Applications, 2000
- The FERET database and evaluation procedure for face-recognition algorithmsImage and Vision Computing, 1998