Independent Component Analysis: A Flexible Nonlinearity and Decorrelating Manifold Approach
- 1 November 1999
- journal article
- Published by MIT Press in Neural Computation
- Vol. 11 (8), 1957-1983
- https://doi.org/10.1162/089976699300016043
Abstract
Independent component analysis (ICA) finds a linear transformation to variables that are maximally statistically independent. We examine ICA and algorithms for finding the best transformation from the point of view of maximizing the likelihood of the data. In particular, we discuss the way in which scaling of the unmixing matrix permits a “static” nonlinearity to adapt to various marginal densities. We demonstrate a new algorithm that uses generalized exponential functions to model the marginal densities and is able to separate densities with light tails. We characterize the manifold of decorrelating matrices and show that it lies along the ridges of high-likelihood unmixing matrices in the space of all unmixing matrices. We show how to find the optimum ICA matrix on the manifold of decorrelating matrices, and as an example we use the algorithm to find independent component basis vectors for an ensemble of portraits.Keywords
This publication has 11 references indexed in Scilit:
- Independent Factor AnalysisNeural Computation, 1999
- Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian SourcesNeural Computation, 1999
- Independent component representations for face recognitionPublished by SPIE-Intl Soc Optical Eng ,1998
- Local feature analysis: a general statistical theory for object representationNetwork: Computation in Neural Systems, 1996
- Blind separation of instantaneous mixture of sources via an independent component analysisIEEE Transactions on Signal Processing, 1996
- An Information-Maximization Approach to Blind Separation and Blind DeconvolutionNeural Computation, 1995
- Simulating the ‘Other-race Effect’ as a Problem in Perceptual LearningConnection Science, 1991
- Application of the Karhunen-Loeve procedure for the characterization of human facesIeee Transactions On Pattern Analysis and Machine Intelligence, 1990
- Distance measures for signal processing and pattern recognitionSignal Processing, 1989
- Low-dimensional procedure for the characterization of human facesJournal of the Optical Society of America A, 1987