A Direct Formulation for Sparse PCA Using Semidefinite Programming
- 1 June 2004
- preprint
- Published by Elsevier BV in SSRN Electronic Journal
Abstract
We examine the problem of approximating, in the Frobenius-norm sense, a positive, semidefinite symmetric matrix by a rank-one matrix, with an upper bound on the cardinality of its eigenvector. The problem arises in the decomposition of a covariance matrix into sparse factors, and has wide applications ranging from biology to finance. We use a modification of the classical variational representation of the largest eigenvalue of a symmetric matrix, where cardinality is constrained, and derive a semidefinite programming based relaxation for our problem. We also discuss Nesterov's smooth minimization technique applied to the SDP arising in the direct sparse PCA method.Keywords
Other Versions
This publication has 14 references indexed in Scilit:
- Sparse Principal Component AnalysisJournal of Computational and Graphical Statistics, 2006
- Smooth minimization of non-smooth functionsMathematical Programming, 2004
- Prox-Method with Rate of Convergence O(1/t) for Variational Inequalities with Lipschitz Continuous Monotone Operators and Smooth Convex-Concave Saddle Point ProblemsSIAM Journal on Optimization, 2004
- A Modified Principal Component Technique Based on the LASSOJournal of Computational and Graphical Statistics, 2003
- Simple Principal ComponentsJournal of the Royal Statistical Society Series C: Applied Statistics, 2000
- Using SeDuMi 1.02, A Matlab toolbox for optimization over symmetric conesOptimization Methods and Software, 1999
- SDPT3 — A Matlab software package for semidefinite programming, Version 1.3Optimization Methods and Software, 1999
- Regression Shrinkage and Selection Via the LassoJournal of the Royal Statistical Society: Series B (Methodological), 1996
- Loading and correlations in the interpretation of principle compenentsJournal of Applied Statistics, 1995
- Rotation of principal components: choice of normalization constraintsJournal of Applied Statistics, 1995