Sparse Discriminant Analysis
Top Cited Papers
- 1 November 2011
- journal article
- Published by Taylor & Francis Ltd in Technometrics
- Vol. 53 (4), 406-413
- https://doi.org/10.1198/tech.2011.08118
Abstract
We consider the problem of performing interpretable classification in the high-dimensional setting, in which the number of features is very large and the number of observations is limited. This setting has been studied extensively in the chemometrics literature, and more recently has become commonplace in biological and medical applications. In this setting, a traditional approach involves performing feature selection before classification. We propose sparse discriminant analysis, a method for performing linear discriminant analysis with a sparseness criterion imposed such that classification and feature selection are performed simultaneously. Sparse discriminant analysis is based on the optimal scoring interpretation of linear discriminant analysis, and can be extended to perform sparse discrimination via mixtures of Gaussians if boundaries between classes are nonlinear or if subgroups are present within each class. Our proposal also provides low-dimensional views of the discriminative directions.Keywords
This publication has 21 references indexed in Scilit:
- Sparse Partial Least Squares Regression for Simultaneous Dimension Reduction and Variable SelectionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2010
- Interpretable Classifiers for fMRI Improve Prediction of PurchasesIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2008
- Pathwise coordinate optimizationThe Annals of Applied Statistics, 2007
- A method for comparison of growth media in objective identification of Penicillium based on multi-spectral imagingJournal of Microbiological Methods, 2007
- Regularized linear discriminant analysis and its application in microarraysBiostatistics, 2006
- Some theory for Fisher's linear discriminant function, `naive Bayes', and some alternatives when there are many more variables than observationsBernoulli, 2004
- Least angle regressionThe Annals of Statistics, 2004
- Partial least squares for discriminationJournal of Chemometrics, 2003
- Empirical Bayes Analysis of a Microarray ExperimentJournal of the American Statistical Association, 2001
- Regularized Discriminant AnalysisJournal of the American Statistical Association, 1989