A group bridge approach for variable selection
Top Cited Papers
Open Access
- 1 June 2009
- journal article
- research article
- Published by Oxford University Press (OUP) in Biometrika
- Vol. 96 (2), 339-355
- https://doi.org/10.1093/biomet/asp020
Abstract
In multiple regression problems when covariates can be naturally grouped, it is important to carry out feature selection at the group and within-group individual variable levels simultaneously. The existing methods, including the lasso and group lasso, are designed for either variable selection or group selection, but not for both. We propose a group bridge approach that is capable of simultaneous selection at both the group and within-group individual variable levels. The proposed approach is a penalized regularization method that uses a specially designed group bridge penalty. It has the oracle group selection property, in that it can correctly select important groups with probability converging to one. In contrast, the group lasso and group least angle regression methods in general do not possess such an oracle property in group selection. Simulation studies indicate that the group bridge has superior performance in group and individual variable selection relative to several existing methods.Keywords
Funding Information
- U.S. National Institutes of Health
- National Science Foundation
- National Security Agency
- NIH
This publication has 19 references indexed in Scilit:
- Asymptotic properties of bridge estimators in sparse high-dimensional regression modelsThe Annals of Statistics, 2008
- Clustering threshold gradient descent regularization: with applications to microarray studiesBioinformatics, 2006
- Component selection and smoothing in multivariate nonparametric regressionThe Annals of Statistics, 2006
- Variable selection using MM algorithmsThe Annals of Statistics, 2005
- Nonconcave penalized likelihood with a diverging number of parametersThe Annals of Statistics, 2004
- Least angle regressionThe Annals of Statistics, 2004
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle PropertiesJournal of the American Statistical Association, 2001
- Asymptotics for lasso-type estimatorsThe Annals of Statistics, 2000
- A Statistical View of Some Chemometrics Regression ToolsTechnometrics, 1993
- Cube Root AsymptoticsThe Annals of Statistics, 1990