Variable Selection for Partially Linear Models With Measurement Errors
- 1 March 2009
- journal article
- Published by Taylor & Francis Ltd in Journal of the American Statistical Association
- Vol. 104 (485), 234-248
- https://doi.org/10.1198/jasa.2009.0127
Abstract
This article focuses on variable selection for partially linear models when the covariates are measured with additive errors. We propose two classes of variable selection procedures, penalized least squares and penalized quantile regression, using the nonconvex penalized principle. The first procedure corrects the bias in the loss function caused by the measurement error by applying the so-called correction-for-attenuation approach, whereas the second procedure corrects the bias by using orthogonal regression. The sampling properties for the two procedures are investigated. The rate of convergence and the asymptotic normality of the resulting estimates are established. We further demonstrate that, with proper choices of the penalty functions and the regularization parameter, the resulting estimates perform asymptotically as well as an oracle procedure as proposed by Fan and Li. Choice of smoothing parameters is also discussed. Finite sample performance of the proposed variable selection procedures is assessed by Monte Carlo simulation studies. We further illustrate the proposed procedures by an application.Keywords
This publication has 33 references indexed in Scilit:
- Sure Independence Screening for Ultrahigh Dimensional Feature SpaceJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- The Dantzig selector: Statistical estimation when p is much larger than nThe Annals of Statistics, 2007
- New Estimation and Model Selection Procedures for Semiparametric Modeling in Longitudinal Data AnalysisJournal of the American Statistical Association, 2004
- Consistent covariate selection and post model selection inference in semiparametric regressionThe Annals of Statistics, 2004
- Two‐stage model selection procedures in partially linear regressionThe Canadian Journal of Statistics / La Revue Canadienne de Statistique, 2004
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle PropertiesJournal of the American Statistical Association, 2001
- A new class of measurement‐error models, with applications to dietary dataThe Canadian Journal of Statistics / La Revue Canadienne de Statistique, 1998
- Heuristics of instability and stabilization in model selectionThe Annals of Statistics, 1996
- The Intrinsic Bayes Factor for Model Selection and PredictionJournal of the American Statistical Association, 1996
- Maximum likelihood identification of Gaussian autoregressive moving average modelsBiometrika, 1973