Choosing the optimal hybrid covariance estimators in adaptive elastic net regression models using information complexity
- 28 July 2019
- journal article
- research article
- Published by Taylor & Francis Ltd in Journal of Statistical Computation and Simulation
- Vol. 89 (16), 2983-2996
- https://doi.org/10.1080/00949655.2019.1647431
Abstract
Elastic net (EN) is a regularization technique which is used for modelling and variable selection with high-dimensional data at the same time. In the literature, it is claimed that EN modelling can be used for undersized samples with high dimensions (i.e. ). But, both the model matrix and the Gram matrix are not of full rank and the inverse of the Gram matrix cannot be calculated. It degenerates and becomes singular. To overcome this problem in EN modelling, Mohebbi et. al. [A new data adaptive elastic net predictive model using hybridized smoothed covariance estimators with information complexity. J Stat Comput Simul. 2019;89(6):1060–1089] purposed a new adaptive elastic net (AEN) modelling using hybrid covariance estimators (HCEs) and information complexity (ICOMP) criteria. There are several forms of HCEs which can be used in AEN regression modelling. Thus, how to decide which HCEs is appropriate is an important problem to be solved. In this paper, we study the performance of the AEN models under several different HCEs using the ICOMP criterion for both the implementation of experimental data and Monte Carlo simulation study with different scenarios of the protocol.
Keywords
This publication has 21 references indexed in Scilit:
- Probabilistic principal component analysis for metabolomic dataBMC Bioinformatics, 2010
- Nonlinear dimensionality reduction of gene expression data for visualization and clustering analysis of cancer tissue samplesComputers in Biology and Medicine, 2010
- Reducing microarray data via nonnegative matrix factorization for visualization and clustering analysisJournal of Biomedical Informatics, 2008
- Geometric Representation of High Dimension, Low Sample Size DataJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- A well-conditioned estimator for large-dimensional covariance matricesJournal of Multivariate Analysis, 2004
- Cancer classification using gene expression dataInformation Systems, 2003
- Informational complexity criteria for regression modelsComputational Statistics & Data Analysis, 1998
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- Ridge Regression: Biased Estimation for Nonorthogonal ProblemsTechnometrics, 1970