Tensor product space ANOVA models
Open Access
- 1 May 2000
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 28 (3), 734-755
- https://doi.org/10.1214/aos/1015951996
Abstract
To deal with the curse of dimensionality in high-dimensional nonparametric problems, we consider using tensor product space ANOVA models, which extend the popular additive models and are able to capture interactions of any order. The multivariate function is given an ANOVA decomposition, that is, it is expressed as a constant plus the sum of functions of one variable (main effects), plus the sum of functions of two variables (two-factor interactions)and so on. We assume the interactions to be in tensor product spaces.We show in both regression and white noise settings, the optimal rate of convergence for the TPS-ANOVA model is within a log factor of the one-dimensional optimal rate, and that the penalized likelihood estimator in TPS-ANOVA achieves this rate of convergence. The quick optimal rate of the TPS-ANOVA model makes it very preferable in high-dimensional function estimation. Many properties of the tensor product space of Sobolev –Hilbert spaces are also given.Keywords
This publication has 18 references indexed in Scilit:
- Asymptotic equivalence of density estimation and Gaussian white noiseThe Annals of Statistics, 1996
- Asymptotic equivalence of nonparametric regression and white noiseThe Annals of Statistics, 1996
- Smoothing spline ANOVA for exponential families, with application to the Wisconsin Epidemiological Study of Diabetic Retinopathy : the 1994 Neyman Memorial LectureThe Annals of Statistics, 1995
- Nonparametric Estimation in the Cox ModelThe Annals of Statistics, 1993
- Smoothing Spline Density Estimation: TheoryThe Annals of Statistics, 1993
- Interaction Spline Models and Their Convergence RatesThe Annals of Statistics, 1991
- Asymptotic Analysis of Penalized Likelihood and Related EstimatorsThe Annals of Statistics, 1990
- Minimax Risk Over Hyperrectangles, and ImplicationsThe Annals of Statistics, 1990
- Approximation of Method of Regularization EstimatorsThe Annals of Statistics, 1988
- On the Estimation of a Probability Density Function by the Maximum Penalized Likelihood MethodThe Annals of Statistics, 1982