Bias reduction in exponential family nonlinear models
- 9 November 2009
- journal article
- Published by Oxford University Press (OUP) in Biometrika
- Vol. 96 (4), 793-804
- https://doi.org/10.1093/biomet/asp055
Abstract
In Firth (1993, Biometrika) it was shown how the leading term in the asymptotic bias of the maximum likelihood estimator is removed by adjusting the score vector, and that in canonical-link generalized linear models the method is equivalent to maximizing a penalized likelihood that is easily implemented via iterative adjustment of the data. Here a more general family of bias-reducing adjustments is developed for a broad class of univariate and multivariate generalized nonlinear models. The resulting formulae for the adjusted score vector are computationally convenient, and in univariate models they directly suggest implementation through an iterative scheme of data adjustment. For generalized linear models a necessary and sufficient condition is given for the existence of a penalized likelihood interpretation of the method. An illustrative application to the Goodman row-column association model shows how the computational simplicity and statistical benefits of bias reduction extend beyond generalized linear models.Keywords
This publication has 11 references indexed in Scilit:
- Bias prevention of maximum likelihood estimates for scalar skew normal and skew t distributionsJournal of Statistical Planning and Inference, 2006
- Confidence intervals for multinomial logistic regression in sparse dataStatistics in Medicine, 2006
- A solution to the problem of separation in logistic regressionStatistics in Medicine, 2002
- A modified score function estimator for multinomial logistic regression in small samplesComputational Statistics & Data Analysis, 2002
- Likelihood-Based Methods for Bias Reduction in Limiting Dilution AssaysBiometrics, 1995
- Bias reduction of maximum likelihood estimatesBiometrika, 1993
- Bias in nonlinear regressionBiometrika, 1986
- The Analysis of Cross-Classified Data Having Ordered and/or Unordered Categories: Association Models, Correlation Models, and Asymmetry Models for Contingency Tables With or Without Missing EntriesThe Annals of Statistics, 1985
- Simple Models for the Analysis of Association in Cross-Classifications Having Ordered CategoriesJournal of the American Statistical Association, 1979
- AN INVARIANT FORM FOR THE PRIOR PROBABILITY IN ESTIMATION PROBLEMSProceedings of the Royal Society of London. Series A - Mathematical and Physical Sciences, 1945