Power analysis for generalized linear mixed models in ecology and evolution
Open Access
- 6 December 2014
- journal article
- research article
- Published by Wiley in Methods in Ecology and Evolution
- Vol. 6 (2), 133-142
- https://doi.org/10.1111/2041-210x.12306
Abstract
Will my study answer my research question?' is the most fundamental question a researcher can ask when designing a study, yet when phrased in statistical terms - What is the power of my study?' or How precise will my parameter estimate be?' - few researchers in ecology and evolution (EE) try to answer it, despite the detrimental consequences of performing under- or over-powered research. We suggest that this reluctance is due in large part to the unsuitability of simple methods of power analysis (broadly defined as any attempt to quantify prospectively the informativeness' of a study) for the complex models commonly used in EE research. With the aim of encouraging the use of power analysis, we present simulation from generalized linear mixed models (GLMMs) as a flexible and accessible approach to power analysis that can account for random effects, overdispersion and diverse response distributions. We illustrate the benefits of simulation-based power analysis in two research scenarios: estimating the precision of a survey to estimate tick burdens on grouse chicks and estimating the power of a trial to compare the efficacy of insecticide-treated nets in malaria mosquito control. We provide a freely available R function, sim.glmm, for simulating from GLMMs. Analysis of simulated data revealed that the effects of accounting for realistic levels of random effects and overdispersion on power and precision estimates were substantial, with correspondingly severe implications for study design in the form of up to fivefold increases in sampling effort. We also show the utility of simulations for identifying scenarios where GLMM-fitting methods can perform poorly. These results illustrate the inadequacy of standard analytical power analysis methods and the flexibility of simulation-based power analysis for GLMMs. The wider use of these methods should contribute to improving the quality of study design in EE.Keywords
Funding Information
- European Union Seventh Framework Programme FP7 (265660)
This publication has 32 references indexed in Scilit:
- Understanding The New StatisticsPublished by Informa UK Limited ,2013
- Random effects structure for confirmatory hypothesis testing: Keep it maximalJournal of Memory and Language, 2013
- Generalized linear mixed models: a practical guide for ecology and evolutionTrends in Ecology & Evolution, 2009
- Ecological Models and Data in RPublished by JSTOR ,2008
- How much power is enough? Against the development of an arbitrary convention for statistical power calculationsFunctional Ecology, 2003
- Analysis of aggregation, a worked example: numbers of ticks on red grouse chicksParasitology, 2001
- Kullback-Leibler information as a basis for strong inference in ecological studiesWildlife Research, 2001
- Appraising Variability in Population StudiesThe Journal of Wildlife Management, 1978
- Beta-Binomial Anova for ProportionsJournal of the Royal Statistical Society Series C: Applied Statistics, 1978
- Fitting the Negative Binomial Distribution to Biological DataBiometrics, 1953