Why Permutation Tests are Superior totandFTests in Biomedical Research
- 1 May 1998
- journal article
- research article
- Published by Taylor & Francis Ltd in The American Statistician
- Vol. 52 (2), 127-132
- https://doi.org/10.1080/00031305.1998.10480551
Abstract
A survey of 252 prospective, comparative studies reported in five, frequently cited biomedical journals revealed that experimental groups were constructed by randomization in 96% of cases and by random sampling in only 4%. The median group sizes ranged from 4 to 12. In the randomized studies in which measurements were made on a continuous scale, comparisons of location were made by t or F tests in 84% of cases, and by nonparametric, rank-order, tests in the remainder. Because randomization rather than random sampling is the norm in biomedical research and because group sizes are usually small, exact permutation or randomization tests for differences in location should be preferred to t or F tests.Keywords
This publication has 16 references indexed in Scilit:
- The Wilcoxon-Mann-Whitney test condemnedBritish Journal of Surgery, 1996
- ADVANTAGES OF PERMUTATION (RANDOMIZATION) TESTS IN CLINICAL AND EXPERIMENTAL PHARMACOLOGY AND PHYSIOLOGYClinical and Experimental Pharmacology and Physiology, 1994
- On the Behavior of Randomization Tests without a Group Invariance AssumptionJournal of the American Statistical Association, 1990
- The Fisher‐Pitman permutation test: A non‐robust alternative to the normal theory F test when variances are heterogeneousBritish Journal of Mathematical and Statistical Psychology, 1987
- Robust Rank Procedures for the Behrens-Fisher ProblemJournal of the American Statistical Association, 1981
- Individual Comparisons by Ranking MethodsBiometrics Bulletin, 1945
- ON THE z-TEST IN RANDOMIZED BLOCKS AND LATIN SQUARESBiometrika, 1937
- On the Two Different Aspects of the Representative Method: The Method of Stratified Sampling and the Method of Purposive SelectionJournal of the Royal Statistical Society, 1934
- The testing of statistical hypotheses in relation to probabilities a prioriMathematical Proceedings of the Cambridge Philosophical Society, 1933
- On the validity of Fisher'sztest when applied to an actual example of non-normal data. (With five text-figures.)The Journal of Agricultural Science, 1933