Chi‐squared and Fisher–Irwin tests of two‐by‐two tables with small sample recommendations
- 21 February 2007
- journal article
- Published by Wiley in Statistics in Medicine
- Vol. 26 (19), 3661-3675
- https://doi.org/10.1002/sim.2832
Abstract
Two‐by‐two tables commonly arise in comparative trials and cross‐sectional studies. In medical studies, two‐by‐two tables may have a small sample size due to the rarity of a condition, or to limited resources. Current recommendations on the appropriate statistical test mostly specify the chi‐squared test for tables where the minimum expected number is at least 5 (following Fisher and Cochran), and otherwise the Fisher–Irwin test; but there is disagreement on which versions of the chi‐squared and Fisher–Irwin tests should be used. A further uncertainty is that, according to Cochran, the number 5 was chosen arbitrarily. Computer‐intensive techniques were used in this study to compare seven two‐sided tests of two‐by‐two tables in terms of their Type I errors. The tests were K. Pearson's and Yates's chi‐squared tests and the ‘N−1’ chi‐squared test (first proposed by E. Pearson), together with four versions of the Fisher–Irwin test (including two mid‐P versions). The optimum test policy was found to be analysis by the ‘N−1’ chi‐squared test when the minimum expected number is at least 1, and otherwise, by the Fisher–Irwin test by Irwin's rule (taking the total probability of tables in either tail that are as likely as, or less likely than the one observed). This policy was found to have increased power compared to Cochran's recommendations. Copyright © 2007 John Wiley & Sons, Ltd.Keywords
This publication has 39 references indexed in Scilit:
- Exact Properties of Some Exact Test Statistics for Comparing Two Binomial ProportionsJournal of the American Statistical Association, 1990
- An exact unconditional test for the 2 × 2 comparative trial.Psychological Bulletin, 1986
- Comparing two independent binomial proportions by a modified chi square testBiometrical Journal, 1980
- Applicability of chi-square to 2 × 2 contingency tables with small expected cell frequencies.Psychological Bulletin, 1978
- An Investigation of the Restraints with Respect to Sample Size Commonly Imposed on the Use of the Chi-Square StatisticJournal of the American Statistical Association, 1971
- A Role of Time-Sharing Computing in Statistical ResearchThe American Statistician, 1968
- 2 × 2 Tables. A Note on E. S. Pearson's PaperBiometrika, 1947
- The Choice of Statistical Tests Illustrated on the Interpretation of Data Classed in a 2 × 2 TableBiometrika, 1947
- Significance Tests for 2 × 2 TablesBiometrika, 1947
- On the Interpretation of χ 2 from Contingency Tables, and the Calculation of PJournal of the Royal Statistical Society, 1922