Comparison of exact tests for association in unordered contingency tables using standard, mid-p, and randomized test versions
- 1 June 2005
- journal article
- research article
- Published by Informa UK Limited in Journal of Statistical Computation and Simulation
- Vol. 75 (6), 447-458
- https://doi.org/10.1080/00949650410001729454
Abstract
Pearson’s chi-square (Pe), likelihood ratio (LR), and Fisher (Fi)–Freeman–Halton test statistics are commonly used to test the association of an unordered r×c contingency table. Asymptotically, these test statistics follow a chi-square distribution. For small sample cases, the asymptotic chi-square approximations are unreliable. Therefore, the exact p-value is frequently computed conditional on the row- and column-sums. One drawback of the exact p-value is that it is conservative. Different adjustments have been suggested, such as Lancaster’s mid-p version and randomized tests. In this paper, we have considered 3×2, 2×3, and 3×3 tables and compared the exact power and significance level of these test’s standard, mid-p, and randomized versions. The mid-p and randomized test versions have approximately the same power and higher power than that of the standard test versions. The mid-p type-I error probability seldom exceeds the nominal level. For a given set of parameters, the power of Pe, LR, and Fi differs approximately the same way for standard, mid-p, and randomized test versions. Although there is no general ranking of these tests, in some situations, especially when averaged over the parameter space, Pe and Fi have the same power and slightly higher power than LR. When the sample sizes (i.e., the row sums) are equal, the differences are small, otherwise the observed differences can be 10% or more. In some cases, perhaps characterized by poorly balanced designs, LR has the highest power.Keywords
This publication has 7 references indexed in Scilit:
- Power comparison of two‐sided exact tests for association in 2 × 2 contingency tables using standard, mid p and randomized test versionsStatistics in Medicine, 2003
- Categorical Data AnalysisWiley Series in Probability and Statistics, 2002
- Exact inference for categorical data: recent advances and continuing controversiesStatistics in Medicine, 2001
- Stochastic SimulationWiley Series in Probability and Statistics, 1987
- Exact Tests for 2 × 2 Contingency TablesThe American Statistician, 1986
- Significance Tests in Discrete DistributionsJournal of the American Statistical Association, 1961
- NOTE ON AN EXACT TREATMENT OF CONTINGENCY, GOODNESS OF FIT AND OTHER PROBLEMS OF SIGNIFICANCEBiometrika, 1951