Testing the significance of a correlation with nonnormal data: Comparison of Pearson, Spearman, transformation, and resampling approaches.
Top Cited Papers
- 1 September 2012
- journal article
- research article
- Published by American Psychological Association (APA) in Psychological Methods
- Vol. 17 (3), 399-417
- https://doi.org/10.1037/a0028087
Abstract
It is well known that when data are nonnormally distributed, a test of the significance of Pearson's r may inflate Type I error rates and reduce power. Statistics textbooks and the simulation literature provide several alternatives to Pearson's correlation. However, the relative performance of these alternatives has been unclear. Two simulation studies were conducted to compare 12 methods, including Pearson, Spearman's rank-order, transformation, and resampling approaches. With most sample sizes (n >= 20), Type I and Type II error rates were minimized by transforming the data to a normal shape prior to assessing the Pearson correlation. Among transformation approaches, a general purpose rank-based inverse normal transformation (i.e., transformation to rankit scores) was most beneficial. However, when samples were both small (n <= 10) and extremely nonnormal, the permutation test often outperformed other alternatives, including various bootstrap tests.Keywords
This publication has 9 references indexed in Scilit:
- The future of psychology practice and science.American Psychologist, 2010
- Rank-Based Inverse Normal Transformations are Increasingly Used, But are They Merited?Behavior Genetics, 2009
- Similar processes despite divergent behavior in two commonly used measures of risky decision makingJournal of Behavioral Decision Making, 2009
- Simulating Multivariate Nonnormal Data Using an Iterative AlgorithmMultivariate Behavioral Research, 2008
- So Many Correlated Tests, So Little Time! Rapid Adjustment of P Values for Multiple Correlated TestsAmerican Journal of Human Genetics, 2007
- Bootstrapping to test for nonzero population correlation coefficients using univariate sampling.Psychological Methods, 2007
- Permutation MethodsPublished by Springer Science and Business Media LLC ,2007
- Detecting Trends Using Spearman's Rank Correlation CoefficientEnvironmental Forensics, 2001
- Data transformation, Type I error rate and powerBritish Journal of Mathematical and Statistical Psychology, 1989