Improving Data Analysis in Second Language Acquisition by Utilizing Modern Developments in Applied Statistics
- 16 October 2009
- journal article
- Published by Oxford University Press (OUP) in Applied Linguistics
- Vol. 31 (3), 368-390
- https://doi.org/10.1093/applin/amp038
Abstract
In this article we introduce language acquisition researchers to two broad areas of applied statistics that can improve the way data are analyzed. First we argue that visual summaries of information are as vital as numerical ones, and suggest ways to improve them. Specifically, we recommend choosing boxplots over barplots and adding locally weighted smooth lines (Loess lines) to scatterplots. Second, we introduce the reader to robust statistics, a tool that can provide a way to use the power of parametric statistics without having to rely on the assumption of a normal distribution; robust statistics incorporate advances made in applied statistics in the last 40 years. Such types of analyses have only recently become feasible for the non-statistician practitioner as the methods are computer-intensive. We acquaint the reader with trimmed means and bootstrapping, procedures from the robust statistics arsenal which are used to make data more robust to deviations from normality. We show examples of how analyses can change when robust statistics are used. Robust statistics have been shown to be nearly as powerful and accurate as parametric statistics when data are normally distributed, and many times more powerful and accurate when data are non-normal.Keywords
This publication has 30 references indexed in Scilit:
- Adaptive robust estimation and testingBritish Journal of Mathematical and Statistical Psychology, 2007
- Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling MethodsMultivariate Behavioral Research, 2004
- THE ROBUSTNESS OF CRITICAL PERIOD EFFECTS IN SECOND LANGUAGE ACQUISITIONStudies in Second Language Acquisition, 2000
- Testing Repeated Measures Hypotheses When Covariance Matrices are Heterogeneous: Revisiting the Robustness of the Welch-James Test AgainEducational and Psychological Measurement, 2000
- Current Trends in Research Methodology and Statistics in Applied LinguisticsTESOL Quarterly, 2000
- Introduction to Robust Estimation and Hypothesis TestingJournal of the American Statistical Association, 1998
- ANOVA: A Paradigm for Low Power and Misleading Measures of Effect Size?Review of Educational Research, 1995
- The two-sample trimmed t for unequal population variancesBiometrika, 1974
- The approximate behaviour and performance of the two-sample trimmed tBiometrika, 1973
- THE PROBABLE ERROR OF A MEANBiometrika, 1908