Comparison of Three Meta-Analytic Procedures for Estimating Moderating Effects of Categorical Variables
- 23 July 2007
- journal article
- research article
- Published by SAGE Publications in Organizational Research Methods
- Vol. 11 (1), 9-34
- https://doi.org/10.1177/1094428106292896
Abstract
The authors conducted Monte Carlo simulations to compare the Hedges and Olkin, the Hunter and Schmidt, and a refinement of the Aguinis and Pierce meta-analytic approaches for estimating moderating effects of categorical variables. The simulation examined binary moderator variables (e.g., gender—male, female; ethnicity—majority, minority). The authors compared the three meta-analytic methods in terms of their point estimation accuracy and Type I and Type II error rates. Results provide guidelines to help researchers choose among the three meta-analytic techniques based on theory (i.e., exploratory vs. confirmatory research) and research design considerations (i.e., degree of range restriction and measurement error).Keywords
This publication has 40 references indexed in Scilit:
- Effect Size and Power in Assessing Moderating Effects of Categorical Variables Using Multiple Regression: A 30-Year Review.Journal of Applied Psychology, 2005
- Searching for the Inverted U-Shaped Relationship Between Time and Performance: Meta-Analyses of the Experience/Performance, Tenure/Performance, and Age/Performance RelationshipsJournal of Management, 2003
- The power of statistical tests in meta-analysis.Psychological Methods, 2001
- Testing Moderator Variable Hypotheses Meta-AnalyticallyJournal of Management, 1998
- On the robustness, bias, and stability of statistics from meta-analysis of correlation coefficients: Some initial Monte Carlo findings.Journal of Applied Psychology, 1998
- Moderator Search in Meta-Analysis: A Review and Cautionary Note on Existing ApproachesEducational and Psychological Measurement, 1998
- Testing for Dichotomous Moderators in Meta-AnalysisThe Journal of Experimental Education, 1998
- Why Meta-Analysis Doesn’t Tell Us What the Data Really Mean: Distinguishing between Moderator Effects and Moderator ProcessesJournal of Management, 1995
- Testing for moderator variables in meta‐analysis: Issues and methodsCommunication Monographs, 1991
- On seeking moderator variables in the meta-analysis of correlational data: A Monte Carlo investigation of statistical power and resistance to Type I error.Journal of Applied Psychology, 1986