When a Truly Positive Correlation Turns Negative: How Different Approaches to Model Hierarchically Structured Constructs Affect Estimated Correlations to Covariates
- 4 October 2021
- journal article
- research article
- Published by SAGE Publications in European Journal of Personality
- Vol. 37 (1), 95-112
- https://doi.org/10.1177/08902070211050170
Abstract
Many constructs in personality psychology assume a hierarchical structure positing a general factor along with several narrower subdimensions or facets. Different approaches are commonly used to model such a structure, including higher-order factor models, bifactor models, single-factor models based on the responses on the observed items, and single-factor models based on parcels computed from the mean observed scores on the subdimensions. The present article investigates the consequences of adopting a certain approach for the validity of conclusions derived from the thereby obtained correlation of the most general factor to a covariate. Any of the considered approaches may closely approximate the true correlation when its underlying assumptions are met or when model misspecifications only pertain to the measurement model of the hierarchical construct. However, when misspecifications involve nonmodeled covariances between parts of the hierarchically structured construct and the covariate, higher-order models, single-factor representations, and facet-parcel approaches can yield severely biased estimates sometimes grossly misrepresenting the true correlation and even incurring sign changes. In contrast, a bifactor approach proved to be most robust and to provide rather unbiased results under all conditions. The implications are discussed and recommendations are provided.This publication has 57 references indexed in Scilit:
- Why the items versus parcels controversy needn’t be one.Psychological Methods, 2013
- Masking misfit in confirmatory factor analysis by increasing unique variances: A cautionary note on the usefulness of cutoff values of fit indices.Psychological Methods, 2011
- Biases of Parameter Estimates in Misspecified Structural Equation ModelsSociological Methodology, 2011
- Diagnosis for Covariance Structure Models by Analyzing the PathStructural Equation Modeling: A Multidisciplinary Journal, 2008
- Empirical, Theoretical, and Practical Advantages of the HEXACO Model of Personality StructurePersonality and Social Psychology Review, 2007
- Higher-Order Factors in a Five-Factor Personality Inventory and its Relation to Social DesirabilityEuropean Journal of Psychological Assessment, 2007
- Toward an Alternative Representation for Disentangling Age-Associated Differences in General and Specific Cognitive Abilities.Psychology and Aging, 2004
- 8. Assessing the Effect of Model Misspecifications on Parameter Estimates in Structural Equation ModelsSociological Methodology, 2003
- First order or higher order general factor?Structural Equation Modeling: A Multidisciplinary Journal, 1997
- Model modifications in covariance structure analysis: The problem of capitalization on chance.Psychological Bulletin, 1992