An Examination of Different Scale Usage Correction Procedures to Enhance Cross-Cultural Data Comparability
- 13 October 2020
- journal article
- research article
- Published by SAGE Publications in Journal of Cross-Cultural Psychology
- Vol. 51 (10), 794-813
- https://doi.org/10.1177/0022022120960815
Abstract
This study aims to examine different scale usage correction procedures that are meant to enhance the cross-cultural comparability of Likert scale data. Specifically, we examined a priori study design (i.e., anchoring vignettes and overclaiming) and post hoc statistical procedures (i.e., ipsatization and extreme response style correction) in data from the 2012 Programme for International Student Assessment across 64 countries. We analyzed both original item responses and corrected item scores from two targeted scales in an integrative fashion by using multilevel confirmatory factor analysis and multilevel regressions. Results indicate that mean levels and structural relations varied across the correction procedures, although the psychological meaning of the constructs examined did not change. Furthermore, scores were least affected by these procedures for females who did not repeat a grade and students with higher math achievement. We discuss the implications of our findings and offer recommendations for researchers who are considering scale usage correction procedures.Keywords
Funding Information
- H2020 Marie Skłodowska-Curie Actions (748788)
This publication has 35 references indexed in Scilit:
- Global self-esteem and method effects: Competing factor structures, longitudinal invariance, and response styles in adolescentsBehavior Research Methods, 2013
- Correcting Big Five Personality Measurements for Acquiescence: An 18–Country Cross–Cultural StudyEuropean Journal of Personality, 2013
- Teacher Support, Motivation, Learning Strategy Use, and Achievement: A Multilevel Mediation ModelThe Journal of Experimental Education, 2012
- A misleading review of response bias: Comment on McGrath, Mitchell, Kim, and Hough (2010).Psychological Bulletin, 2011
- Testing for Measurement and Structural Equivalence in Large-Scale Cross-Cultural Studies: Addressing the Issue of NonequivalenceInternational Journal of Testing, 2010
- Improving Anchoring Vignettes: Designing Surveys to Correct Interpersonal IncomparabilityPublic Opinion Quarterly, 2010
- International Large-Scale Assessment DataEducational Researcher, 2010
- Social competence, social support, and academic achievement in minority, low-income, urban elementary school children.School Psychology Quarterly, 2008
- Standardization to Account for Cross-Cultural Response BiasJournal of Cross-Cultural Psychology, 2004
- The over-claiming technique: Measuring self-enhancement independent of ability.Journal of Personality and Social Psychology, 2003