The Effect of Labeling and Numbering of Response Scales on the Likelihood of Response Bias
Open Access
- 14 January 2014
- journal article
- research article
- Published by SAGE Publications in Sociological Methodology
- Vol. 44 (1), 369-399
- https://doi.org/10.1177/0081175013516114
Abstract
Extreme response style (ERS) and acquiescence response style (ARS) are among the most encountered problems in attitudinal research. The authors investigate whether the response bias caused by these response styles varies with following three aspects of question format: full versus end labeling, numbering answer categories, and bipolar versus agreement response scales. A questionnaire was distributed to a random sample of 5,351 respondents from the Longitudinal Internet Studies for the Social Sciences household panel, of which a subsample was assigned to one of five conditions. The authors apply a latent class factor model that allows for diagnosing and correcting for ERS and ARS simultaneously. The results show clearly that both response styles are present in the data set, but ARS is less pronounced than ERS. With regard to format effects, the authors find that end labeling evokes more ERS than full labeling and that bipolar scales evoke more ERS than agreement style scales. With full labeling, ERS opposes opting for middle response categories, whereas end labeling distinguishes ERS from all other response categories. ARS did not significantly differ depending on test conditions.Keywords
This publication has 38 references indexed in Scilit:
- Four layouts and a finding: the effects of changes in the order of the verbal labels and numerical values on Likert‐type scalesInternational Journal of Social Research Methodology, 2010
- Testing the Stability of an Acquiescence Style Factor Behind Two Interrelated Substantive Variables in a Panel DesignSociological Methods & Research, 2008
- Reliability and validity of egocentered network data collected via web: A meta-analysis of multilevel multitrait multimethod studiesSocial Networks, 2006
- An Investigation Into the Factors Influencing Extreme-Response StyleEducational and Psychological Measurement, 2006
- Modeling Acquiescence in Measurement Models for Two Balanced Sets of ItemsStructural Equation Modeling: A Multidisciplinary Journal, 2000
- New Trends in Measuring Environmental Attitudes: Measuring Endorsement of the New Ecological Paradigm: A Revised NEP ScaleJournal of Social Issues, 2000
- Measuring Extreme Response StylePublic Opinion Quarterly, 1992
- Response-Order Effects in Likert-Type ScalesEducational and Psychological Measurement, 1991
- Construct Validity and Error Components of Survey Measures: A Structural Modeling ApproachPublic Opinion Quarterly, 1984
- A comparison of the behaviorally anchored rating and mixed standard scale formats.Journal of Applied Psychology, 1980