Lies, Damned Lies, and Survey Self-Reports? Identity as a Cause of Measurement Bias
- 18 November 2016
- journal article
- research article
- Published by SAGE Publications in Social Psychology Quarterly
- Vol. 79 (4), 333-354
- https://doi.org/10.1177/0190272516628298
Abstract
Explanations of error in survey self-reports have focused on social desirability: that respondents answer questions about normative behavior to appear prosocial to interviewers. However, this paradigm fails to explain why bias occurs even in self-administered modes like mail and web surveys. We offer an alternative explanation rooted in identity theory that focuses on measurement directiveness as a cause of bias. After completing questions about physical exercise on a web survey, respondents completed a text message–based reporting procedure, sending updates on their major activities for five days. Random assignment was then made to one of two conditions: instructions mentioned the focus of the study, physical exercise, or not. Survey responses, text updates, and records from recreation facilities were compared. Direct measures generated bias—overreporting in survey measures and reactivity in the directive text condition—but the nondirective text condition generated unbiased measures. Findings are discussed in terms of identity.Keywords
This publication has 56 references indexed in Scilit:
- Identity Importance and the Overreporting of Religious Service Attendance: Multiple Imputation of Religious Attendance Using the American Time Use Study and the General Social SurveyJournal for the Scientific Study of Religion, 2011
- Exceptional Behavior or Exceptional Identity?: Overreporting of Church Attendance in the U.S.Public Opinion Quarterly, 2011
- The Effect of Social Desirability and Social Approval on Self-Reports of Physical ActivityAmerican Journal of Epidemiology, 2005
- Diary Methods: Capturing Life as it is LivedAnnual Review of Psychology, 2003
- Overreporting VotingPublic Opinion Quarterly, 2001
- Validity and Reliability issues in Objective Monitoring of Physical ActivityResearch Quarterly for Exercise and Sport, 2000
- Reducing Vote Overreporting in Surveys: Social Desirability, Memory Failure, and Source MonitoringPublic Opinion Quarterly, 1999
- Comparison of Self-Reported Recycling Attitudes and Behaviors with Actual BehaviorPsychological Reports, 1994
- Validity and reliability of self-reported physical activity status: the Lipid Research Clinics questionnaireMedicine & Science in Sports & Exercise, 1993
- Validation and Comparison of Eight Physical Activity QuestionnairesEpidemiology, 1990