Using Paradata to Explore Item Level Response Times in Surveys
- 28 June 2012
- journal article
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series A: Statistics in Society
- Vol. 176 (1), 271-286
- https://doi.org/10.1111/j.1467-985x.2012.01041.x
Abstract
Summary: We analyse item level keystroke data from cycle 6 of the National Survey of Family Growth, which is a survey on fertility and related topics that is conducted in the USA. The National Survey of Family Growth is conducted among both males and females by using computer-assisted personal visit interviews and an audio computer-assisted self-interviewing component for the most sensitive topics. Our analyses focus on the time taken to answer a question as a function of item level characteristics, respondent characteristics and interviewer characteristics. Using multilevel models, we explore how these factors influence response times. Our exploratory study suggests that factors at all three levels (item, respondent and interviewer) influence response times. These results demonstrate that question features that explain variation in response times can be automatically derived from standard computer-assisted personal interviewing paradata. The effects of respondent characteristics that we observe are in line with prior findings from more controlled studies conducted in supervised telephone facilities. Some demographic characteristics of interviewers contributed to the variation in response times, though they failed to explain large portions of the between-interviewer variance.Keywords
Funding Information
- National Center for Health Statistics (200-2000-07001)
This publication has 25 references indexed in Scilit:
- Taking the Audio Out of Audio-CASIPublic Opinion Quarterly, 2009
- Response Latency and (Para)Linguistic Expressions as Indicators of Response ErrorPublished by Wiley ,2004
- The minority slowness effect: Subtle inhibitions in the expression of views not shared by others.Journal of Personality and Social Psychology, 2003
- Do Strength‐Related Attitude Properties Determine Susceptibility to Response Effects? New Evidence From Response Latency, Attitude Extremity, and Aggregate IndicesPolitical Psychology, 2000
- Individual differences in information-processing rate and amount: Implications for group differences in response latency.Psychological Bulletin, 1999
- Evaluating Interviewer Use of CAPI TechnologyPublished by Wiley ,1997
- Molar and latent models of cognitive slowing: Implications for aging, dementia, depression, development, and intelligencePsychonomic Bulletin & Review, 1996
- Response Latency as a Signal to Question Problems in Survey ResearchPublic Opinion Quarterly, 1996
- Identifying Salient Beliefs About Leisure Activities: Frequency of Elicitation Versus Response Latency1Journal of Applied Social Psychology, 1995
- Attitude accessibility as a moderator of the attitude–perception and attitude–behavior relations: An investigation of the 1984 presidential election.Journal of Personality and Social Psychology, 1986