A Method for Evaluating Mode Effects in Mixed-mode Surveys
Open Access
- 1 January 2010
- journal article
- Published by Oxford University Press (OUP) in Public Opinion Quarterly
- Vol. 74 (5), 1027-1045
- https://doi.org/10.1093/poq/nfq059
Abstract
Survey designs in which data from different groups of respondents are collected by different survey modes have become increasingly popular. However, such mixed-mode (MM) designs lead to a confounding of selection effects and measurement effects (measurement error) caused by mode differences. Consequently, MM data have poor quality. Nevertheless, comparing MM data with data from a comparable single-mode survey allows researchers to measure selection effects and measurement effects separately. The authors develop a method to evaluate mode effects and illustrate this method with data from a Dutch MM experiment within the European Social Survey program. In this experiment, respondents could choose between three modes: a Web survey, a telephone interview, or a face-to-face interview. Mode effects on three political variables are evaluated: interest in politics, perceived complexity of politics, and voter turnout in the last national election.Keywords
This publication has 11 references indexed in Scilit:
- Assessing the Effect of Data Collection Mode on MeasurementInternational Statistical Review, 2010
- Mode of questionnaire administration can have serious effects on data qualityJournal of Public Health, 2005
- Survey Mode as a Source of Instability in Responses across SurveysField Methods, 2005
- Marginal Structural Models as a Tool for StandardizationEpidemiology, 2003
- Maximizing Response to Surveys in Health Program Evaluation At Minimum Cost Using Multiple MethodsEvaluation Review, 1995
- Interview Mode Effects in Surveys of Drug and Alcohol Use: A Field ExperimentPublic Opinion Quarterly, 1994
- The Design and Administration of Mail SurveysAnnual Review of Sociology, 1991
- The impact of administration mode on response effects in survey measurementApplied Cognitive Psychology, 1991
- The central role of the propensity score in observational studies for causal effectsBiometrika, 1983
- On a Least Squares Adjustment of a Sampled Frequency Table When the Expected Marginal Totals are KnownThe Annals of Mathematical Statistics, 1940