Validation: What Big Data Reveal About Survey Misreporting and the Real Electorate
Top Cited Papers
- 1 January 2012
- journal article
- Published by Cambridge University Press (CUP) in Political Analysis
- Vol. 20 (4), 437-459
- https://doi.org/10.1093/pan/mps023
Abstract
Social scientists rely on surveys to explain political behavior. From consistent overreporting of voter turnout, it is evident that responses on survey items may be unreliable and lead scholars to incorrectly estimate the correlates of participation. Leveraging developments in technology and improvements in public records, we conduct the first-ever fifty-state vote validation. We parse overreporting due to response bias from overreporting due to inaccurate respondents. We find that nonvoters who are politically engaged and equipped with politically relevant resources consistently misreport that they voted. This finding cannot be explained by faulty registration records, which we measure with new indicators of election administration quality. Respondents are found to misreport only on survey items associated with socially desirable outcomes, which we find by validating items beyond voting, like race and party. We show that studies of representation and participation based on survey reports dramatically misestimate the differences between voters and nonvoters.Keywords
This publication has 25 references indexed in Scilit:
- Explaining Politics, Not Polls: Reexamining Macropartisanship with Recalibrated NES DataPublic Opinion Quarterly, 2010
- Correcting for Survey Misreports Using Auxiliary Information with an Application to Estimating TurnoutAmerican Journal of Political Science, 2010
- Race And Turnout In U.S. Elections Exposing Hidden EffectsPublic Opinion Quarterly, 2010
- Bringing Registration into Models of Vote OverreportingPublic Opinion Quarterly, 2007
- Web-Based Questionnaires and the Mode EffectSocial Science Computer Review, 2006
- Social Desirability and Response Validity: A Comparative Analysis of Overreporting Voter Turnout in Five CountriesThe Journal of Politics, 2005
- On the Overreport Bias of the National Election Study Turnout RatePolitical Analysis, 2003
- Internal and External Effects on the Accuracy of NES Turnout: ReplyPolitical Analysis, 2003
- Comment on “Voter Turnout and the National Election Studies”Political Analysis, 2003
- The Political Implications of Higher TurnoutBritish Journal of Political Science, 2001