Prediction Diversity and Selective Attention in the Wisdom of Crowds
- 15 December 2020
- journal article
- research article
- Published by Wolfram Research, Inc. in Complex Systems
- Vol. 29 (4), 861-875
- https://doi.org/10.25088/complexsystems.29.4.861
Abstract
The wisdom of crowds is the idea that the combination of independent estimates of the magnitude of some quantity yields a remarkably accurate prediction, which is always more accurate than the average individual estimate. In addition, it is largely believed that the accuracy of the crowd can be improved by increasing the diversity of the estimates. Here we report the results of three experiments to probe the current understanding of the wisdom of crowds, namely, the estimates of the number of candies in a jar, the length of a paper strip and the number of pages of a book. We find that the collective estimate is better than the majority of the individual estimates in all three experiments. In disagreement with the prediction diversity theorem, we find no significant correlation between the prediction diversity and the collective error. The poor accuracy of the crowd on some experiments leads us to conjecture that its alleged accuracy is most likely an artifact of selective attention.Keywords
This publication has 9 references indexed in Scilit:
- The surprising little effectiveness of cooperative algorithms in parallel problem solvingZeitschrift für Physik B Condensed Matter, 2020
- Agent-based models of collective intelligencePhysics of Life Reviews, 2019
- Sequential sampling, magnitude estimation, and the wisdom of crowdsJournal of Mathematical Psychology, 2017
- When more of the same is betterEurophysics Letters, 2016
- The Curious Anomaly of Skewed Judgment Distributions and Systematic Error in the Wisdom of CrowdsPLOS ONE, 2014
- Imitative Learning as a Connector of Collective BrainsPLOS ONE, 2014
- Revisiting Francis Galton’s Forecasting CompetitionStatistical Science, 2014
- The Two-Piece Normal, Binormal, or Double Gaussian Distribution: Its Origin and RediscoveriesStatistical Science, 2014
- Natural selection. IV. The Price equation*Journal of Evolutionary Biology, 2012