Soylent
- 23 July 2015
- journal article
- Published by Association for Computing Machinery (ACM) in Communications of the ACM
- Vol. 58 (8), 85-94
- https://doi.org/10.1145/2791285
Abstract
This paper introduces architectural and interaction patterns for integrating crowdsourced human contributions directly into user interfaces. We focus on writing and editing, complex endeavors that span many levels of conceptual and pragmatic activity. Authoring tools offer help with pragmatics, but for higher-level help, writers commonly turn to other people. We thus present Soylent, a word processing interface that enables writers to call on Mechanical Turk workers to shorten, proofread, and otherwise edit parts of their documents on demand. To improve worker quality, we introduce the Find-Fix-Verify crowd programming pattern, which splits tasks into a series of generation and review stages. Evaluation studies demonstrate the feasibility of crowdsourced editing and investigate questions of reliability, cost, wait time, and work time for edits.Keywords
This publication has 16 references indexed in Scilit:
- TurKitPublished by Association for Computing Machinery (ACM) ,2010
- Who are the crowdworkers?Published by Association for Computing Machinery (ACM) ,2010
- FAWNPublished by Association for Computing Machinery (ACM) ,2009
- Financial incentives and the "performance of crowds"Published by Association for Computing Machinery (ACM) ,2009
- Crowdsourcing user studies with Mechanical TurkPublished by Association for Computing Machinery (ACM) ,2008
- An Exploration into Activity-Informed Physical Advertising Using PESTPublished by Springer Science and Business Media LLC ,2007
- Labeling images with a computer gamePublished by Association for Computing Machinery (ACM) ,2004
- Tangible bitsPublished by Association for Computing Machinery (ACM) ,1997
- Techniques for automatically correcting words in textACM Computing Surveys, 1992
- Awareness and coordination in shared workspacesPublished by Association for Computing Machinery (ACM) ,1992