{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T07:23:27Z","timestamp":1781335407436,"version":"3.54.1"},"reference-count":19,"publisher":"Association for Computing Machinery (ACM)","issue":"8","license":[{"start":{"date-parts":[[2015,7,23]],"date-time":"2015-07-23T00:00:00Z","timestamp":1437609600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Commun. ACM"],"published-print":{"date-parts":[[2015,7,23]]},"abstract":"<jats:p>This paper introduces architectural and interaction patterns for integrating crowdsourced human contributions directly into user interfaces. We focus on writing and editing, complex endeavors that span many levels of conceptual and pragmatic activity. Authoring tools offer help with pragmatics, but for higher-level help, writers commonly turn to other people. We thus present Soylent, a word processing interface that enables writers to call on Mechanical Turk workers to shorten, proofread, and otherwise edit parts of their documents on demand. To improve worker quality, we introduce the Find-Fix-Verify crowd programming pattern, which splits tasks into a series of generation and review stages. Evaluation studies demonstrate the feasibility of crowdsourced editing and investigate questions of reliability, cost, wait time, and work time for edits.<\/jats:p>","DOI":"10.1145\/2791285","type":"journal-article","created":{"date-parts":[[2015,7,27]],"date-time":"2015-07-27T13:33:00Z","timestamp":1438003980000},"page":"85-94","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":95,"title":["Soylent"],"prefix":"10.1145","volume":"58","author":[{"given":"Michael S.","family":"Bernstein","sequence":"first","affiliation":[{"name":"Stanford University, Stanford, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Greg","family":"Little","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert C.","family":"Miller","sequence":"additional","affiliation":[{"name":"MIT CSAIL, Cambridge, MA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bj\u00f6rn","family":"Hartmann","sequence":"additional","affiliation":[{"name":"University of California, Berkeley, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark S.","family":"Ackerman","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, MI"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David R.","family":"Karger","sequence":"additional","affiliation":[{"name":"MIT CSAIL, Cambridge, MA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Crowell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katrina","family":"Panovich","sequence":"additional","affiliation":[{"name":"Google, Inc., Mountain View, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2015,7,23]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1629575.1629577"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866029.1866080"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.3115\/1220175.1220223"},{"key":"e_1_2_1_4_1","volume-title":"Watch What I Do","author":"Cypher A.","year":"1993","unstructured":"Cypher , A. Watch What I Do . MIT Press , Cambridge, MA , 1993 . Cypher, A. Watch What I Do. MIT Press, Cambridge, MA, 1993."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/143457.143468"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753357"},{"key":"e_1_2_1_7_1","volume-title":"Proc. UIST '97","author":"Ishii H.","year":"1997","unstructured":"Ishii , H. , Ullmer , B. Tangible bits : Towards seamless interfaces between people, bits and atoms . In Proc. UIST '97 ( 1997 ). Ishii, H., Ullmer, B. Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proc. UIST '97 (1997)."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357127"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/146370.146380"},{"key":"e_1_2_1_10_1","volume-title":"Proc. SIGIR 2010 Workshop on Crowdsourcing for Search Evaluation","author":"Le J.","year":"2010","unstructured":"Le , J. , Edmonds , A. , Hester , V. , Biewald , L. Ensuring quality in crowdsourced search relevance evaluation: The effects of training question distribution . In Proc. SIGIR 2010 Workshop on Crowdsourcing for Search Evaluation ( 2010 ), 21--26. Le, J., Edmonds, A., Hester, V., Biewald, L. Ensuring quality in crowdsourced search relevance evaluation: The effects of training question distribution. In Proc. SIGIR 2010 Workshop on Crowdsourcing for Search Evaluation (2010), 21--26."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866029.1866040"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/517637"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1600150.1600175"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979148"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753846.1753873"},{"key":"e_1_2_1_16_1","series-title":"Lecture Notes in Computer Science (Berlin","volume-title":"Pervasive '07","author":"Sala M.","year":"2007","unstructured":"Sala , M. , Partridge , K. , Jacobson , L. , Begole , J. An exploration into activity-informed physical advertising using PEST . In Pervasive '07 , volume 4480 of Lecture Notes in Computer Science (Berlin , Heidelberg, 2007 ), Springer , Berlin, Heidelberg. Sala, M., Partridge, K., Jacobson, L., Begole, J. An exploration into activity-informed physical advertising using PEST. In Pervasive '07, volume 4480 of Lecture Notes in Computer Science (Berlin, Heidelberg, 2007), Springer, Berlin, Heidelberg."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/1613715.1613751"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2008.4562953"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985733"}],"container-title":["Communications of the ACM"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2791285","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2791285","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T05:43:10Z","timestamp":1750225390000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2791285"}},"subtitle":["a word processor with a crowd inside"],"short-title":[],"issued":{"date-parts":[[2015,7,23]]},"references-count":19,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2015,7,23]]}},"alternative-id":["10.1145\/2791285"],"URL":"https:\/\/doi.org\/10.1145\/2791285","relation":{},"ISSN":["0001-0782","1557-7317"],"issn-type":[{"value":"0001-0782","type":"print"},{"value":"1557-7317","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,7,23]]},"assertion":[{"value":"2015-07-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}