{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T08:50:24Z","timestamp":1787820624186,"version":"build-2784847793"},"reference-count":86,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2016,6,28]],"date-time":"2016-06-28T00:00:00Z","timestamp":1467072000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000266","name":"UK Engineering and Physical Sciences Research Council","doi-asserted-by":"crossref","award":["EP\/G059063\/1 and EP\/L504889\/1"],"award-info":[{"award-number":["EP\/G059063\/1 and EP\/L504889\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2016,7,21]]},"abstract":"<jats:p>Obtaining high-quality data from crowds can be difficult if contributors do not give tasks sufficient attention. Attention checks are often used to mitigate this problem, but, because the roots of inattention are poorly understood, checks often compel attentive contributors to complete unnecessary work. We investigated a potential source of inattentiveness during crowdwork: multitasking. We found that workers switched to other tasks every 5 minutes, on average. There were indications that increasing switch frequency negatively affected performance. To address this, we tested an intervention that encouraged workers to stay focused on our task after multitasking was detected. We found that our intervention reduced the frequency of task switching. It also improves on existing attention checks because it does not place additional demands on workers who are already focused. Our approach shows that crowds can help to overcome some of the limitations of laboratory studies by affording access to naturalistic multitasking behavior.<\/jats:p>","DOI":"10.1145\/2928269","type":"journal-article","created":{"date-parts":[[2016,7,5]],"date-time":"2016-07-05T14:08:13Z","timestamp":1467727693000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":37,"title":["Diminished Control in Crowdsourcing"],"prefix":"10.1145","volume":"23","author":[{"given":"Sandy J. J.","family":"Gould","sequence":"first","affiliation":[{"name":"University College London, Gower Street, London"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna L.","family":"Cox","sequence":"additional","affiliation":[{"name":"University College London, Gower Street, London"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Duncan P.","family":"Brumby","sequence":"additional","affiliation":[{"name":"University College London, Gower Street, London"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,6,28]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2212776.2223706"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0030986"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting 53","author":"Andrews Alyssa","year":"1931"},{"key":"e_1_2_1_4_1","volume-title":"1st AAAI Conference on Human Computation and Crowdsourcing. AAAI, 17--24","author":"Araujo Ricardo Matsumura","year":"2013"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240632"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753846.1754054"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1314683.1314689"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2005.12.009"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-011-0081-0"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047201"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979404"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702156"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0032696"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/1745691610393980"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007850605129"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-013-0365-7"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702146"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1553-2712.2000.tb00469.x"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0057410"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1031607.1031638"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979405"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675260"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.3758\/BRM.40.2.428"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2468356.2468388"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753688"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-012-0296-9"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985707"},{"key":"e_1_2_1_28_1","first-page":"213","article-title":"Data collection in a flat world: the strengths and weaknesses of mechanical turk samples","volume":"26","author":"Goodman Joseph K.","year":"2013","journal-title":"J. Behav"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2212776.2212420"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1177\/1541931213571034"},{"key":"e_1_2_1_31_1","volume-title":"Brumby","author":"Gould Sandy J. J.","year":"2013"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702613.2732709"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.15346\/hc.v2i1.4"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858067"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0021912"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1316624.1316686"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753357"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.135.1.103"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/11527886_59"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357070"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1056808.1056948"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240732"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240730"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1177\/1555343411432339"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2015.03.002"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518979"},{"key":"e_1_2_1_47_1","unstructured":"Adam Kapelner and Dana Chandler. 2010. Preventing satisficing in online surveys. In CrowdConf.  Adam Kapelner and Dana Chandler. 2010. Preventing satisficing in online surveys. In CrowdConf."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720813504216"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1037\/1076-898X.13.3.135"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441923"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357127"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470684"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2384916.2384942"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702594"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0014397"},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the 28th Annual Meeting of the Cognitive Science Conference. Cognitive Science Society","author":"Li Simon Y. W."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531710"},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of the 11th International Symposium on Aviation Psychology.","author":"Loukopoulos L. D."},{"key":"e_1_2_1_59_1","volume-title":"1st AAAI Conference on Human Computation and Crowdsourcing. AAAI, 103--111","author":"Mao Andrew","year":"2013"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.5555\/2486788.2486963"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1055017"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207754"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557204"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557361"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/1809400.1809422"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1037\/e577272012-004"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.46.4.650.56816"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0014402"},{"key":"e_1_2_1_69_1","first-page":"5","article-title":"Running experiments on Amazon Mechanical Turk","volume":"5","author":"Paolacci Gabriele","year":"2010","journal-title":"Judgm. Decis. Mak."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-013-0434-y"},{"key":"e_1_2_1_71_1","volume-title":"Human Factors and Ergonomics Society Annual Meeting Proceedings. Sage, 393--397","author":"Ratwani Raj M.","year":"1931"},{"key":"e_1_2_1_72_1","volume-title":"Chi, Praveen Paritosh, and Peng Dai","author":"Rzeszotarski Jeffrey M.","year":"2013"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380125"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047199"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753341"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753340"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518981"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557155"},{"key":"e_1_2_1_79_1","series-title":"Lecture Notes in Computer Science","volume-title":"On the Move to Meaningful Internet Systems: OTM 2013 Conferences, Robert Meersman et&nbsp;al. (Eds.)","author":"Scekic Ognjen"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1080\/00140136208930578"},{"key":"e_1_2_1_81_1","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing. EMNLP\u201908","author":"Snow Rion"},{"key":"e_1_2_1_82_1","volume-title":"Working: People Talk About What They Do All Day and How They Feel About What They Do","author":"Terkel Studs","year":"1974"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogsys.2010.07.010"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1177\/0963721411408771"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1037\/e578902012-061"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1136\/qshc.2009.039255"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2928269","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2928269","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:56:28Z","timestamp":1750222588000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2928269"}},"subtitle":["An Investigation of Crowdworker Multitasking Behavior"],"short-title":[],"issued":{"date-parts":[[2016,6,28]]},"references-count":86,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2016,7,21]]}},"alternative-id":["10.1145\/2928269"],"URL":"https:\/\/doi.org\/10.1145\/2928269","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,6,28]]},"assertion":[{"value":"2014-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-06-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}