{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T17:17:10Z","timestamp":1776100630669,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":14,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,9,21]],"date-time":"2022-09-21T00:00:00Z","timestamp":1663718400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,9,21]]},"DOI":"10.1145\/3537674.3555783","type":"proceedings-article","created":{"date-parts":[[2022,9,7]],"date-time":"2022-09-07T16:08:30Z","timestamp":1662566910000},"page":"127-129","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["Crowdsourcing Quality Concerns: An Examination of Amazon\u2019s Mechanical Turk"],"prefix":"10.1145","author":[{"given":"Marc","family":"Dupuis","sequence":"first","affiliation":[{"name":"Division of Computing and Software Systems, University of Washington, USA"}]},{"given":"Karen","family":"Renaud","sequence":"additional","affiliation":[{"name":"University of Strathclyde, United Kingdom"}]},{"given":"Rosalind","family":"Searle","sequence":"additional","affiliation":[{"name":"University of Glasgow, United Kingdom"}]}],"member":"320","published-online":{"date-parts":[[2022,9,21]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1177\/1948550619875149"},{"key":"e_1_3_2_1_2_1","volume-title":"An Analysis of the Use of Amazon\u2019s Mechanical Turk for Survey Research in the Cloud. In International Conference on Cloud Security Management","author":"Dupuis Marc","year":"2013","unstructured":"Marc Dupuis , Barbara Endicott-Popovsky , and Robert Crossler . 2013 . An Analysis of the Use of Amazon\u2019s Mechanical Turk for Survey Research in the Cloud. In International Conference on Cloud Security Management . Seattle, Washington. Marc Dupuis, Barbara Endicott-Popovsky, and Robert Crossler. 2013. An Analysis of the Use of Amazon\u2019s Mechanical Turk for Survey Research in the Cloud. In International Conference on Cloud Security Management. Seattle, Washington."},{"key":"e_1_3_2_1_3_1","volume-title":"Pandemic. In Proceedings of the 21st Annual Conference on Information Technology Education. ACM, Virtual Event USA, 320\u2013323","author":"Dupuis J.","unstructured":"Marc\u00a0 J. Dupuis and Karen Renaud . 2020. Conducting \u201cIn-Person\u201d Research During a Pandemic. In Proceedings of the 21st Annual Conference on Information Technology Education. ACM, Virtual Event USA, 320\u2013323 . https:\/\/doi.org\/10.1145\/3368308.3415420 10.1145\/3368308.3415420 Marc\u00a0J. Dupuis and Karen Renaud. 2020. Conducting \u201cIn-Person\u201d Research During a Pandemic. In Proceedings of the 21st Annual Conference on Information Technology Education. ACM, Virtual Event USA, 320\u2013323. https:\/\/doi.org\/10.1145\/3368308.3415420"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174023"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10683-011-9273-9"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v6i1.13327"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1017\/psrm.2020.6"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1930297500002205"},{"key":"e_1_3_2_1_9_1","volume-title":"Je Ne Regrette. In New Security Paradigms Workshop (NSPW \u201922)","author":"Renaud Karen","year":"2022","unstructured":"Karen Renaud , Marc Dupuis , and Rosalind Searle . 2022 . Cybersecurity Regrets: I\u2019ve had a few .... Je Ne Regrette. In New Security Paradigms Workshop (NSPW \u201922) . New Hampshire, USA. Karen Renaud, Marc Dupuis, and Rosalind Searle. 2022. Cybersecurity Regrets: I\u2019ve had a few.... Je Ne Regrette. In New Security Paradigms Workshop (NSPW \u201922). New Hampshire, USA."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3498891.3498896"},{"key":"e_1_3_2_1_11_1","volume-title":"Untold history of AI: How Amazon\u2019s Mechanical Turkers got squeezed inside the machine","author":"Schwartz Oscar","year":"2019","unstructured":"Oscar Schwartz . 2019. Untold history of AI: How Amazon\u2019s Mechanical Turkers got squeezed inside the machine . IEEE Spectrum. Retrieved from https:\/\/spectrum. ieee. org\/tech-talk\/techhistory\/dawn-of-electronics\/untold-history-of-ai-mechanical-turk-revisited-tktkt( 2019 ). Oscar Schwartz. 2019. Untold history of AI: How Amazon\u2019s Mechanical Turkers got squeezed inside the machine. IEEE Spectrum. Retrieved from https:\/\/spectrum. ieee. org\/tech-talk\/techhistory\/dawn-of-electronics\/untold-history-of-ai-mechanical-turk-revisited-tktkt(2019)."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","unstructured":"David\u00a0O. Sears. 1986. College sophomores in the laboratory: Influences of a narrow data base on social psychology\u2019s view of human nature.Journal of Personality and Social Psychology 51 3(1986) 515.  David\u00a0O. Sears. 1986. College sophomores in the laboratory: Influences of a narrow data base on social psychology\u2019s view of human nature.Journal of Personality and Social Psychology 51 3(1986) 515.","DOI":"10.1037\/0022-3514.51.3.515"},{"key":"e_1_3_2_1_13_1","volume-title":"Data Collection in the Digital Age: Innovative Alternatives to Student Samples.MIS Quarterly 38, 2","author":"Steelman R.","year":"2014","unstructured":"Zachary\u00a0 R. Steelman , Bryan\u00a0 I. Hammer , and Moez Limayem . 2014. Data Collection in the Digital Age: Innovative Alternatives to Student Samples.MIS Quarterly 38, 2 ( 2014 ), 355\u2013378. Zachary\u00a0R. Steelman, Bryan\u00a0I. Hammer, and Moez Limayem. 2014. Data Collection in the Digital Age: Innovative Alternatives to Student Samples.MIS Quarterly 38, 2 (2014), 355\u2013378."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359126"}],"event":{"name":"SIGITE '22: The 23rd Annual Conference on Information Technology Education","location":"Chicago IL USA","acronym":"SIGITE '22","sponsor":["SIGITE ACM Special Interest Group on Information Technology Education"]},"container-title":["Proceedings of the 23rd Annual Conference on Information Technology Education"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3537674.3555783","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3537674.3555783","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:50Z","timestamp":1750186970000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3537674.3555783"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,21]]},"references-count":14,"alternative-id":["10.1145\/3537674.3555783","10.1145\/3537674"],"URL":"https:\/\/doi.org\/10.1145\/3537674.3555783","relation":{},"subject":[],"published":{"date-parts":[[2022,9,21]]},"assertion":[{"value":"2022-09-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}