{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T10:15:58Z","timestamp":1792836958900,"version":"4.5.0"},"reference-count":50,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2021,8,6]],"date-time":"2021-08-06T00:00:00Z","timestamp":1628208000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,8,6]],"date-time":"2021-08-06T00:00:00Z","timestamp":1628208000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Behav Res"],"published-print":{"date-parts":[[2022,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Crowdsourced psychological and other biobehavioral research using platforms like Amazon\u2019s Mechanical Turk (MTurk) is increasingly common \u2013 but has proliferated more rapidly than studies to establish data quality best practices. Thus, this study investigated whether outcome scores for three common screening tools would be significantly different among MTurk workers who were subject to different sets of quality control checks. We conducted a single-stage, randomized controlled trial with equal allocation to each of four study arms: Arm 1 (Control Arm), Arm 2 (Bot\/VPN Check), Arm 3 (Truthfulness\/Attention Check), and Arm 4 (Stringent Arm \u2013 All Checks). Data collection was completed in Qualtrics, to which participants were referred from MTurk. Subjects (<jats:italic>n<\/jats:italic> = 1100) were recruited on November 20\u201321, 2020. Eligible workers were required to claim U.S. residency, have a successful task completion rate &gt; 95%, have completed a minimum of 100 tasks, and have completed a maximum of 10,000 tasks. Participants completed the US-Alcohol Use Disorders Identification Test (USAUDIT), the Patient Health Questionnaire (PHQ-9), and a screener for Generalized Anxiety Disorder (GAD-7). We found that differing quality control approaches significantly, meaningfully, and directionally affected outcome scores on each of the screening tools. Most notably, workers in Arm 1 (Control) reported higher scores than those in Arms 3 and 4 for all tools, and a higher score than workers in Arm 2 for the PHQ-9. These data suggest that the use, or lack thereof, of quality control questions in crowdsourced research may substantively affect findings, as might the types of quality control items.<\/jats:p>","DOI":"10.3758\/s13428-021-01665-8","type":"journal-article","created":{"date-parts":[[2021,8,6]],"date-time":"2021-08-06T15:04:15Z","timestamp":1628262255000},"page":"885-897","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":102,"title":["Quality control questions on Amazon\u2019s Mechanical Turk (MTurk): A randomized trial of impact on the USAUDIT, PHQ-9, and GAD-7"],"prefix":"10.3758","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2345-8850","authenticated-orcid":false,"given":"Jon","family":"Agley","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yunyu","family":"Xiao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rachael","family":"Nolan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lilian","family":"Golzarri-Arroyo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,8,6]]},"reference":[{"key":"1665_CR1","unstructured":"Adesida, P. O. (2020). Suicide capability scale development: PPCS and CSAS (Publication Number 28148178) [Azusa Pacific University]. ProQuest."},{"key":"1665_CR2","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1186\/s12889-020-10103-x","volume":"21","author":"J Agley","year":"2020","unstructured":"Agley, J., & Xiao, Y. (2020). Misinformation about COVID-19: evidence for differential latent profiles and a strong association with trust in science. BMC Public Health, 21, 89. https:\/\/doi.org\/10.1186\/s12889-020-10103-x","journal-title":"BMC Public Health"},{"key":"1665_CR3","unstructured":"Agley, J., Xiao, Y., & Nolan, R. (2020). Amazon MTurk for research: Improving data quality. 10.17605\/OSF.IO\/SV9EA"},{"key":"1665_CR4","doi-asserted-by":"crossref","unstructured":"Aguinis, H., Villamor, I., & Ramani, R. S. (2020). MTurk research: Review and recommendations. Journal of Management, 46(4), 823\u2013837.","DOI":"10.1177\/0149206320969787"},{"key":"1665_CR5","unstructured":"Amazon.com. (2020). Amazon Mechanical Turk: Access a global, on-demand, 24x7 workforce. Amazon. Retrieved November 25, 2020 from https:\/\/MTurk.com"},{"key":"1665_CR6","doi-asserted-by":"publisher","unstructured":"Angus, D. J., Pickering, D., Keen, B., & Blaszczynski, A. (2021). Study framing influences crowdsourced rates of problem gambling and alcohol use disorder. Psychology of Addictive Behaviors, https:\/\/doi.org\/10.1037\/adb0000687.","DOI":"10.1037\/adb0000687"},{"issue":"6","key":"1665_CR7","doi-asserted-by":"publisher","first-page":"684","DOI":"10.1037\/pas0000217","volume":"28","author":"KA Arditte","year":"2016","unstructured":"Arditte, K.A., \u00c7ek, D., Shaw, A.M., & Timpano, K.R. (2016). The importance of assessing clinical phenomena in Mechanical Turk research. Psychological Assessment, 28(6), 684\u2013691.","journal-title":"Psychological Assessment"},{"key":"1665_CR8","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1016\/j.paid.2019.02.015","volume":"143","author":"AJ Barends","year":"2019","unstructured":"Barends, A. J., & Vries, R. E. D. (2019). Noncompliant responding: Comparing exclusion criteria in MTurk personality research to improve data quality. Personality and Individual Differences, 143, 84\u201389.","journal-title":"Personality and Individual Differences"},{"key":"1665_CR9","doi-asserted-by":"crossref","unstructured":"Bauer, B. W., Larsen, K. L., Caulfield, N., Elder, D. D., Jordan, S. S., & Capron, D. W. (2020). Review of best practice recommendations for ensuring high data quality with Amazon's Mechanical Turk. PsyArxiv, https:\/\/psyarxiv.com\/m78sf\/download?format=pdf.","DOI":"10.31234\/osf.io\/m78sf"},{"issue":"3","key":"1665_CR10","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1111\/ajps.12081","volume":"58","author":"AJ Berinsky","year":"2014","unstructured":"Berinsky, A. J., Margolis, M. F., & Sances, M. W. (2014). Separating the shirkers from the workers? Making sure respondents pay attention on self-administered surveys. American Journal of Political Science, 58(3), 739\u2013753. https:\/\/doi.org\/10.1111\/ajps.12081","journal-title":"American Journal of Political Science"},{"issue":"4","key":"1665_CR11","first-page":"552","volume":"29","author":"MJ Blanca","year":"2017","unstructured":"Blanca, M. J., Alarc\u00f3n, R., Arnau, J., Bono, R., & Bendayan, R. (2017). Non-normal data: Is ANOVA still a valid option? Psicothema, 29(4), 552\u2013557.","journal-title":"Psicothema"},{"key":"1665_CR12","unstructured":"Brenner, J. (2020). Examining the stage progression of employee burnout (Publication Number 28148693) [Hofstra University]. ProQuest."},{"key":"1665_CR13","doi-asserted-by":"publisher","first-page":"2586","DOI":"10.3758\/s13428-018-1035-6","volume":"50","author":"EM Buchanan","year":"2018","unstructured":"Buchanan, E. M., & Scofield, J. E. (2018). Methods to detect low quality data and its implication for psychological research. Behavior Research Methods, 50, 2586\u20132596. https:\/\/doi.org\/10.3758\/s13428-018-1035-6","journal-title":"Behavior Research Methods"},{"issue":"1","key":"1665_CR14","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1177\/1745691610393980","volume":"6","author":"M Buhrmester","year":"2011","unstructured":"Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality Data? Perspectives on Psychological Science, 6(1), 3\u20135.","journal-title":"Perspectives on Psychological Science"},{"key":"1665_CR15","doi-asserted-by":"publisher","first-page":"112","DOI":"10.3758\/s13428-013-0365-7","volume":"46","author":"J Chandler","year":"2014","unstructured":"Chandler, J., Mueller, P., & Paolacci, G. (2014). Nonna\u00efvet\u00e9 among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers. Behavior Research Methods, 46, 112\u2013130. https:\/\/doi.org\/10.3758\/s13428-013-0365-7","journal-title":"Behavior Research Methods"},{"key":"1665_CR16","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1146\/annurev-clinpsy-021815-093623","volume":"12","author":"J Chandler","year":"2016","unstructured":"Chandler, J., & Shapiro, D. (2016). Conducting clinical research using crowdsourced convenience samples. Annual Review of Clinical Psychology, 12, 53\u201381.","journal-title":"Annual Review of Clinical Psychology"},{"key":"1665_CR17","unstructured":"CloudResearch.com. (2021). Online participant recruitment \u2013 made easy. CloudResearch. Retrieved April 12, 2021 from https:\/\/www.cloudresearch.com"},{"key":"1665_CR18","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1186\/s12874-019-0770-4","volume":"19","author":"JA Cunningham","year":"2019","unstructured":"Cunningham, J. A., Godinho, A., & Bertholet, N. (2019). Outcomes of two randomized controlled trials, employing participants recruited through Mechanical Turk, of Internet interventions targeting unhealthy alcohol use. BMC Medical Research Methodology, 19, 124. https:\/\/doi.org\/10.1186\/s12874-019-0770-4","journal-title":"BMC Medical Research Methodology"},{"key":"1665_CR19","unstructured":"Dennis, S. A., Goodson, B. M., & Pearson, C. (2019). Virtual private servers and the limitations of IP-based screening procedures: Lessons from the MTurk quality crisis of 2018. Available at SSRN 3233954."},{"issue":"8","key":"1665_CR20","doi-asserted-by":"publisher","first-page":"775","DOI":"10.1002\/da.22769","volume":"35","author":"DL Dickinson","year":"2018","unstructured":"Dickinson, D. L., Wolkow, A. P., Rajaratnam, S. M. W., & Drummond, S. P. A. (2018). Personal sleep debt and daytime sleepiness mediate the relationship between sleep and mental health outcomes in young adults. Depression and Anxiety, 35(8), 775\u2013783. https:\/\/doi.org\/10.1002\/da.22769","journal-title":"Depression and Anxiety"},{"key":"1665_CR21","doi-asserted-by":"publisher","first-page":"2228","DOI":"10.3758\/s13428-018-1103-y","volume":"51","author":"M Dupuis","year":"2019","unstructured":"Dupuis, M., Meier, E., & Cuneo, F. (2019). Detecting computer-generated random responding in questionnaire-based data: A comparison of seven indices. Behavior Research Methods, 51, 2228\u20132237.","journal-title":"Behavior Research Methods"},{"issue":"4","key":"1665_CR22","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1037\/tra0000502","volume":"12","author":"K Engle","year":"2020","unstructured":"Engle, K., Talbot, M., & Samuelson, K.W. (2020). Is Amazon\u2019s Mechanical Turk (MTurk) a comparable recruitment source for trauma studies? Psychological Trauma: Theory, Research, Practice, and Policy, 12(4), 381\u2013388.","journal-title":"Psychological Trauma: Theory, Research, Practice, and Policy"},{"key":"1665_CR23","unstructured":"Flaherty, C. (2020). Faculty home work. Retrieved December 14 from https:\/\/www.insidehighered.com\/news\/2020\/03\/24\/working-home-during-covid-19-proves-challenging-faculty-members"},{"key":"1665_CR24","doi-asserted-by":"publisher","first-page":"102268","DOI":"10.1016\/j.joep.2020.102268","volume":"78","author":"L Ganduillia","year":"2020","unstructured":"Ganduillia, L., Lezzi, E., & Parciasepe, P. (2020). Replication with MTurk of the experimental design by Gangadharan, Grossman, Jones & Leister (2018): Charitable giving across donor types. Journal of Economic Psychology, 78, 102268.","journal-title":"Journal of Economic Psychology"},{"key":"1665_CR25","doi-asserted-by":"publisher","first-page":"406","DOI":"10.1186\/s13063-018-2735-z","volume":"19","author":"S Grant","year":"2018","unstructured":"Grant, S., Mayo-Wilson, E., Montgomery, P., Macdonald, G., Michie, S., Hopewell, S., & Moher, D. (2018). CONSORT-SPI 2018 explanation and elaboration: guidance for reporting social and psychological intervention trials. Trials, 19, 406.","journal-title":"Trials"},{"issue":"6","key":"1665_CR26","doi-asserted-by":"publisher","first-page":"578","DOI":"10.1080\/00952990.2018.1456545","volume":"44","author":"JC Higgins-Biddle","year":"2018","unstructured":"Higgins-Biddle, J. C., & Babor, T. F. (2018). A review of the Alcohol Use Disorders Identification Test (AUDIT), AUDIT-C, and USAUDIT for screening in the United States: Past issues and future directions. The American Journal of Drug and Alcohol Abuse, 44(6), 578\u2013586.","journal-title":"The American Journal of Drug and Alcohol Abuse"},{"key":"1665_CR27","doi-asserted-by":"publisher","first-page":"1563","DOI":"10.3758\/s13428-017-0984-5","volume":"50","author":"C Hydock","year":"2018","unstructured":"Hydock, C. (2018). Assessing and overcoming participant dishonesty in online data collection. Behavior Research Methods, 50, 1563\u20131567. https:\/\/doi.org\/10.3758\/s13428-017-0984-5","journal-title":"Behavior Research Methods"},{"issue":"4","key":"1665_CR28","doi-asserted-by":"publisher","first-page":"e23872","DOI":"10.2196\/23872","volume":"7","author":"JP Jain","year":"2021","unstructured":"Jain, J.P., Offer, C., Rowe, C., Turner, C., Dawson-Rose, C., Hoffman, T., & Santos, G-M. (2021). The psychosocial predictors and day-level correlates of substance use among participants recruited via an online crowdsourcing platform in the United States: Daily diary study. JMIR Public Health and Surveillance, 7(4), e23872.","journal-title":"JMIR Public Health and Surveillance"},{"issue":"4","key":"1665_CR29","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1177\/0098628312456615","volume":"39","author":"DR Johnson","year":"2012","unstructured":"Johnson, D. R., & Borden, L. A. (2012). Participants at Your Fingertips: Using Amazon\u2019s Mechanical Turk to Increase Student\u2013Faculty Collaborative Research. Teaching of Psychology, 39(4), 245\u2013251.","journal-title":"Teaching of Psychology"},{"key":"1665_CR30","doi-asserted-by":"publisher","first-page":"1359","DOI":"10.3389\/fpsyg.2017.01359","volume":"8","author":"MG Keith","year":"2017","unstructured":"Keith, M. G., Tay, L., & Harms, P. D. (2017). Systems perspective of Amazon Mechanical Turk for Organizational Research: Review and Recommendations. Frontiers in Psychology, 8, 1359.","journal-title":"Frontiers in Psychology"},{"key":"1665_CR31","doi-asserted-by":"publisher","first-page":"614","DOI":"10.1017\/psrm.2020.6","volume":"8","author":"R Kennedy","year":"2020","unstructured":"Kennedy, R., Clifford, S., Burleigh, T., Waggoner, P. D., Jewell, R., & Winter, N. J. G. (2020). The shape and solutions to the MTurk quality crisis. Political Science Research and Methods, 8, 614\u2013629.","journal-title":"Political Science Research and Methods"},{"key":"1665_CR32","doi-asserted-by":"publisher","unstructured":"Killgore, W. D. S., Cloonan, S. A., Taylor, E. C., & Dailey, N. S. (2020). Loneliness: A signature mental health concern in the era of COVID-19. Psychiatry Research, 113117. https:\/\/doi.org\/10.1016\/j.psychres.2020.113117","DOI":"10.1016\/j.psychres.2020.113117"},{"issue":"1","key":"1665_CR33","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1037\/adb0000219","volume":"31","author":"HS Kim","year":"2017","unstructured":"Kim, H. S., & Hodgins, D. C. (2017). Reliability and validity of data obtained from alcohol, cannabis, and gambling populations on Amazon\u2019s Mechanical Turk. Psychology of Addictive Behaviors, 31(1), 86\u201394.","journal-title":"Psychology of Addictive Behaviors"},{"key":"1665_CR34","doi-asserted-by":"publisher","unstructured":"Kim, H. S., & Hodgins, D. C. (2020). Are you for real? Maximizing participant eligibility on Amazon's Mechanical Turk Addiction. https:\/\/doi.org\/10.1111\/add.15065","DOI":"10.1111\/add.15065"},{"key":"1665_CR35","unstructured":"Kraiger, K., McGonagle, A. K., & Sanchez, D. R. (2020). What's in a sample? Comparison of effect size replication and response quality across student, MTurk, and Qualtrics samples 11th Conference on Organizational Psychology: People and Risks, Saratov State University."},{"issue":"9","key":"1665_CR36","doi-asserted-by":"publisher","first-page":"606","DOI":"10.1046\/j.1525-1497.2001.016009606.x","volume":"16","author":"K Kroenke","year":"2001","unstructured":"Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606\u2013613.","journal-title":"Journal of General Internal Medicine"},{"key":"1665_CR37","doi-asserted-by":"crossref","unstructured":"Loepp, E., & Kelly, J. T. (2020). Distinction without a difference? An assessment of MTurk Worker types. Research & Politics, January\u2013March, 1\u20138.","DOI":"10.1177\/2053168019901185"},{"key":"1665_CR38","doi-asserted-by":"publisher","first-page":"109603","DOI":"10.1016\/j.paid.2019.109603","volume":"152","author":"CC MacInnis","year":"2020","unstructured":"MacInnis, C. C., Boss, H. C. D., & Bourdage, J. S. (2020). More evidence of participant misrepresentation on MTurk and investigating who misrepresents. Personality and Individual Differences, 152, 109603.","journal-title":"Personality and Individual Differences"},{"issue":"10","key":"1665_CR39","doi-asserted-by":"publisher","first-page":"1960","DOI":"10.1111\/add.15032","volume":"115","author":"AM Mellis","year":"2020","unstructured":"Mellis, A. M., & Bickel, W. K. (2020). Mechanical Turk data collection in addiction research: utility, concerns and best practices. Addiction, 115(10), 1960\u20131968. https:\/\/doi.org\/10.1111\/add.15032.","journal-title":"Addiction"},{"key":"1665_CR40","doi-asserted-by":"publisher","unstructured":"Merz, Z. C., Lace, J. W., & Einstein, A. M. (2020). Examining broad intellectual abilities obtained within an MTurk internet sample. Current Psychology. https:\/\/doi.org\/10.1007\/s12144-020-00741-0","DOI":"10.1007\/s12144-020-00741-0"},{"issue":"1","key":"1665_CR41","first-page":"1","volume":"7","author":"DW Nordstokke","year":"2007","unstructured":"Nordstokke, D. W., & Zumbo, B. D. (2007). A cautionary tale about Levene's Tests for Equal Variances. Educational Research & Policy Studies, 7(1), 1\u201314.","journal-title":"Educational Research & Policy Studies"},{"key":"1665_CR42","doi-asserted-by":"publisher","unstructured":"Ogletree, A. M., & Katz, B. (2020). How do older adults recruited using MTurk differ from those in a national probability sample? The International Journal of Aging and Human Development, Online First. https:\/\/doi.org\/10.1177\/0091415020940197","DOI":"10.1177\/0091415020940197"},{"issue":"1","key":"1665_CR43","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1177\/2167702619865973","volume":"8","author":"Y Ophir","year":"2019","unstructured":"Ophir, Y., Sisso, I., Asterhan, C.S.C., Tikochinski, R., & Reichart, R. (2019). The Turker blues: Hidden factors behind increased depression rates among Amazon\u2019s Mechanical Turkers. Clinical Psychological Science, 8(1), 65\u201383.","journal-title":"Clinical Psychological Science"},{"issue":"6","key":"1665_CR44","doi-asserted-by":"publisher","first-page":"1201","DOI":"10.1177\/0003122415607230","volume":"80","author":"D Peterson","year":"2015","unstructured":"Peterson, D. (2015). All that is solid: Bench-building at the frontiers of two experimental sciences. American Sociological Review, 80(6), 1201\u20131225.","journal-title":"American Sociological Review"},{"key":"1665_CR45","unstructured":"Prolific. (2018). Using attention checks as a measure of data quality. Prolific. Retrieved May 11 from https:\/\/researcher-help.prolific.co\/hc\/en-gb\/articles\/360009223553-Using-attention-checks-as-a-measure-of-data-quality"},{"key":"1665_CR46","unstructured":"Qualtrics. (2020). Randomizer. QualtricsXM. Retrieved September 4 from https:\/\/www.qualtrics.com\/support\/survey-platform\/survey-module\/survey-flow\/standard-elements\/randomizer\/"},{"key":"1665_CR47","doi-asserted-by":"crossref","unstructured":"Redmiles, E. M., Kross, S., & Mazurek, M. L. (2019). How well do my results generalize? Comparing security and privacy survey results from MTurk, web, and telephone samples 2019 IEEE Symposium on Security and Privacy (SP), San Francisco, CA.","DOI":"10.1109\/SP.2019.00014"},{"issue":"10","key":"1665_CR48","first-page":"1092","volume":"166","author":"RL Spitzer","year":"2006","unstructured":"Spitzer, R. L., Kroenke, K., Williams, J. B. W., & L\u00f6we, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. JAMA Internal Medicine, 166(10), 1092\u20131097.","journal-title":"JAMA Internal Medicine"},{"key":"1665_CR49","doi-asserted-by":"publisher","first-page":"390","DOI":"10.3389\/fpsyt.2018.00390","volume":"9","author":"S Tomitaka","year":"2018","unstructured":"Tomitaka, S., Kawasaki, Y., Ide, K., Akutagawa, M., Ono, Y., & Furukawa, T.A. (2018). Stability of the distribution of Patient Health Questionnaire-9 scores against age in the general population: Data from the National Health and Nutrition Examination Survey. Frontiers in Psychiatry, 9, 390.","journal-title":"Frontiers in Psychiatry"},{"key":"1665_CR50","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1002\/jts.22303","volume":"31","author":"K Van Stolk-Cooke","year":"2018","unstructured":"Van Stolk-Cooke, K., Brown, A., Maheux, A., Parent, J., Forehand, R., & Price, M. (2018). Crowdsourcing trauma: Psychopathology in a trauma-exposed sample recruited via Mechanical Turk. Journal of Traumatic Stress, 31, 549\u2013557.","journal-title":"Journal of Traumatic Stress"}],"container-title":["Behavior Research Methods"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.3758\/s13428-021-01665-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.3758\/s13428-021-01665-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.3758\/s13428-021-01665-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,27]],"date-time":"2022-04-27T17:12:43Z","timestamp":1651079563000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.3758\/s13428-021-01665-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,6]]},"references-count":50,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,4]]}},"alternative-id":["1665"],"URL":"https:\/\/doi.org\/10.3758\/s13428-021-01665-8","relation":{},"ISSN":["1554-3528"],"issn-type":[{"value":"1554-3528","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,6]]},"assertion":[{"value":"1 July 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 August 2021","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests related to the content of this manuscript.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}},{"value":"This study was reviewed by the Indiana University Institutional Review Board (IRB) prior to being conducted (#2011696997).","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"All participants digitally indicated consent to respond to questions about alcohol and mood prior to participating but were not informed that they would be randomized to different arms, nor that the purpose of the study was to assess the effects of data quality control techniques. A waiver for this incomplete informed consent was approved as part of the IRB review.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"n\/a","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Analytic code is available as a supplemental file alongside this article.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Code availability"}}]}}