{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,15]],"date-time":"2026-03-15T05:49:31Z","timestamp":1773553771609,"version":"3.50.1"},"reference-count":46,"publisher":"Public Library of Science (PLoS)","issue":"11","license":[{"start":{"date-parts":[[2025,11,10]],"date-time":"2025-11-10T00:00:00Z","timestamp":1762732800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Kathy Ireland Endowed Chair for Psychiatric Research in the University of Alabama Heersink School of Medicine"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS One"],"abstract":"<jats:sec id=\"sec001\">\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>Since the COVID-19 pandemic, more researchers have used to online data collection to recruit participants to research studies. However, one perceived limitation of online data collection is a belief that it results in lower quality data due to the introduction of bots or misrepresentation by participants to qualify for study compensation. The current study demonstrates that following recommendations for online data collection results in quick collection of a high-quality, diverse, multi-state sample.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec002\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The current study followed recommendations for best practice, advertising on social media sites combined with investigator-implemented (e.g., splash page, attention checks, use of physical payment) and built-in Qualtrics tools (e.g., IP tracking, CAPTCHA) to collect data from participants who use substances from 15 states within the United States examining cannabis use and perceptions of harm reduction interventions (HRIs).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec003\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Before cleaning, 3,642 participants completed the screener across 172 days of survey up-time. After cleaning, the final sample included 639 responses in the final cannabis survey, and 1,137 responses in the final HRI survey including 264 participants completing both surveys. The study yielded approximately 8.8 cleaned surveys per day and a usable data rate of 60.3% for participants who completed the cannabis survey only, 72.4% for participants who completed the HRI survey only, and 72.6% for participants who completed both.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec004\">\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>While every method of data collection has strengths and weaknesses, when implemented using appropriate tools to prevent completion of surveys by non-valid participants, internet-based data collection methods can provide researchers with relatively low-cost, high-quality samples.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1371\/journal.pone.0336612","type":"journal-article","created":{"date-parts":[[2025,11,10]],"date-time":"2025-11-10T18:37:08Z","timestamp":1762799828000},"page":"e0336612","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":1,"title":["A national study of substance use: Demonstrated use of recommendations for best practice online data collection"],"prefix":"10.1371","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1902-3045","authenticated-orcid":true,"given":"Andrew P.","family":"Bontemps","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bailey E.","family":"Pridgen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William P.","family":"Wagner","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6921-3440","authenticated-orcid":true,"given":"Karen L.","family":"Cropsey","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2025,11,10]]},"reference":[{"key":"pone.0336612.ref001","doi-asserted-by":"crossref","first-page":"886680","DOI":"10.3389\/fpsyt.2022.886680","article-title":"In vivo experience with NRT to increase adherence and smoking abstinence among individuals in the criminal legal system: study protocol for a randomized clinical trial","volume":"13","author":"ES Hawes","year":"2022","journal-title":"Front Psychiatry"},{"key":"pone.0336612.ref002","doi-asserted-by":"crossref","first-page":"2055207618771757","DOI":"10.1177\/2055207618771757","article-title":"Using social media for health research: methodological and ethical considerations for recruitment and intervention delivery","volume":"4","author":"D Arigo","year":"2018","journal-title":"Digit Health"},{"key":"pone.0336612.ref003","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1037\/a0038087","article-title":"Social media recruitment and online data collection: a beginner\u2019s guide and best practices for accessing low-prevalence and hard-to-reach populations","volume":"55","author":"D King","year":"2014","journal-title":"Can Psychol"},{"issue":"3","key":"pone.0336612.ref004","doi-asserted-by":"crossref","first-page":"1380","DOI":"10.1111\/apps.12302","article-title":"Data collection via online platforms: challenges and recommendations for future research","volume":"70","author":"A Newman","year":"2021","journal-title":"Appl Psychol"},{"key":"pone.0336612.ref005","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.jesp.2017.01.006","article-title":"Beyond the Turk: alternative platforms for crowdsourcing behavioral research","volume":"70","author":"E Peer","year":"2017","journal-title":"J Exp Soc Psychol"},{"issue":"1","key":"pone.0336612.ref006","doi-asserted-by":"crossref","DOI":"10.29115\/SP-2020-0015","article-title":"Collecting online survey data: a comparison of data quality among a commercial panel & MTurk","volume":"13","author":"B Zhang","year":"2020","journal-title":"Surv Pract"},{"issue":"2","key":"pone.0336612.ref007","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1162\/COLI_a_00057","article-title":"Amazon mechanical turk: gold mine or coal mine?","volume":"37","author":"K Fort","year":"2011","journal-title":"Comput Linguist"},{"issue":"1","key":"pone.0336612.ref008","doi-asserted-by":"crossref","first-page":"400","DOI":"10.3758\/s13428-015-0578-z","article-title":"Attentive turkers: MTurk participants perform better on online attention checks than do subject pool participants","volume":"48","author":"DJ Hauser","year":"2016","journal-title":"Behav Res"},{"issue":"2","key":"pone.0336612.ref009","doi-asserted-by":"crossref","first-page":"1481","DOI":"10.1007\/s11135-024-02001-w","article-title":"Bots and baddies: supporting the integrity of online survey research in the face of a growing challenge","volume":"59","author":"E Hitches","year":"2024","journal-title":"Qual Quant"},{"key":"pone.0336612.ref010","article-title":"Too good to be true: bots and bad data from mechanical turk","author":"MA Webb","year":"2022","journal-title":"Perspect Psychol Sci"},{"issue":"6","key":"pone.0336612.ref011","doi-asserted-by":"crossref","first-page":"2156","DOI":"10.1016\/j.chb.2013.05.009","article-title":"Separate but equal? A comparison of participants and data gathered via Amazon\u2019s MTurk, social media, and face-to-face behavioral testing","volume":"29","author":"K Casler","year":"2013","journal-title":"Comput Hum Behav"},{"issue":"5","key":"pone.0336612.ref012","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1177\/1073191118760709","article-title":"Who are the turkers? A characterization of MTurk workers using the personality assessment inventory","volume":"26","author":"MN McCredie","year":"2019","journal-title":"Assessment"},{"issue":"4","key":"pone.0336612.ref013","doi-asserted-by":"crossref","first-page":"614","DOI":"10.1017\/psrm.2020.6","article-title":"The shape of and solutions to the MTurk quality crisis","volume":"8","author":"R Kennedy","year":"2020","journal-title":"PSRM"},{"issue":"8","key":"pone.0336612.ref014","doi-asserted-by":"crossref","first-page":"3139","DOI":"10.1016\/j.jbusres.2015.12.002","article-title":"A multi-group analysis of online survey respondent data quality: Comparing a regular USA consumer panel to MTurk samples","volume":"69","author":"SM Smith","year":"2016","journal-title":"J Bus Res"},{"key":"pone.0336612.ref015","doi-asserted-by":"crossref","DOI":"10.2196\/60184","article-title":"From doubt to confidence-overcoming fraudulent submissions by bots and other takers of a web-based survey","volume":"26","author":"JJ Hardesty","year":"2024","journal-title":"J Med Internet Res"},{"key":"pone.0336612.ref016","author":"C Rodriguez","year":"2023"},{"issue":"2","key":"pone.0336612.ref017","doi-asserted-by":"crossref","first-page":"885","DOI":"10.3758\/s13428-021-01665-8","article-title":"Quality control questions on Amazon\u2019s Mechanical Turk (MTurk): a randomized trial of impact on the USAUDIT, PHQ-9, and GAD-7","volume":"54","author":"J Agley","year":"2022","journal-title":"Behav Res"},{"key":"pone.0336612.ref018","doi-asserted-by":"crossref","DOI":"10.2139\/ssrn.4991773","volume-title":"Experiments on social media","author":"G Aridor","year":"2024"},{"key":"pone.0336612.ref019","volume-title":"Monitoring the Future |National Survey Results on Drug Use, 1975-2023: Secondary School Students","author":"RA Miech","year":"2023"},{"key":"pone.0336612.ref020","author":"RA Miech","year":"2024"},{"key":"pone.0336612.ref021","year":"2023"},{"issue":"1","key":"pone.0336612.ref022","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1186\/s12913-016-1630-0","article-title":"Technological aids for improving longitudinal research on substance use disorders","volume":"16","author":"D Farabee","year":"2016","journal-title":"BMC Health Serv Res"},{"key":"pone.0336612.ref023","author":"J Gfroerer","year":"2014"},{"key":"pone.0336612.ref024","first-page":"1","article-title":"Methods for population research on substance use and consequences","volume":"258","author":"M Wolfson","year":"2020","journal-title":"Handb Exp Pharmacol"},{"issue":"3","key":"pone.0336612.ref025","first-page":"248","article-title":"Substance use disorders and COVID-19: the role of telehealth in treatment and research","volume":"20","author":"BA Kleykamp","year":"2020","journal-title":"JSWPA"},{"issue":"6","key":"pone.0336612.ref026","doi-asserted-by":"crossref","first-page":"755","DOI":"10.15288\/jsa.2002.63.755","article-title":"Mode effects for collecting alcohol and other drug use data: web and U.S. mail","volume":"63","author":"SE McCabe","year":"2002","journal-title":"J Stud Alcohol"},{"issue":"5","key":"pone.0336612.ref027","doi-asserted-by":"crossref","first-page":"834","DOI":"10.15288\/jsad.2012.73.834","article-title":"Innovative recruitment using online networks: lessons learned from an online study of alcohol and other drug use utilizing a web-based, respondent-driven sampling (webRDS) strategy","volume":"73","author":"JA Bauermeister","year":"2012","journal-title":"J Stud Alcohol Drugs"},{"key":"pone.0336612.ref028"},{"key":"pone.0336612.ref029","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/j.drugpo.2016.02.022","article-title":"Smoking, vaping, eating: Is legalization impacting the way people use cannabis?","volume":"36","author":"JT Borodovsky","year":"2016","journal-title":"Int J Drug Policy"},{"key":"pone.0336612.ref030","volume-title":"Conducting surveys and interventions entirely online: a virtual lab practitioner\u2019s manual","author":"N Rao","year":"2020"},{"key":"pone.0336612.ref031","first-page":"207","article-title":"Social media recruitment in online survey research: a systematic literature review","volume":"17","author":"Z Zindel","year":"2023","journal-title":"EBSCOhost"},{"key":"pone.0336612.ref032"},{"key":"pone.0336612.ref033","author":"Bureau UC"},{"issue":"1","key":"pone.0336612.ref034","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1186\/s42238-020-00018-0","article-title":"The relationship of cannabis decriminalization in Colorado and cannabis use in individuals with alcohol use disorders","volume":"2","author":"JT Hua","year":"2020","journal-title":"J Cannabis Res"},{"key":"pone.0336612.ref035","doi-asserted-by":"crossref","DOI":"10.3389\/fpsyt.2022.1060656","article-title":"The clouded debate: a systematic review of comparative longitudinal studies examining the impact of recreational cannabis legalization on key public health outcomes","volume-title":"Front Psychiatry","author":"M Athanassiou","year":"2023"},{"key":"pone.0336612.ref036","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1016\/j.drugalcdep.2017.07.027","article-title":"Race\/ethnicity and marijuana use in the United States: diminishing differences in the prevalence of use, 2006\u20132015","volume":"179","author":"KM Keyes","year":"2017","journal-title":"Drug Alcohol Depend"},{"key":"pone.0336612.ref037","doi-asserted-by":"crossref","first-page":"107900","DOI":"10.1016\/j.drugalcdep.2020.107900","article-title":"Modes of marijuana use \u2013 smoking, vaping, eating, and dabbing: results from the 2016 BRFSS in 12 States","volume":"209","author":"GL Schauer","year":"2020","journal-title":"Drug Alcohol Depend"},{"issue":"6","key":"pone.0336612.ref038","doi-asserted-by":"crossref","first-page":"1493","DOI":"10.1007\/s11606-022-07948-w","article-title":"Cannabis recreational legalization and prevalence of simultaneous cannabis and alcohol use in the United States","volume":"38","author":"PD Gon\u00e7alves","year":"2023","journal-title":"J Gen Intern Med"},{"issue":"3","key":"pone.0336612.ref039","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1016\/j.jadohealth.2022.10.010","article-title":"Adolescent cannabis use during a period of rapid policy change: evidence from the PATH study","volume":"72","author":"MM Orsini","year":"2023","journal-title":"J Adolesc Health"},{"key":"pone.0336612.ref040","doi-asserted-by":"crossref","first-page":"1432774","DOI":"10.3389\/frma.2024.1432774","article-title":"AI-powered fraud and the erosion of online survey integrity: an analysis of 31 fraud detection strategies","volume":"9","author":"N Pinz\u00f3n","year":"2024","journal-title":"Front Res Metr Anal"},{"issue":"1","key":"pone.0336612.ref041","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1177\/14707853241297009","article-title":"Bots in web survey interviews: a showcase","volume":"67","author":"JK H\u00f6hne","year":"2024","journal-title":"Int J Market Res"},{"issue":"9","key":"pone.0336612.ref042","doi-asserted-by":"crossref","first-page":"1624","DOI":"10.1111\/add.16200","article-title":"Agreement between self-reported illicit drug use and biological samples: a systematic review and meta-analysis","volume":"118","author":"C Bharat","year":"2023","journal-title":"Addiction"},{"issue":"3","key":"pone.0336612.ref043","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1080\/16066359.2021.1961759","article-title":"Willingness to use syringe service programs and safe consumption sites among methadone patients with histories of injection drug use in a small Midwest community","volume":"30","author":"E Pasman","year":"2022","journal-title":"Addict Res Theory"},{"key":"pone.0336612.ref044","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.drugpo.2017.11.005","article-title":"Perceptions about supervised injection facilities among people who inject drugs in Philadelphia","volume":"52","author":"RE Harris","year":"2018","journal-title":"Int J Drug Policy"},{"key":"pone.0336612.ref045","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.drugpo.2019.03.003","article-title":"Acceptability of implementing community-based drug checking services for people who use drugs in three United States cities: Baltimore, Boston and Providence","volume":"68","author":"SG Sherman","year":"2019","journal-title":"Int J Drug Policy"},{"issue":"7","key":"pone.0336612.ref046","doi-asserted-by":"crossref","first-page":"858","DOI":"10.1080\/10826080701801261","article-title":"Evaluation of a naloxone distribution and administration program in New York City","volume":"43","author":"TM Piper","year":"2008","journal-title":"Subst Use Misuse"}],"container-title":["PLOS One"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0336612","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,10]],"date-time":"2025-11-10T18:37:15Z","timestamp":1762799835000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0336612"}},"subtitle":[],"editor":[{"given":"Souparno","family":"Mitra","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2025,11,10]]},"references-count":46,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025,11,10]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0336612","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,10]]}}}