{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:46:05Z","timestamp":1782845165309,"version":"3.54.5"},"reference-count":31,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n As technology continues to shape the landscape of health research, the utilization of web-based surveys for collecting sexual health information among adolescents and young adults has become increasingly prevalent. However, this shift toward digital platforms brings forth a new set of challenges, particularly the infiltration of automated bots that can compromise data integrity and the reliability of survey results.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n We aimed to outline the data verification process used in our study design, which employed survey programming and data cleaning protocols.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n A 26-item survey was developed and programmed with several data integrity functions, including reCAPTCHA scores, RelevantID fraud and duplicate scores, verification of IP addresses, and honeypot questions. Participants aged 15\u201024 years were recruited via social media advertisements over 7 weeks and received a US $15 incentive after survey completion. Data verification occurred through a 2-part cleaning process, which removed responses that were incomplete, flagged as spam by Qualtrics, or from duplicate IP addresses, or those that did not meet the inclusion criteria. Final comparisons of reported age with date of birth and reported state with state inclusion criteria were performed. Participants who completed the study survey were linked to a second survey to receive their incentive. Responses without first and last names and full addresses were removed, as were those with duplicate IP addresses or the exact same longitude and latitude coordinates. Finally, IP addresses used to complete both surveys were compared, and consistent responses were eligible for an incentive.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Over 7 weeks, online advertisements for a web-based survey reached 1.4 million social media users. Of the 20,585 survey responses received, 4589 (22.3%) were verified. Incentives were sent to 462 participants; of these, 14 responses were duplicates and 3 contained discrepancies, resulting in a final sample of 445 responses.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Confidential web-based surveys are an appealing method for reaching populations\u2014particularly adolescents and young adults, who may be reluctant to disclose sensitive information to family, friends, or clinical providers. Web-based surveys are a useful tool for researchers targeting hard-to-reach populations due to the difficulty in obtaining a representative sample. However, researchers face the ongoing threat of bots and fraudulent participants in a technology-driven world, necessitating the adoption of evolving bot detection software and tailored protocols for data collection in unique contexts.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/56788","type":"journal-article","created":{"date-parts":[[2024,10,10]],"date-time":"2024-10-10T07:40:08Z","timestamp":1728546008000},"page":"e56788-e56788","source":"Crossref","is-referenced-by-count":5,"title":["Data Verification and Respondent Validity for a Web-Based Sexual Health Survey: Tutorial"],"prefix":"10.2196","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6428-8013","authenticated-orcid":false,"given":"Jayelin N","family":"Parker","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6045-0252","authenticated-orcid":false,"given":"Theresa L","family":"Rager","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2434-6829","authenticated-orcid":false,"given":"Jade","family":"Burns","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5460-4932","authenticated-orcid":false,"given":"Okeoma","family":"Mmeje","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2024,12,9]]},"reference":[{"issue":"4","key":"R1","doi-asserted-by":"publisher","first-page":"208","DOI":"10.1097\/00007435-199904000-00004","article-title":"Concurrent sex partners and risk for sexually transmitted diseases among adolescents","volume":"26","author":"Rosenberg","journal-title":"Sex Transm Dis"},{"issue":"1","key":"R2","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1016\/j.jadohealth.2022.02.004","article-title":"Sexual concurrency among adolescent women with multiple partners: a daily diary study","volume":"71","author":"Hensel","journal-title":"J Adolesc Health"},{"issue":"4","key":"R3","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.5.4.e32","article-title":"How adolescents use technology for health information: implications for health professionals from focus group studies","volume":"5","author":"Skinner","journal-title":"J Med Internet Res"},{"key":"R4","unstructured":"Adolescents\u2019 reports of formal sexual health education. Guttmacher Institute. Dec2017. URL: https:\/\/www.guttmacher.org\/sites\/default\/files\/factsheet\/facts-american-teens-sources-information-about-sex.pdf [Accessed 01-11-2024]"},{"issue":"5","key":"R5","doi-asserted-by":"publisher","first-page":"693","DOI":"10.1177\/1524839920938704","article-title":"Qualitative evaluation of social media and mobile technology interventions designed to improve HIV health outcomes for youth and young adults living with HIV: a HRSA SPNS initiative","volume":"21","author":"Brooks","journal-title":"Health Promot Pract"},{"issue":"5","key":"R6","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1016\/j.jadohealth.2022.05.012","article-title":"Adolescent perceptions of technology-based sexual and reproductive health services: a systematic review","volume":"71","author":"Rea","journal-title":"J Adolesc Health"},{"issue":"2","key":"R7","doi-asserted-by":"publisher","first-page":"762","DOI":"10.1002\/aepp.13353","article-title":"Battling bots: experiences and strategies to mitigate fraudulent responses in online surveys","volume":"45","author":"Goodrich","journal-title":"Appl Eco Perspect Pol"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.1016\/j.eclinm.2021.100764","article-title":"The role of sexually transmitted infections (STI) prevention and control programs in reducing gender, sexual and STI-related stigma","volume":"33","author":"Garcia","journal-title":"E Clin Med"},{"issue":"10","key":"R9","doi-asserted-by":"publisher","DOI":"10.2196\/23021","article-title":"Threats of bots and other bad actors to data quality following research participant recruitment through social media: cross-sectional questionnaire","volume":"22","author":"Pozzar","journal-title":"J Med Internet Res"},{"issue":"4","key":"R10","doi-asserted-by":"publisher","first-page":"2841","DOI":"10.1007\/s11135-021-01252-1","article-title":"Ensuring survey research data integrity in the era of internet bots","volume":"56","author":"Griffin","journal-title":"Qual Quant"},{"issue":"2","key":"R11","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1089\/cyber.2022.0173","article-title":"Internet-based mental health survey research: navigating internet bots on Reddit","volume":"26","author":"Mournet","journal-title":"Cyberpsychol Behav Soc Netw"},{"key":"R12","doi-asserted-by":"publisher","DOI":"10.1016\/j.paid.2023.112289","article-title":"Bots are the new fraud: a post-hoc exploration of statistical methods to identify bot-generated responses in a corrupt data set","volume":"213","author":"Irish","journal-title":"Pers Individ Dif"},{"key":"R13","unstructured":"Luna-Lucero M . Bots and online human subjects research. Teachers College Columbia University. Aug11, 2022. URL: https:\/\/www.tc.columbia.edu\/institutional-review-board\/irb-blog\/2022\/bots-and-online-human-subjects-research [Accessed 24-10-2024]"},{"key":"R14","unstructured":"Trajcheva S . Survey bots exposed: how they manipulate data and skew results. CHEQ. Oct17, 2023. URL: https:\/\/cheq.ai\/blog\/survey-bots-skew-results [Accessed 24-10-2024]"},{"issue":"2","key":"R15","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1097\/QAI.0000000000003035","article-title":"Overcoming challenges of online research: measures to ensure enrollment of eligible participants","volume":"91","author":"Campbell","journal-title":"J Acquir Immune Defic Syndr"},{"key":"R16","doi-asserted-by":"crossref","unstructured":"Shaw TJ Cascalheira CJ Helminen EC et al. Yes stormtrooper, these are the droids you\u2019re looking for: a method paper evaluating bot detection strategies in online psychological research. PsyArXiv. Preprint posted online onFeb7, 2023. [doi: 10.31234\/osf.io\/gtp6z]","DOI":"10.31234\/osf.io\/gtp6z"},{"issue":"8","key":"R17","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pgph.0001452","article-title":"Identifying and preventing fraudulent responses in online public health surveys: lessons learned during the COVID-19 pandemic","volume":"3","author":"Wang","journal-title":"PLOS Glob Public Health"},{"issue":"7799","key":"R18","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-020-00768-0","article-title":"Mischief-making bots attacked my scientific survey","volume":"579","author":"Perkel","journal-title":"Nat New Biol"},{"key":"R19","unstructured":"Qualtrics XM. Qualtrics. URL: https:\/\/www.qualtrics.com [Accessed 24-10-2024]"},{"key":"R20","doi-asserted-by":"crossref","unstructured":"von Ahn L Blum M Hopper NJ Langford J . CAPTCHA: using hard AI problems for security. In: Biham E , editor. Advances in Cryptology \u2013 EUROCRYPT 2003: International Conference on the Theory and Applications of Cryptographic Techniques, Warsaw, Poland, May 4-8, 2003, Proceedings. Springer; 2003:294-311. [doi: 10.1007\/3-540-39200-9_18]","DOI":"10.1007\/3-540-39200-9_18"},{"key":"R21","unstructured":"ReCAPTCHA v3. Google for Developers. URL: https:\/\/developers.google.com\/recaptcha\/docs\/v3#interpreting_the_score [Accessed 24-10-2024]"},{"key":"R22","unstructured":"Fraud detection. Qualtrics. URL: https:\/\/www.qualtrics.com\/support\/survey-platform\/survey-module\/survey-checker\/fraud-detection\/ [Accessed 24-10-2024]"},{"key":"R23","unstructured":"Sexually transmitted disease surveillance 2020. Centers for Disease Control and Prevention. URL: https:\/\/www.cdc.gov\/std\/statistics\/2020\/2020-SR-4-10-2023.pdf [Accessed 24-10-2024]"},{"key":"R24","unstructured":"Simone M . Bots started sabotaging my online research. I fought back. STAT. Nov21, 2019. URL: https:\/\/www.statnews.com\/2019\/11\/21\/bots-started-sabotaging-my-online-research-i-fought-back [Accessed 24-10-2024]"},{"issue":"4","key":"R25","doi-asserted-by":"publisher","DOI":"10.2196\/resprot.7655","article-title":"Addressing participant validity in a small internet health survey (the Restore study): protocol and recommendations for survey response validation","volume":"7","author":"Dewitt","journal-title":"JMIR Res Protoc"},{"key":"R26","doi-asserted-by":"crossref","unstructured":"Nerurkar AK Thampi GT Motwani D Chaudhari K Panhale P . Intelligent robotic process automation that shall make captcha security ineffective. Presented at: Proceedings of the International Conference on Engineering Research and Application 2022 (ICERA 2022); Oct 6-7, 2022; Dehradun, India. [doi: 10.1063\/5.0175270]","DOI":"10.1063\/5.0175270"},{"issue":"1","key":"R27","first-page":"56","volume":"11","author":"Fass-Holmes","journal-title":"J Interdiscip Stud Educ"},{"issue":"1","key":"R28","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1186\/s12874-022-01556-2","article-title":"Using a consistency check during data collection to identify invalid responding in an online cannabis screening survey","volume":"22","author":"Schell","journal-title":"BMC Med Res Methodol"},{"issue":"3","key":"R29","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1007\/s11121-016-0644-5","article-title":"Principled missing data treatments","volume":"19","author":"Lang","journal-title":"Prev Sci"},{"issue":"5","key":"R30","doi-asserted-by":"publisher","first-page":"740","DOI":"10.1177\/0886260517744845","article-title":"Conducting anonymous, incentivized, online surveys with sexual and gender minority adolescents: lessons learned from a national polyvictimization study","volume":"33","author":"Sterzing","journal-title":"J Interpers Violence"},{"key":"R31","unstructured":"Rager T Mmeje O Parker J . National perspectives of youth (SoMe) dataset and key. University of Michigan Deep Blue Data. URL: https:\/\/doi.org\/10.7302\/72jv-qt42 [Accessed 24-10-2024]"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/formative.jmir.org\/2024\/1\/e56788","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:46:12Z","timestamp":1782841572000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2024\/1\/e56788"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,9]]},"references-count":31,"URL":"https:\/\/doi.org\/10.2196\/56788","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,9]]},"article-number":"v8i4e56788"}}