{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T12:39:55Z","timestamp":1791549595151,"version":"4.3.4"},"reference-count":15,"publisher":"BMJ","issue":"2","license":[{"start":{"date-parts":[[2025,5,30]],"date-time":"2025-05-30T00:00:00Z","timestamp":1748563200000},"content-version":"unspecified","delay-in-days":59,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000241","name":"PSI Foundation","doi-asserted-by":"crossref","award":["23-03"],"award-info":[{"award-number":["23-03"]}],"id":[{"id":"10.13039\/501100000241","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Open Qual"],"accepted":{"date-parts":[[2025,4,30]]},"published-print":{"date-parts":[[2025,4]]},"abstract":"<jats:p>Online surveys are an increasingly common way to collect data from the public, with social media and financial incentives (e.g. gift cards) commonly used to increase participation rates. Anonymity, ease of response, and the potential to reach diverse demographics have also contributed to the popularity of online surveys. Health services research benefits from the increased accessibility that online survey-based data collection provides; however, fraudulent responses are of concern. The following article describes our team\u2019s experience with a national survey of Canadian healthcare providers being overrun with fraudulent responses and approach to ensure the validity of our survey data. We provide recommendations for research teams on how best to design their surveys, work with their institutions to implement safeguards within survey platforms, and screen completed responses. We also describe fraudulent open-text responses that we believe to have been produced with the help of artificial intelligence and are sounding the alarm for other researchers to be aware of this potential threat to data integrity. Informed by the learnings shared, researchers and research institutions can be better equipped to prevent and screen fraudulent responses to continue successfully engage the public in online research.<\/jats:p>","DOI":"10.1136\/bmjoq-2024-003208","type":"journal-article","created":{"date-parts":[[2025,6,1]],"date-time":"2025-06-01T16:35:12Z","timestamp":1748795712000},"page":"e003208","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":10,"title":["It\u2019s raining bots: how easier access to internet surveys has created the perfect storm"],"prefix":"10.1136","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-1834-284X","authenticated-orcid":false,"given":"Isabelle","family":"Caven","sequence":"first","affiliation":[{"name":"University Health Network, Toronto, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenxiao","family":"Yang","sequence":"additional","affiliation":[{"name":"University Health Network, Toronto, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Karen","family":"Okrainec","sequence":"additional","affiliation":[{"name":"University Health Network, Toronto, Ontario, Canada"},{"name":"Department of Medicine, University of Toronto, Toronto, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2025,6,1]]},"reference":[{"key":"2025083113215130000_14.2.e003208.1","unstructured":"Zhang Z , Zhu S , Mink J , et al . Beyond bot detection: combating fraudulent online survey takers\u2731. WWW \u201922; Virtual Event, Lyon France, April 25, 2022 doi:10.1145\/3485447.3512230 Available: https:\/\/dl.acm.org\/doi\/proceedings\/10.1145\/3485447"},{"key":"2025083113215130000_14.2.e003208.2","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pgph.0001452","article-title":"Identifying and preventing fraudulent responses in online public health surveys: Lessons learned during the COVID-19 pandemic","volume":"3","author":"Wang","year":"2023","journal-title":"PLOS Glob Public Health"},{"key":"2025083113215130000_14.2.e003208.3","doi-asserted-by":"publisher","DOI":"10.1111\/jlme.12200"},{"key":"2025083113215130000_14.2.e003208.4","doi-asserted-by":"publisher","DOI":"10.1002\/aepp.13353"},{"key":"2025083113215130000_14.2.e003208.5","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1002\/pan3.10557","article-title":"Addressing fraudulent responses in online surveys: Insights from a web\u2010based participatory mapping study","volume":"6","author":"Johnson","year":"2024","journal-title":"People and Nature"},{"key":"2025083113215130000_14.2.e003208.6","doi-asserted-by":"crossref","first-page":"472","DOI":"10.20982\/tqmp.16.5.p472","article-title":"Got Bots? Practical Recommendations to Protect Online Survey Data from Bot Attacks","volume":"16","author":"Storozuk","year":"2020","journal-title":"TQMP"},{"key":"2025083113215130000_14.2.e003208.7","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2019.103208"},{"key":"2025083113215130000_14.2.e003208.8","doi-asserted-by":"publisher","DOI":"10.1145\/966389.966390"},{"key":"2025083113215130000_14.2.e003208.9","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0311197","article-title":"ProCAPTCHA: A profile-based CAPTCHA for personal password authentication","volume":"19","author":"Nanglae","year":"2024","journal-title":"PLoS One"},{"key":"2025083113215130000_14.2.e003208.10","doi-asserted-by":"crossref","DOI":"10.2196\/resprot.7655","article-title":"Addressing Participant Validity in a Small Internet Health Survey (The Restore Study): Protocol and Recommendations for Survey Response Validation","volume":"7","author":"Dewitt","year":"2018","journal-title":"JMIR Res Protoc"},{"key":"2025083113215130000_14.2.e003208.11","doi-asserted-by":"crossref","DOI":"10.2196\/30730","article-title":"Strategies for the Identification and Prevention of Survey Fraud: Data Analysis of a Web-Based Survey","volume":"7","author":"Pratt-Chapman","year":"2021","journal-title":"JMIR Cancer"},{"key":"2025083113215130000_14.2.e003208.12","doi-asserted-by":"crossref","DOI":"10.2196\/47091","article-title":"Assessing and Improving Data Integrity in Web-Based Surveys: Comparison of Fraud Detection Systems in a COVID-19 Study","volume":"8","author":"Bonett","year":"2024","journal-title":"JMIR Form Res"},{"key":"2025083113215130000_14.2.e003208.13","doi-asserted-by":"crossref","DOI":"10.3389\/frma.2024.1432774","article-title":"AI-powered fraud and the erosion of online survey integrity: an analysis of 31 fraud detection strategies","volume":"9","author":"Pinz\u00f3n","year":"2024","journal-title":"Front Res Metr Anal"},{"key":"2025083113215130000_14.2.e003208.14","doi-asserted-by":"publisher","DOI":"10.1177\/1525822X12443097"},{"key":"2025083113215130000_14.2.e003208.15","doi-asserted-by":"crossref","DOI":"10.2196\/60184","article-title":"From Doubt to Confidence-Overcoming Fraudulent Submissions by Bots and Other Takers of a Web-Based Survey","volume":"26","author":"Hardesty","year":"2024","journal-title":"J Med Internet Res"}],"container-title":["BMJ Open Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjoq-2024-003208","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,31]],"date-time":"2025-08-31T20:22:00Z","timestamp":1756671720000},"score":1,"resource":{"primary":{"URL":"https:\/\/qir.bmj.com\/lookup\/doi\/10.1136\/bmjoq-2024-003208"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4]]},"references-count":15,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,6,1]]},"published-print":{"date-parts":[[2025,4]]}},"alternative-id":["10.1136\/bmjoq-2024-003208"],"URL":"https:\/\/doi.org\/10.1136\/bmjoq-2024-003208","relation":{},"ISSN":["2399-6641"],"issn-type":[{"value":"2399-6641","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4]]}}}