{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,29]],"date-time":"2026-10-29T17:20:31Z","timestamp":1793294431679,"version":"4.5.0"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2025,5,3]],"date-time":"2025-05-03T00:00:00Z","timestamp":1746230400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2025,5,3]],"date-time":"2025-05-03T00:00:00Z","timestamp":1746230400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/501100007658","name":"Crohn's and Colitis Canada","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100007658","id-type":"DOI","asserted-by":"publisher"}]},{"name":"The IMAGINE Network"},{"DOI":"10.13039\/501100000024","name":"Canadian Institute of Health Research","doi-asserted-by":"crossref","award":["1715-000-001"],"award-info":[{"award-number":["1715-000-001"]}],"id":[{"id":"10.13039\/501100000024","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Patient"],"published-print":{"date-parts":[[2025,7]]},"DOI":"10.1007\/s40271-025-00740-y","type":"journal-article","created":{"date-parts":[[2025,5,3]],"date-time":"2025-05-03T01:43:34Z","timestamp":1746236614000},"page":"373-390","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Identifying and Managing Fraudulent Respondents in Online Stated Preferences Surveys: A Case Example from Best\u2013Worst Scaling in Health Preferences Research"],"prefix":"10.1007","volume":"18","author":[{"given":"Karen V.","family":"MacDonald","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Geoffrey C.","family":"Nguyen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maida J.","family":"Sewitch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8467-8008","authenticated-orcid":false,"given":"Deborah A.","family":"Marshall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,5,3]]},"reference":[{"issue":"3","key":"740_CR1","doi-asserted-by":"publisher","first-page":"1380","DOI":"10.1111\/apps.12302","volume":"70","author":"A Newman","year":"2021","unstructured":"Newman A, Bavik YL, Mount M, Shao B. Data collection via online platforms: challenges and recommendations for future research. Appl Psychol. 2021;70(3):1380\u2013402.","journal-title":"Appl Psychol"},{"issue":"4","key":"740_CR2","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1037\/a0038087","volume":"55","author":"DB King","year":"2014","unstructured":"King DB, O\u2019Rourke N, DeLongis A. Social media recruitment and online data collection: a beginner\u2019s guide and best practices for accessing low-prevalence and hard-to-reach populations. Can Psychol. 2014;55(4):240\u20139.","journal-title":"Can Psychol"},{"key":"740_CR3","doi-asserted-by":"publisher","first-page":"205520761986722","DOI":"10.1177\/2055207619867223","volume":"5","author":"C Benedict","year":"2019","unstructured":"Benedict C, Hahn AL, Diefenbach MA, Ford JS. Recruitment via social media: advantages and potential biases. Digital Health. 2019;5:2055207619867223.","journal-title":"Digital Health."},{"key":"740_CR4","doi-asserted-by":"publisher","DOI":"10.2196\/47705","volume":"25","author":"Q Oudat","year":"2023","unstructured":"Oudat Q, Bakas T. Merits and pitfalls of social media as a platform for recruitment of study participants. J Med Internet Res. 2023;25: e47705.","journal-title":"J Med Internet Res"},{"key":"740_CR5","doi-asserted-by":"publisher","DOI":"10.1007\/s40271-024-00695-6","author":"S Ozdemir","year":"2024","unstructured":"Ozdemir S, Quaife M, Mohamed AF, Norman R. An overview of data collection in health preference research. Patient. 2024. https:\/\/doi.org\/10.1007\/s40271-024-00695-6.","journal-title":"Patient"},{"issue":"10","key":"740_CR6","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0287766","volume":"18","author":"JM Gonzalez","year":"2023","unstructured":"Gonzalez JM, Grover K, Leblanc TW, Reeve BB. Did a bot eat your homework? An assessment of the potential impact of bad actors in online administration of preference surveys. PLoS\u00a0One. 2023;18(10): e0287766.","journal-title":"PLoS\u00a0One"},{"key":"740_CR7","unstructured":"Global Data Quality. Global data quality glossary 2024 [accessed: 2024 10 28]. Available from: https:\/\/www.globaldataquality.org\/glossary."},{"issue":"1","key":"740_CR8","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1111\/jlme.12200","volume":"43","author":"JEF Teitcher","year":"2021","unstructured":"Teitcher JEF, Bockting WO, Bauermeister JA, Hoefer CJ, Miner MH, Klitzman RL. Detecting, preventing, and responding to \u201cfraudsters\u201d in internet research: ethics and tradeoffs. J Law Med Ethics. 2021;43(1):116\u201333.","journal-title":"J Law Med Ethics"},{"issue":"3","key":"740_CR9","doi-asserted-by":"publisher","first-page":"205979912110504","DOI":"10.1177\/20597991211050467","volume":"14","author":"J Lawlor","year":"2021","unstructured":"Lawlor J, Thomas C, Guhin AT, Kenyon K, Lerner MD, Drahota A. Suspicious and fraudulent online survey participation: introducing the REAL framework. Methodol Innov. 2021;14(3):20597991211050468.","journal-title":"Methodol Innov."},{"issue":"3","key":"740_CR10","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1093\/poq\/nfv015","volume":"79","author":"MS Jones","year":"2015","unstructured":"Jones MS, House LA, Gao Z. Respondent screening and revealed preference axioms: testing quarantining methods for enhanced data quality in web panel surveys. Public Opin Q. 2015;79(3):687\u2013709.","journal-title":"Public Opin Q"},{"issue":"6","key":"740_CR11","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1080\/14737167.2017.1389648","volume":"17","author":"EM Janssen","year":"2017","unstructured":"Janssen EM, Marshall DA, Hauber AB, Bridges JFP. Improving the quality of discrete-choice experiments in health: how can we assess validity and reliability? Expert Rev Pharmacoecon Outcomes Res. 2017;17(6):531\u201342.","journal-title":"Expert Rev Pharmacoecon Outcomes Res"},{"issue":"8","key":"740_CR12","doi-asserted-by":"publisher","first-page":"1381","DOI":"10.1016\/j.jval.2022.01.015","volume":"25","author":"MF Jonker","year":"2022","unstructured":"Jonker MF, Roudijk B, Maas M. The sensitivity and specificity of repeated and dominant choice tasks in discrete choice experiments. Value Health. 2022;25(8):1381\u20139.","journal-title":"Value Health."},{"issue":"2","key":"740_CR13","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/j.jval.2018.07.876","volume":"22","author":"FR Johnson","year":"2019","unstructured":"Johnson FR, Yang JC, Reed SD. The internal validity of discrete choice experiment data: a testing tool for quantitative assessments. Value Health. 2019;22(2):157\u201360.","journal-title":"Value Health."},{"issue":"4","key":"740_CR14","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1007\/s40271-023-00625-y","volume":"16","author":"J Veldwijk","year":"2023","unstructured":"Veldwijk J, Marceta SM, Swait JD, Lipman SA, de Bekker-Grob EW. Taking the shortcut: simplifying heuristics in discrete choice experiments. Patient. 2023;16(4):301\u201315.","journal-title":"Patient"},{"key":"740_CR15","doi-asserted-by":"crossref","first-page":"729","DOI":"10.1007\/s40271-022-00601-y","volume":"15","author":"DA Marshall","year":"2022","unstructured":"Marshall DA, MacDonald KV, Johnson FR. Wrong or unexpected? Using internal validity tests to understand stated preference survey results. Patient. 2022;15:729\u201338.","journal-title":"Patient"},{"key":"740_CR16","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781107337855","volume-title":"Best-worst scaling: theory, methods and applications","author":"JJ Louviere","year":"2015","unstructured":"Louviere JJ, Flynn TN, Marley AAJ. Best-worst scaling: theory, methods and applications. Cambridge: Cambridge University Press; 2015."},{"issue":"1","key":"740_CR17","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1186\/s13561-015-0079-x","volume":"6","author":"AC M\u00fchlbacher","year":"2016","unstructured":"M\u00fchlbacher AC, Kaczynski A, Zweifel P, Johnson FR. Experimental measurement of preferences in health and healthcare using best\u2013worst scaling: an overview. Health Econ Rev. 2016;6(1):2.","journal-title":"Health Econ Rev."},{"issue":"9","key":"740_CR18","doi-asserted-by":"publisher","first-page":"883","DOI":"10.1007\/s40273-022-01167-1","volume":"40","author":"IL Hollin","year":"2022","unstructured":"Hollin IL, Paskett J, Schuster ALR, Crossnohere NL, Bridges JFP. Best\u2013worst scaling and the prioritization of objects in health: a systematic review. Pharmacoeconomics. 2022;40(9):883\u201399.","journal-title":"Pharmacoeconomics"},{"key":"740_CR19","doi-asserted-by":"publisher","DOI":"10.1016\/j.jocm.2023.100466","volume":"50","author":"ALR Schuster","year":"2024","unstructured":"Schuster ALR, Crossnohere NL, Campoamor NB, Hollin IL, Bridges JFP. The rise of best\u2013worst scaling for prioritization: a transdisciplinary literature review. J Choice Modell. 2024;50: 100466.","journal-title":"J Choice Modell."},{"issue":"3","key":"740_CR20","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1023\/A:1023254226592","volume":"12","author":"D Collins","year":"2003","unstructured":"Collins D. Pretesting survey instruments: an overview of cognitive methods. Qual Life Res. 2003;12(3):229\u201338.","journal-title":"Qual Life Res"},{"key":"740_CR21","volume-title":"The practice of survey research: theory and applications","author":"E Ruel","year":"2015","unstructured":"Ruel E, Wagner WI, Gillespie B. Pretesting and pilot testing. In: Ruel E, editor. The practice of survey research: theory and applications. SAGE Publications, Inc.; 2015."},{"key":"740_CR22","unstructured":"Lipovetsky S, Liakhovitski D, Conklin M, editors. What is the right size for my MaxDiff study? Sawtooth Software Conference; 2015; Orlando, Florida, USA: Sawtooth Software."},{"key":"740_CR23","doi-asserted-by":"crossref","unstructured":"von Ahn L, Blum M, Hopper NJ, Langford J, editors. CAPTCHA: using hard AI problems for security. Advances in Cryptology \u2014 EUROCRYPT 2003; 2003 2003; Berlin, Heidelberg: Springer Berlin Heidelberg.","DOI":"10.1007\/3-540-39200-9_18"},{"key":"740_CR24","unstructured":"Qualtrics XM. Fraud detection 2024 [accessed: September 25, 2024]. Available from: https:\/\/www.qualtrics.com\/support\/survey-platform\/survey-module\/survey-checker\/fraud-detection\/."},{"issue":"5","key":"740_CR25","doi-asserted-by":"publisher","first-page":"472","DOI":"10.20982\/tqmp.16.5.p472","volume":"16","author":"A Storozuk","year":"2020","unstructured":"Storozuk A, Ashley M, Delage V, Maloney EA. Got bots? practical recommendations to protect online survey data from bot attacks. Quant Methods Psychol. 2020;16(5):472\u201381.","journal-title":"Quant Methods Psychol."},{"issue":"7","key":"740_CR26","first-page":"235","volume":"42","author":"C Yarrish","year":"2019","unstructured":"Yarrish C, Groshon L, Mitchell JD, Appelbaum A, Klock S, Winternitz T, et al. Finding the signal in the noise: minimizing responses from bots and inattentive humans in online research. Behav Ther. 2019;42(7):235\u201342.","journal-title":"Behav Ther"},{"issue":"6","key":"740_CR27","doi-asserted-by":"publisher","first-page":"464","DOI":"10.1016\/j.jmp.2005.05.003","volume":"49","author":"AAJ Marley","year":"2005","unstructured":"Marley AAJ, Louviere JJ. Some probabilistic models of best, worst, and best\u2013worst choices. J Math Psychol. 2005;49(6):464\u201380.","journal-title":"J Math Psychol"},{"issue":"3","key":"740_CR28","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1177\/002224379303000303","volume":"30","author":"J Swait","year":"1993","unstructured":"Swait J, Louviere J. The role of the scale parameter in the estimation and comparison of multinomial logit models. J Mark Res. 1993;30(3):305\u201314.","journal-title":"J Mark Res"},{"issue":"2","key":"740_CR29","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1007\/s40271-017-0282-4","volume":"11","author":"CM Vass","year":"2018","unstructured":"Vass CM, Wright S, Burton M, Payne K. Scale heterogeneity in healthcare discrete choice experiments: a primer. Patient. 2018;11(2):167\u201373.","journal-title":"Patient"},{"issue":"6","key":"740_CR30","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1080\/13696998.2018.1553781","volume":"22","author":"KL Cheung","year":"2019","unstructured":"Cheung KL, Mayer S, Simon J, de Vries H, Evers SMAA, Kremer IEH, et al. Comparison of statistical analysis methods for object case best\u2013worst scaling. J Med Econ. 2019;22(6):509\u201315.","journal-title":"J Med Econ"},{"key":"740_CR31","doi-asserted-by":"publisher","first-page":"311","DOI":"10.4337\/9781781003152","volume-title":"Handbook of choice modelling","author":"S Hess","year":"2014","unstructured":"Hess S. Latent class structures: taste heterogeneity and beyond. In: Hess S, Daly A, editors. Handbook of choice modelling. Cheltenham: Edward Elgar Publishers; 2014. p. 311\u201330."},{"key":"740_CR32","volume-title":"Stata statistical software: release 18","author":"StataCorp","year":"2023","unstructured":"StataCorp. Stata statistical software: release 18. College Station: StataCorp LLC; 2023."},{"issue":"2","key":"740_CR33","first-page":"127","volume":"8","author":"C Zhang","year":"2014","unstructured":"Zhang C, Conrad F. Speeding in web surveys: the tendency to answer very fast and its association with straightlining. Survey Res Methods. 2014;8(2):127\u201335.","journal-title":"Survey Res Methods."},{"issue":"2","key":"740_CR34","doi-asserted-by":"publisher","DOI":"10.1093\/qopen\/qoad019","volume":"3","author":"C Bir","year":"2023","unstructured":"Bir C, Widmar NO, Slipchenko N, Polcyn A, Wolf CA. Employing a transitivity violation detection algorithm to assess best\u2013worst scaling designs. Q Open. 2023;3(2): qoad019.","journal-title":"Q Open"}],"container-title":["The Patient - Patient-Centered Outcomes Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40271-025-00740-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40271-025-00740-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40271-025-00740-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,16]],"date-time":"2025-06-16T13:45:53Z","timestamp":1750081553000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40271-025-00740-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,3]]},"references-count":34,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,7]]}},"alternative-id":["740"],"URL":"https:\/\/doi.org\/10.1007\/s40271-025-00740-y","relation":{},"ISSN":["1178-1653","1178-1661"],"issn-type":[{"value":"1178-1653","type":"print"},{"value":"1178-1661","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,3]]},"assertion":[{"value":"23 March 2025","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 May 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This research was supported by funding from Grant-in-Aid from Crohn\u2019s and Colitis Canada and the IMAGINE Network. The IMAGINE Network is supported by a grant from the Canadian Institute of Health Research (funding reference number: 1715-000-001) with funding from several partners.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Funding"}},{"value":"All authors declare no conflicts of interest.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of Interest"}},{"value":"Participant data will not be made available to other researchers as study participants did not consent to have their data shared beyond use in this study. A copy of the study survey and more details on statistical methods are available upon request.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Data Availability"}},{"value":"The University of Calgary Conjoint Health Research Ethics Board (REB18-0105) and Sinai Hospital Research Ethics Committee (REB17-0720-E) approved this study. Electronic informed consent was obtained from all individual participants included in this study.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval and Consent to Participate"}},{"value":"Conceptualization: K.V.M. and D.M. Funding acquisition: G.C.N., M.J.S., and D.A.M. Data curation and formal analysis: K.V.M. Interpretation of data: K.V.M., G.C.N., M.J.S., and D.A.M. Methodology: K.V.M. and D.A.M. Resources: G.C.N. and D.A.M. Supervision: D.A.M. Writing (original draft): K.V.M. and D.A.M. Writing (review and editing): K.V.M., G.C.N., M.J.S., and D.A.M. All authors approved the final version to be published and agreed to be accountable for all aspects of the work.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Author Contributions"}}]}}