{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T18:03:51Z","timestamp":1790877831071,"version":"4.1.0"},"reference-count":36,"publisher":"Public Library of Science (PLoS)","issue":"10","license":[{"start":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T00:00:00Z","timestamp":1790812800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS One"],"abstract":"<jats:p>\n                    Having follow-up free response probes after forced choice survey questions allows researchers to assess the validity of the original choices. This can also be useful when psychological scales are administered as screening tools. The follow-up probes can be used to help decide if further diagnostic tests should be administered. A binary version of the General Health Questionnaire (GHQ-12) was given to an online sample (\n                    <jats:italic>n<\/jats:italic>\n                    \u2009=\u20091,048). Half answered the twelve GHQ questions in a binary format without follow-up probes. Half were asked with follow-up probes if they provided the psychologically concerning response. Those in the probe condition reported fewer psychologically concerning responses than those in the control condition. The difference between the probe and control groups increased as the survey went on. Researchers should be cautious comparing results from surveys that use selective follow-up probes with results from surveys that do not.\n                  <\/jats:p>","DOI":"10.1371\/journal.pone.0359515","type":"journal-article","created":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T17:29:51Z","timestamp":1790875791000},"page":"e0359515","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Asking follow-up probes for selected responses in survey scales can affect responses to these items"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4619-1848","authenticated-orcid":true,"given":"Daniel B.","family":"Wright","sequence":"first","affiliation":[{"name":"Leadership, and Higher Education University of Nevada","place":["Las Vegas, Nevada, United States of America"],"department":["Department of Educational Psychology"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,10,1]]},"reference":[{"issue":"2","key":"pone.0359515.ref001","doi-asserted-by":"crossref","first-page":"218","DOI":"10.2307\/2090907","article-title":"The random probe: A technique for evaluating the validity of closed questions","volume":"31","author":"H Schuman","year":"1966","journal-title":"Am Sociol Rev"},{"issue":"8","key":"pone.0359515.ref002","doi-asserted-by":"crossref","DOI":"10.1136\/bmjgh-2025-019216","article-title":"A brief international screening tool for traumatic birth and childbirth-related PTSD: The city BiTS-short form","volume":"10","author":"S Ayers","year":"2025","journal-title":"BMJ Glob Health"},{"issue":"7","key":"pone.0359515.ref003","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0304182","article-title":"The evaluation of the general health questionnaire (GHQ-12) reliability generalization: A meta-analysis","volume":"19","author":"AK Wojujutari","year":"2024","journal-title":"PLoS One"},{"issue":"1","key":"pone.0359515.ref004","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1093\/poq\/nfp013","article-title":"Sources of error in cognitive interviews","volume":"73","author":"FG Conrad","year":"2009","journal-title":"Public Opinion Quarterly"},{"issue":"2","key":"pone.0359515.ref005","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1002\/acp.1333","article-title":"Cognitive psychology and survey methodology: Nurturing the continuing dialogue between disciplines Applied cognitive psychology","volume":"21","author":"RF Belli","year":"2007","journal-title":"Appl Cogn Psychol"},{"issue":"2","key":"pone.0359515.ref006","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1037\/0003-066X.40.2.175","article-title":"Cognitive psychology meets the national survey","volume":"40","author":"EF Loftus","year":"1985","journal-title":"Am Psychologist"},{"issue":"2","key":"pone.0359515.ref007","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1002\/acp.1340","article-title":"Cognitive aspects of survey methodology","volume":"21","author":"N Schwarz","year":"2007","journal-title":"Appl Cognitive Psychol"},{"key":"pone.0359515.ref008","first-page":"129","article-title":"Rational choice and the structure of the environment Psychological Review","volume":"63","author":"HA Simon","year":"1956"},{"issue":"3","key":"pone.0359515.ref009","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1002\/acp.2350050305","article-title":"Response strategies for coping with the cognitive demands of attitude measures in surveys","volume":"5","author":"JA Krosnick","year":"1991","journal-title":"Applied Cognitive Psychology"},{"issue":"1","key":"pone.0359515.ref010","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1017\/S0033291700021644","article-title":"A scaled version of the general health questionnaire","volume":"9","author":"DP Goldberg","year":"1979","journal-title":"Psychol Med"},{"key":"pone.0359515.ref011","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1186\/1471-2458-8-355","article-title":"The reliability of the twelve-item general health questionnaire (GHQ-12) under realistic assumptions","volume":"8","author":"M Hankins","year":"2008","journal-title":"BMC Public Health"},{"issue":"2","key":"pone.0359515.ref012","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0031661","article-title":"Measuring empathizing and systemizing with a large US sample","volume":"7","author":"DB Wright","year":"2012","journal-title":"PLoS One"},{"issue":"4","key":"pone.0359515.ref013","doi-asserted-by":"crossref","first-page":"231228","DOI":"10.1098\/rsos.231228","article-title":"Psychometric evaluation of the Trust in Science and Scientists Scale","volume":"11","author":"SM Wolff","year":"2024","journal-title":"R Soc Open Sci"},{"key":"pone.0359515.ref014","volume-title":"Multilevel Statistical Models","author":"H Goldstein","year":"2011","edition":"4"},{"key":"pone.0359515.ref015","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1348\/000711008X327632","article-title":"Multilevel modelling: Beyond the basic applications","volume":"62","author":"DB Wright","year":"2009","journal-title":"Br J Math Stat Psychol"},{"issue":"1","key":"pone.0359515.ref016","doi-asserted-by":"crossref","DOI":"10.18637\/jss.v067.i01","article-title":"Fitting Linear Mixed-Effects Models Using lme4","volume":"67","author":"D Bates","year":"2015","journal-title":"J Stat Soft"},{"key":"pone.0359515.ref017","volume-title":"R: A Language and Environment for Statistical Computing","author":"R Core Team","year":"2025"},{"key":"pone.0359515.ref018","volume-title":"Dynamic documents with R and knitr. Boca: Chapman and Hall\/CRC","author":"Y Xie","year":"2015","edition":"2"},{"key":"pone.0359515.ref019","doi-asserted-by":"crossref","DOI":"10.1002\/0471249688","volume-title":"Categorical Data Analysis","author":"A Agresti","year":"2002","edition":"2"},{"key":"pone.0359515.ref020","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4899-4541-9","volume-title":"An Introduction to the Bootstrap. Monographs on Statistics and Applied Probability","author":"B Efron","year":"1993"},{"issue":"2","key":"pone.0359515.ref021","doi-asserted-by":"crossref","first-page":"252","DOI":"10.5127\/jep.013611","article-title":"Using Bootstrap Estimation and the Plug-in Principle for Clinical Psychology Data","volume":"2","author":"DB Wright","year":"2011","journal-title":"J Experimen Psychopathol"},{"key":"pone.0359515.ref022","doi-asserted-by":"crossref","DOI":"10.1201\/9781003726821","volume-title":"What\u2019s the question? Deciding what you really want to know","author":"DJ Hand","year":"2026"},{"key":"pone.0359515.ref023","volume-title":"MKinfer: Inferential Statistics","author":"M Kohl","year":"2024"},{"key":"pone.0359515.ref024","author":"RD Luce","year":"1986","journal-title":"Response times: Their role in inferring elementary mental. New York, NY: Oxford University Press"},{"key":"pone.0359515.ref025","doi-asserted-by":"crossref","first-page":"948","DOI":"10.1111\/rssa.12302","article-title":"Trust in numbers","volume":"180","author":"DJ Spiegelhalter","year":"2017","journal-title":"Journal of the Royal Statistical Society. Series A (Statistics in Society). Stat Soc A"},{"issue":"1","key":"pone.0359515.ref026","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1214\/07-AOAS134","article-title":"Skip sequencing: A decision problem in questionnaire design","volume":"2","author":"CF Manski","year":"2008","journal-title":"Ann Appl Stat"},{"issue":"1","key":"pone.0359515.ref027","first-page":"7","article-title":"How much is a box? The hidden cost of adding an open-ended probe to an online survey","volume":"15","author":"M Luebker","year":"2021","journal-title":"Methods, Data, Analyses"},{"issue":"1","key":"pone.0359515.ref028","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1177\/00491241231176846","article-title":"The effects of open-ended probes on closed survey questions in web surveys","volume":"54","author":"P Hadler","year":"2023","journal-title":"Sociol Method Res"},{"issue":"5","key":"pone.0359515.ref029","first-page":"1063","article-title":"Remembering can cause forgetting: Retrieval dynamics in long-term memory","volume":"20","author":"MC Anderson","year":"1994","journal-title":"J Experimental Psychology: Learning, memory, and cognition"},{"issue":"2","key":"pone.0359515.ref030","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1086\/269420","article-title":"Survey questions about the frequency of vaguely defined events: The effects of response alternative","volume":"58","author":"GD Gaskell","year":"1994","journal-title":"Public Opinion Quarterly"},{"issue":"1","key":"pone.0359515.ref031","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1177\/1745691610393980","article-title":"Amazon\u2019s mechanical turk: A new source of inexpensive, yet high-quality, data?","volume":"6","author":"M Buhrmester","year":"2011","journal-title":"Perspect Psychol Sci"},{"issue":"3","key":"pone.0359515.ref032","article-title":"Evaluating Amazon\u2019s Mechanical Turk as a tool for experimental behavioral research","volume":"8","author":"MJC Crump","year":"2013","journal-title":"PLoS One"},{"key":"pone.0359515.ref033","first-page":"1","article-title":"Mechanical Turk","volume":"44","author":"W Mason","year":"2012","journal-title":"Behavioral Research Methods"},{"key":"pone.0359515.ref034","volume-title":"Amazon\u2019s Mechanical Turk for Academics: The HIT Handbook for Social Science Research","author":"B Sheehan","year":"2016"},{"issue":"3","key":"pone.0359515.ref035","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0279720","article-title":"Data quality in online human-subjects research: Comparisons between MTurk, prolific, cloudresearch qualtrics, and SONA","volume":"18","author":"D Douglas","year":"2023","journal-title":"PLoS ONE"},{"issue":"3","key":"pone.0359515.ref036","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1002\/acp.2350050304","article-title":"The impact of administration mode on response effects in survey measurement","volume":"5","author":"N Schwarz","year":"1991","journal-title":"Appl Cognitive Psychol"}],"container-title":["PLOS One"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0359515","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T17:30:01Z","timestamp":1790875801000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0359515"}},"subtitle":[],"editor":[{"given":"Ali","family":"Cetin","sequence":"first","affiliation":[{"name":"University of Health Sciences (Istanbul, T\u00fcrkiye)","place":["T\u00dcRKIYE"]}],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,10,1]]},"references-count":36,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2026,10,1]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0359515","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,1]]}}}