{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,29]],"date-time":"2026-10-29T22:55:37Z","timestamp":1793314537872,"version":"4.5.0"},"reference-count":46,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Online questionnaires are widely used for large-scale screening. However, careless responding (CR) from participants can compromise the reliability of screening outcomes. Prior studies have focused on the effects of individual and environmental factors on CR, but the effect of questionnaire type remains underexplored.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study investigates the individual factors influencing CR in online mental health screening and assesses how the effect of these factors varies across different psychological questionnaires.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n This study analyzed data from 24,367 participants across 4 questionnaires (PHQ-9 [Patient Health Questionnaire-9], PSS [Perceived Stress Scale], ISI [Insomnia Severity Index], and GAD-7 [Generalized Anxiety Disorder-7 Scale]). CR was defined as the proportion of items completed in less than 2 seconds per item. We used a multiple linear regression model to examine the effect of individual factors (sex, age, education, smoking, and drinking) on CR across 4 questionnaires. In addition, response times were visualized to identify patterns between careless and careful responders.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n Females demonstrate lower levels of CR than males when completing the PHQ-9 (\n \u03b2<\/jats:italic>\n =\u2212.172, 95% CI \u22120.104 to \u22120.089;\n P<\/jats:italic>\n <.001), PSS (\n \u03b2<\/jats:italic>\n =\u2212.234, 95% CI \u22120.162 to \u22120.14;\n P<\/jats:italic>\n <.001), ISI (\n \u03b2<\/jats:italic>\n =\u2212.207, 95% CI \u22120.13 to \u22120.114;\n P<\/jats:italic>\n <.001), and GAD-7 (\n \u03b2<\/jats:italic>\n =\u2212.177, 95% CI \u22120.108 to \u22120.093;\n P<\/jats:italic>\n <.001). Older participants demonstrated lower levels of CR on the PHQ-9 (\n \u03b2<\/jats:italic>\n =\u2212.036, 95% CI \u22120.007 to \u22120.003;\n P<\/jats:italic>\n <.001), ISI (\n \u03b2<\/jats:italic>\n =\u2212.036, 95% CI \u22120.007 to \u22120.003;\n P<\/jats:italic>\n <.001), and GAD-7 (\n \u03b2<\/jats:italic>\n =\u2212.053, 95% CI \u22120.009 to \u22120.005;\n P<\/jats:italic>\n <.001), but their age was unrelated to CR on the PSS. Interestingly, compared with participants with an associate-level education, those with a high education (bachelor\u2019s, master\u2019s, or doctoral degree) demonstrated higher levels of CR, especially those with a master\u2019s degree (PHQ-9:\n \u03b2<\/jats:italic>\n =.098, 95% CI 0.136 to 0.188;\n P<\/jats:italic>\n <.001 and GAD-7:\n \u03b2<\/jats:italic>\n =.091, 95% CI 0.125 to 0.178;\n P<\/jats:italic>\n <.001). Smokers exhibited varied patterns, with current smokers demonstrating lower levels of CR on the PHQ-9 (\n \u03b2<\/jats:italic>\n =\u2212.022, 95% CI \u22120.064 to \u22120.016;\n P<\/jats:italic>\n =.001) and GAD-7 (\n \u03b2<\/jats:italic>\n =\u2212.014, 95% CI \u22120.051 to \u22120.002;\n P<\/jats:italic>\n =.03), whereas occasional smokers demonstrated higher levels of CR on the PSS (\n \u03b2<\/jats:italic>\n =.019, 95% CI 0.010 to 0.050;\n P<\/jats:italic>\n =.003) than nonsmokers. Drinkers demonstrated lower levels of CR than nondrinkers, with the strongest effect among occasional drinkers on the PHQ-9 (\n \u03b2<\/jats:italic>\n =\u2212.163, 95% CI \u22120.103 to \u22120.087;\n P<\/jats:italic>\n <.001). Analysis of response times revealed that participants tended to spend less time on PHQ-9 and GAD-7 surveys, and CR on PSS and ISI surveys was characterized by skipping questions.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n The effect of individual factors on CR varies across questionnaire types. These findings offer valuable insights for questionnaire designers and administrators, highlighting the need for targeted intervention.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/70451","type":"journal-article","created":{"date-parts":[[2025,6,4]],"date-time":"2025-06-04T16:25:06Z","timestamp":1749054306000},"page":"e70451-e70451","source":"Crossref","is-referenced-by-count":3,"title":["The Impact of Individual Factors on Careless Responding Across Different Mental Disorder Screenings: Cross-Sectional Study"],"prefix":"10.2196","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6041-4702","authenticated-orcid":false,"given":"Huawei","family":"Kuang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-4219-4117","authenticated-orcid":false,"given":"Lichao","family":"Zhu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-4275-7476","authenticated-orcid":false,"given":"Haonan","family":"Yin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-6827-4029","authenticated-orcid":false,"given":"Zihe","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-8603-0584","authenticated-orcid":false,"given":"Biao","family":"Jing","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1741-7374","authenticated-orcid":false,"given":"Junwei","family":"Kuang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,7,31]]},"reference":[{"issue":"10328","key":"R1","doi-asserted-by":"publisher","first-page":"957","DOI":"10.1016\/S0140-6736(21)02141-3","article-title":"Time for united action on depression: a Lancet\u2013World Psychiatric Association Commission","volume":"399","author":"Herrman","journal-title":"Lancet"},{"issue":"10157","key":"R2","doi-asserted-by":"publisher","first-page":"1553","DOI":"10.1016\/S0140-6736(18)31612-X","article-title":"The Lancet Commission on global mental health and sustainable development","volume":"392","author":"Patel","journal-title":"Lancet"},{"issue":"6","key":"R3","doi-asserted-by":"publisher","DOI":"10.2196\/28892","article-title":"Mental health and behavior of college students during the COVID-19 pandemic: longitudinal mobile smartphone and ecological momentary assessment study, part II","volume":"23","author":"Mack","journal-title":"J Med Internet Res"},{"key":"R4","unstructured":"COVID-19 pandemic triggers 25% increase in prevalence of anxiety and depression worldwide. World Health Organization. 2022. URL: https:\/\/www.who.int\/news\/item\/02-03-2022-covid-19-pandemic-triggers-25-increase-in-prevalence-of-anxiety-and-depression-worldwide [Accessed 22-02-2025]"},{"issue":"4","key":"R5","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1192\/bjp.bp.116.189464","article-title":"Association between mental health-related stigma and active help-seeking: systematic review and meta-analysis","volume":"210","author":"Schnyder","journal-title":"Br J Psychiatry"},{"issue":"10312","key":"R6","doi-asserted-by":"publisher","first-page":"1700","DOI":"10.1016\/S0140-6736(21)02143-7","article-title":"Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic","volume":"398","author":"Santomauro","journal-title":"The Lancet"},{"issue":"2","key":"R7","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1016\/S2215-0366(15)00505-2","article-title":"Estimating the true global burden of mental illness","volume":"3","author":"Vigo","journal-title":"Lancet Psychiatry"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.2196\/46778","article-title":"Digital phenotyping for monitoring mental disorders: systematic review","volume":"25","author":"Bufano","journal-title":"J Med Internet Res"},{"issue":"4","key":"R9","doi-asserted-by":"publisher","first-page":"958","DOI":"10.1080\/07421222.2024.2415771","article-title":"Explainable artificial intelligence for mental disorder screening: a computational design science approach","volume":"41","author":"Tutun","journal-title":"J Manag Inf Syst"},{"issue":"9","key":"R10","doi-asserted-by":"publisher","DOI":"10.2196\/28369","article-title":"Mental health screening in general practices as a means for enhancing uptake of digital mental health interventions: observational cohort study","volume":"23","author":"Whitton","journal-title":"J Med Internet Res"},{"issue":"4","key":"R11","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.6866","article-title":"Pregnant women\u2019s views on the feasibility and acceptability of web-based mental health e-screening versus paper-based screening: a randomized controlled trial","volume":"19","author":"Kingston","journal-title":"J Med Internet Res"},{"key":"R12","doi-asserted-by":"publisher","DOI":"10.1016\/j.metip.2020.100022","article-title":"The quality of data collected online: an investigation of careless responding in a crowdsourced sample","volume":"2","author":"Br\u00fchlmann","journal-title":"Methods Psychol"},{"key":"R13","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2017.06.032","article-title":"Careless response and attrition as sources of bias in online survey assessments of personality traits and performance","volume":"76","author":"Ward","journal-title":"Comput Human Behav"},{"key":"R14","doi-asserted-by":"publisher","DOI":"10.2196\/55712","article-title":"Ecological momentary assessment of mental health problems among university students: data quality evaluation study","volume":"26","author":"Portillo-Van Diest","journal-title":"J Med Internet Res"},{"issue":"3","key":"R15","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1037\/a0028085","article-title":"Identifying careless responses in survey data","volume":"17","author":"Meade","journal-title":"Psychol Methods"},{"key":"R16","doi-asserted-by":"crossref","unstructured":"Gadiraju U Kawase R Dietze S Demartini G . Understanding malicious behavior in crowdsourcing platforms: the case of online surveys. Presented at: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems; Apr 18-23, 2015; Seoul Republic of Korea. [doi: 10.1145\/2702123.2702443]","DOI":"10.1145\/2702123.2702443"},{"issue":"1","key":"R17","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/j.jrp.2004.09.009","article-title":"Ascertaining the validity of individual protocols from web-based personality inventories","volume":"39","author":"Johnson","journal-title":"J Res Pers"},{"issue":"2","key":"R18","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1016\/j.chb.2008.10.012","article-title":"Multitasking across generations: multitasking choices and difficulty ratings in three generations of Americans","volume":"25","author":"Carrier","journal-title":"Comput Human Behav"},{"key":"R19","unstructured":"Brower CK . Too long and too boring: the effects of survey length and interest on careless responding. Wright State University; 2018. URL: http:\/\/rave.ohiolink.edu\/etdc\/view?acc_num=wright1524614764948287 [Accessed 22-07-2025]"},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.1016\/j.jrp.2013.09.008","article-title":"Caring about carelessness: participant inattention and its effects on research","volume":"48","author":"Maniaci","journal-title":"J Res Pers"},{"issue":"2","key":"R21","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1037\/pspp0000085","article-title":"Who cares and who is careless? Insufficient effort responding as a reflection of respondent personality","volume":"111","author":"Bowling","journal-title":"J Pers Soc Psychol"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2018.03.007","article-title":"The attentive and the careless: Examining the relationship between benevolent and malevolent personality traits with careless responding in online surveys","volume":"84","author":"McKay","journal-title":"Comput Human Behav"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2020.09.131","article-title":"Screening for depression in primary care with Patient Health Questionnaire-9 (PHQ-9): a systematic review","volume":"279","author":"Costantini","journal-title":"J Affect Disord"},{"issue":"3","key":"R24","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1007\/s10862-023-10062-8","article-title":"Psychometric characteristics of the Romanian adaptation of the GAD-7","volume":"45","author":"Cotiga","journal-title":"J Psychopathol Behav Assess"},{"issue":"5","key":"R25","doi-asserted-by":"publisher","first-page":"601","DOI":"10.1093\/sleep\/34.5.601","article-title":"The Insomnia Severity Index: psychometric indicators to detect insomnia cases and evaluate treatment response","volume":"34","author":"Morin","journal-title":"Sleep"},{"issue":"10","key":"R26","doi-asserted-by":"publisher","first-page":"846","DOI":"10.1093\/abm\/kaad015","article-title":"The perceived stress scale as a measure of stress: decomposing score variance in longitudinal behavioral medicine studies","volume":"57","author":"Harris","journal-title":"Ann Behav Med"},{"issue":"1","key":"R27","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-024-03888-8","article-title":"Temporal dynamics in psychological assessments: a novel dataset with scales and response times","volume":"11","author":"Su","journal-title":"Sci Data"},{"issue":"2","key":"R28","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1177\/10944281211056520","article-title":"The quick and the careless: the construct validity of page time as a measure of insufficient effort responding to surveys","volume":"26","author":"Bowling","journal-title":"Organ Res Methods"},{"issue":"1","key":"R29","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1007\/s10869-011-9231-8","article-title":"Detecting and deterring insufficient effort responding to surveys","volume":"27","author":"Huang","journal-title":"J Bus Psychol"},{"key":"R30","doi-asserted-by":"publisher","DOI":"10.24106\/kefdergi.1525320","article-title":"Identifying the careless responders: a cross-country comparison on PISA 2018 dataset","volume":"32","author":"Erdem Kara","journal-title":"Kastamonu Edu J"},{"issue":"1","key":"R31","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1037\/adb0000924","article-title":"Careless responding in online studies is associated with alcohol use: a mega-analysis","volume":"38","author":"Jones","journal-title":"Psychol Addict Behav"},{"key":"R32","doi-asserted-by":"publisher","DOI":"10.1016\/j.jesp.2015.07.006","article-title":"Methods for the detection of carelessly invalid responses in survey data","volume":"66","author":"Curran","journal-title":"J Exp Soc Psychol"},{"issue":"2","key":"R33","doi-asserted-by":"publisher","first-page":"175","DOI":"10.3758\/bf03193146","article-title":"G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences","volume":"39","author":"Faul","journal-title":"Behav Res Methods"},{"issue":"4","key":"R34","doi-asserted-by":"publisher","first-page":"1149","DOI":"10.3758\/BRM.41.4.1149","article-title":"Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses","volume":"41","author":"Faul","journal-title":"Behav Res Methods"},{"issue":"5","key":"R35","doi-asserted-by":"publisher","first-page":"414","DOI":"10.11648\/j.ajtas.20150405.22","article-title":"Identifying the limitation of stepwise selection for variable selection in regression analysis","volume":"4","author":"Olusegun","journal-title":"AJTAS"},{"key":"R36","doi-asserted-by":"crossref","unstructured":"Zahn-Waxler C Hulle C . Empathy, guilt, and depression: when caring for others becomes costly to children. In: Oakley B Knafo A Madhavan G Wilson DS , editors. Pathological Altruism. Oxford University Press; 2012:321-344. [doi: 10.1093\/acprof:oso\/9780199738571.003.0224]","DOI":"10.1093\/acprof:oso\/9780199738571.003.0224"},{"key":"R37","unstructured":"Rudman LA Glick P . The Social Psychology of Gender: How Power and Intimacy Shape Gender Relations. Guilford Publications; 2021. ISBN: 9781462546794"},{"key":"R38","doi-asserted-by":"publisher","DOI":"10.1016\/j.cobeha.2017.07.009","article-title":"The positivity effect: a negativity bias in youth fades with age","volume":"19","author":"Carstensen","journal-title":"Curr Opin Behav Sci"},{"issue":"8","key":"R39","doi-asserted-by":"publisher","first-page":"464","DOI":"10.1177\/070674371205700804","article-title":"On the self-stigma of mental illness: stages, disclosure, and strategies for change","volume":"57","author":"Corrigan","journal-title":"Can J Psychiatry"},{"issue":"3","key":"R40","doi-asserted-by":"publisher","first-page":"431","DOI":"10.1016\/j.socscimed.2008.03.018","article-title":"Rethinking theoretical approaches to stigma: a Framework Integrating Normative Influences on Stigma (FINIS)","volume":"67","author":"Pescosolido","journal-title":"Soc Sci Med"},{"issue":"4","key":"R41","doi-asserted-by":"publisher","first-page":"410","DOI":"10.1037\/bul0000138","article-title":"Perfectionism is increasing over time: a meta-analysis of birth cohort differences from 1989 to 2016","volume":"145","author":"Curran","journal-title":"Psychol Bull"},{"issue":"3","key":"R42","doi-asserted-by":"publisher","first-page":"522","DOI":"10.1111\/jopy.12333","article-title":"The perniciousness of perfectionism: a meta-analytic review of the perfectionism-suicide relationship","volume":"86","author":"Smith","journal-title":"J Pers"},{"issue":"2","key":"R43","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1111\/apps.12118","article-title":"Applying social psychology to prevent careless responding during online surveys","volume":"67","author":"Ward","journal-title":"Appl Psychol"},{"issue":"2","key":"R44","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1080\/19012276.2015.1071202","article-title":"Careless responses in survey data and the validity of a screening instrument","volume":"68","author":"Roivainen","journal-title":"Nord Psychol"},{"issue":"6","key":"R45","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1007\/s00127-005-0911-4","article-title":"Determinants of non-participation, and the effects of non-participation on potential cause-effect relationships, in the PART study on mental disorders","volume":"40","author":"Lundberg","journal-title":"Soc Psychiatry Psychiatr Epidemiol"},{"key":"R46","unstructured":"Data from: temporal dynamics in psychological assessments: a novel dataset with scales and response times. Zenodo. URL: https:\/\/zenodo.org\/records\/10423537 [Accessed 22-07-2025]"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2025\/1\/e70451","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:59:11Z","timestamp":1782842351000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2025\/1\/e70451"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,31]]},"references-count":46,"URL":"https:\/\/doi.org\/10.2196\/70451","relation":{},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,31]]},"article-number":"v27i10328e70451"}}