{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T07:04:35Z","timestamp":1774940675711,"version":"3.50.1"},"reference-count":39,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T00:00:00Z","timestamp":1774915200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychol."],"abstract":"<jats:p>This study uses secondary analysis of a health survey dataset to explore the impact of completion time on the reliability and validity of online questionnaires. A total of 1,758 chronic low back pain patients recruited online were included in the study. Using two widely used scales for assessing low back pain, the Fear-Avoidance Beliefs Questionnaire (FABQ) and the Oswestry Disability Index (ODI), we analyzed internal consistency, structural validity, and convergent validity across different completion time groups. Multi-group analyses based on time quartiles revealed that completion time exerted some influence on the internal consistency and structural validity of the FABQ, though slower completion times did not consistently yield better results. However, the internal consistency and structural validity of the ODI remained relatively stable across the different completion time groups. Longer completion times were associated with greater response variability in the FABQ but not in the ODI (in unadjusted analyses). Among participants who completed the questionnaires more quickly (the first 50% for FABQ and the first 25% for ODI), convergent validity was less ideal, with some results being contrary to expectations (when examining the correlations with self-reported happiness, sleep quality, and pain levels). In conclusion, our study supports the use of completion time as an important indicator for assessing the quality of online survey data.<\/jats:p>","DOI":"10.3389\/fpsyg.2026.1717264","type":"journal-article","created":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T05:33:15Z","timestamp":1774935195000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["The impact of completion time on the reliability and validity of online electronic questionnaires: a preliminary study of the FABQ and ODI scales"],"prefix":"10.3389","volume":"17","author":[{"given":"Shilin","family":"Bi","sequence":"first","affiliation":[{"name":"Department of Physical Education, Xinjiang Hetian College","place":["Xinjiang, China"]},{"name":"School of Physical Education, Sichuan Agricultural University","place":["Ya\u2019an, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chao","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Physical Education, Xinjiang Hetian College","place":["Xinjiang, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haowei","family":"Liu","sequence":"additional","affiliation":[{"name":"Faculty of Psychology, Southwest University","place":["Chongqing, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Li","family":"Huang","sequence":"additional","affiliation":[{"name":"Faculty of Psychology, Southwest University","place":["Chongqing, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haodong","family":"Tian","sequence":"additional","affiliation":[{"name":"Faculty of Psychology, Southwest University","place":["Chongqing, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xing","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Physical Education and Sport, Faculty of Sport Sciences, University of Granada","place":["Granada, Spain"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hansen","family":"Li","sequence":"additional","affiliation":[{"name":"School of Physical Education, Sichuan Agricultural University","place":["Ya\u2019an, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2026,3,31]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"139","DOI":"10.2224\/sbp.2006.34.2.139","article-title":"Measuring happiness with a single-item scale","volume":"34","author":"Abdel-Khalek","year":"2006","journal-title":"Soc. Behav. Pers."},{"key":"ref2","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1186\/s12955-022-02056-z","article-title":"Gothenburg empowerment scale (GES): psychometric properties and measurement invariance in adults with congenital heart disease from Belgium, Norway and South Korea","volume":"20","author":"Acu\u00f1a Mora","year":"2022","journal-title":"Health Qual. Life Outcomes"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.9734\/bjmcs\/2016\/25183","article-title":"Assessing the validity and reliability of a measurement model in structural equation Modeling (SEM)","volume":"15","author":"Ahmad","year":"2016","journal-title":"Br. J. Math. Comput. Sci."},{"key":"ref4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10862-023-10108-x","article-title":"Psychometric evaluation of the emotion regulation questionnaire in a clinical sample","volume":"46","author":"Andrea","year":"2024","journal-title":"J. Psychopathol. Behav. Assess."},{"key":"ref5","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1007\/s11747-011-0278-x","article-title":"Specification, evaluation, and interpretation of structural equation models","volume":"40","author":"Bagozzi","year":"2012","journal-title":"J. Acad. Mark. Sci."},{"key":"ref6","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1111\/ajps.12081","article-title":"Separating the shirkers from the workers? Making sure respondents pay attention on self-administered surveys","volume":"58","author":"Berinsky","year":"2014","journal-title":"Am. J. Polit. Sci."},{"key":"ref7","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1186\/1477-7525-7-54","article-title":"Psychometric properties of a single-item scale to assess sleep quality among individuals with fibromyalgia","volume":"7","author":"Cappelleri","year":"2009","journal-title":"Health Qual. Life Outcomes"},{"key":"ref8","first-page":"1398","volume-title":"Encyclopedia of Quality of life and well-Being Research","author":"Chin","year":"2024"},{"key":"ref9","doi-asserted-by":"publisher","first-page":"307","DOI":"10.3233\/WOR-2005-00468","article-title":"Validation of the Chinese version of the Oswestry disability index","volume":"25","author":"Chow","year":"2005","journal-title":"Work"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"532","DOI":"10.12965\/jer.130079","article-title":"A study of the relationship among fear-avoidance beliefs, pain and disability index in patients with low back pain","volume":"9","author":"Chung","year":"2013","journal-title":"J. Exerc. Rehabil."},{"key":"ref11","doi-asserted-by":"publisher","first-page":"2940","DOI":"10.1097\/00007632-200011150-00017","article-title":"The Oswestry disability index","volume":"25","author":"Fairbank","year":"2000","journal-title":"Spine"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"716","DOI":"10.1016\/j.paid.2012.11.030","article-title":"On-line questionnaire completion time and personality test scores","volume":"54","author":"Furnham","year":"2013","journal-title":"Pers. Individ. Differ."},{"key":"ref13","doi-asserted-by":"publisher","first-page":"2007","DOI":"10.1007\/s00586-017-5179-3","article-title":"The Oswestry disability index, confirmatory factor analysis in a sample of 35,263 verifies a one-factor structure but practicality issues remain","volume":"26","author":"Gabel","year":"2017","journal-title":"Eur. Spine J."},{"key":"ref14","doi-asserted-by":"publisher","first-page":"101384","DOI":"10.1016\/j.leaqua.2020.101384","article-title":"Careless responding in questionnaire measures: detection, impact, and remedies","volume":"31","author":"Goldammer","year":"2020","journal-title":"Leadersh. Q."},{"key":"ref15","doi-asserted-by":"publisher","first-page":"8422","DOI":"10.3758\/s13428-024-02484-3","article-title":"Careless responding detection revisited: accuracy of direct and indirect measures","volume":"56","author":"Goldammer","year":"2024","journal-title":"Behav. Res. Methods"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"25152459241236414","DOI":"10.1177\/25152459241236414","article-title":"Practices in data-quality evaluation: a large-scale review of online survey studies published in 2022","volume":"7","author":"Gottfried","year":"2024","journal-title":"Adv. Methods Pract. Psychol. Sci."},{"key":"ref17","doi-asserted-by":"publisher","first-page":"877","DOI":"10.1007\/s10198-022-01517-y","article-title":"Completing the time trade-off with respondents who are older, in poorer health or with an immigrant background in an EQ-5D-5L valuation study","volume":"24","author":"Hansen","year":"2023","journal-title":"Eur. J. Health Econ."},{"key":"ref18","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1016\/j.paid.2017.02.015","article-title":"Reliability and completion speed in online questionnaires under consideration of personality","volume":"111","author":"Harms","year":"2017","journal-title":"Pers. Individ. Differ."},{"key":"ref19","doi-asserted-by":"publisher","first-page":"S240","DOI":"10.1002\/acr.20543","article-title":"Measures of adult pain: visual analog scale for pain (VAS pain), numeric rating scale for pain (NRS pain), Mcgill pain questionnaire (MPQ), short-form Mcgill pain questionnaire (SF-MPQ), chronic pain grade scale (CPGS), short form-36 bodily pain scale (SF-36 BPS), and measure of intermittent and constant osteoarthritis pain (ICOAP)","volume":"63","author":"Hawker","year":"2011","journal-title":"Arthritis Care Res."},{"key":"ref20","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1186\/s12955-020-01644-1","article-title":"Development of the Hausa version of the pain catastrophizing scale: translation, cross-cultural adaptation and psychometric evaluation in mixed urban and rural patients with chronic low back pain","volume":"19","author":"Ibrahim","year":"2021","journal-title":"Health Qual. Life Outcomes"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"e713","DOI":"10.1016\/j.physio.2015.03.3568","article-title":"Relationship between sleep quality and functional and psychological symptoms in patients with chronic low back pain","volume":"101","author":"Kanaan","year":"2015","journal-title":"Physiotherapy"},{"key":"ref22","doi-asserted-by":"publisher","first-page":"2557","DOI":"10.1186\/s12889-024-19953-1","article-title":"The link between childhood physical activity enjoyment and adult kinesiophobia in individuals with chronic low back pain","volume":"24","author":"Liu","year":"2024","journal-title":"BMC Public Health"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1080\/00031305.2000.10474549","article-title":"Using heteroscedasticity consistent standard errors in the linear regression model","volume":"54","author":"Long","year":"2000","journal-title":"Am. Stat."},{"key":"ref24","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/s00586-004-0815-0","article-title":"Development of a German version of the Oswestry disability index. Part 1: cross-cultural adaptation, reliability, and validity","volume":"15","author":"Mannion","year":"2006","journal-title":"Eur. Spine J."},{"key":"ref25","first-page":"1","author":"Mayerl","year":"2013"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1037\/a0028085","article-title":"Identifying careless responses in survey data","volume":"17","author":"Meade","year":"2012","journal-title":"Psychol. Methods"},{"key":"ref27","first-page":"1","volume-title":"COSMIN Study Design checklist for Patient-reported outcome measurement instruments","author":"Mokkink","year":"2019"},{"key":"ref28","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1089\/cpb.2007.0258","article-title":"Does speed in completing an online questionnaire have an influence on its reliability?","volume":"11","author":"Montag","year":"2008","journal-title":"Cyberpsychol. Behav."},{"key":"ref29","doi-asserted-by":"publisher","first-page":"00491241251345457","DOI":"10.1177\/00491241251345457","article-title":"Evaluating methods to prevent and detect inattentive respondents in web surveys","author":"Olbrich","year":"2025","journal-title":"Sociol. Methods Res."},{"key":"ref30","doi-asserted-by":"publisher","first-page":"1643","DOI":"10.3758\/s13428-021-01694-3","article-title":"Data quality of platforms and panels for online behavioral research","volume":"54","author":"Peer","year":"2022","journal-title":"Behav. Res. Methods"},{"key":"ref31","doi-asserted-by":"publisher","first-page":"1985","DOI":"10.1177\/147323001003800612","article-title":"Cross-cultural adaptation, reliability and validity of the Chinese version of the fear avoidance beliefs questionnaire","volume":"38","author":"Pei","year":"2010","journal-title":"J. Int. Med. Res."},{"key":"ref32","doi-asserted-by":"publisher","first-page":"1147","DOI":"10.1007\/s11136-018-1798-3","article-title":"COSMIN guideline for systematic reviews of patient-reported outcome measures","volume":"27","author":"Prinsen","year":"2018","journal-title":"Qual. Life Res."},{"key":"ref33","doi-asserted-by":"publisher","first-page":"561","DOI":"10.9734\/ajeba\/2024\/v24i71430","article-title":"Fit indices in structural equation modeling and confirmatory factor analysis: reporting guidelines","volume":"24","author":"Sathyanarayana","year":"2024","journal-title":"Asian J. Econ. Bus. Account."},{"key":"ref34","doi-asserted-by":"publisher","first-page":"1849","DOI":"10.5664\/jcsm.7478","article-title":"A new single-item sleep quality scale: results of psychometric evaluation in patients with chronic primary insomnia and depression","volume":"14","author":"Snyder","year":"2018","journal-title":"J. Clin. Sleep Med."},{"key":"ref35","doi-asserted-by":"publisher","first-page":"1273","DOI":"10.1007\/s11165-016-9602-2","article-title":"The use of Cronbach\u2019s alpha when developing and reporting research instruments in science education","volume":"48","author":"Taber","year":"2018","journal-title":"Res. Sci. Educ."},{"key":"ref36","doi-asserted-by":"publisher","first-page":"435","DOI":"10.1007\/s11135-005-8081-8","article-title":"Conducting online surveys","volume":"40","author":"Van Selm","year":"2006","journal-title":"Qual. Quant."},{"key":"ref37","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/0304-3959(93)90127-B","article-title":"A fear-avoidance beliefs questionnaire (FABQ) and the role of fear-avoidance beliefs in chronic low back pain and disability","volume":"52","author":"Waddell","year":"1993","journal-title":"Pain"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1146\/annurev-psych-040422-045007","article-title":"Dealing with careless responding in survey data: prevention, identification, and recommended best practices","volume":"74","author":"Ward","year":"2023","journal-title":"Annu. Rev. Psychol."},{"key":"ref39","doi-asserted-by":"publisher","first-page":"1504","DOI":"10.1016\/j.apmr.2014.03.014","article-title":"Relationship between sleep, pain, and disability in patients with spinal pathology","volume":"95","author":"Zarrabian","year":"2014","journal-title":"Arch. Phys. Med. Rehabil."}],"container-title":["Frontiers in Psychology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2026.1717264\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T05:33:16Z","timestamp":1774935196000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2026.1717264\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,31]]},"references-count":39,"alternative-id":["10.3389\/fpsyg.2026.1717264"],"URL":"https:\/\/doi.org\/10.3389\/fpsyg.2026.1717264","relation":{},"ISSN":["1664-1078"],"issn-type":[{"value":"1664-1078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,31]]},"article-number":"1717264"}}