{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,17]],"date-time":"2026-01-17T20:29:04Z","timestamp":1768681744519,"version":"3.49.0"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,3,3]],"date-time":"2020-03-03T00:00:00Z","timestamp":1583193600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2020,3,3]],"date-time":"2020-03-03T00:00:00Z","timestamp":1583193600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Health Qual Life Outcomes"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n<jats:title>Background<\/jats:title>\n<jats:p>The provision of psychometrically valid patient reported outcomes (PROs) improves patient outcomes and reflects their quality of life. Consequently, ad hoc clinician-generated questionnaires of the past are being replaced by more rigorous instruments. This change, while beneficial, risks the loss\/orphaning of decades-long information on difficult to capture\/chronically ill populations. The goal of this study was to assess to the quality of data retrieved from these legacy questionnaires.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Methods<\/jats:title>\n<jats:p>Participants included 8563 patients who generated a total of 12,626 hospital admissions over the 2004\u20132014 study period. Items used to screen for issues related to function, mood, symptoms, and social support among patients with chronic disease were identified in our medical center\u2019s patient information questionnaire. Cluster and exploratory factor analyses (EFA) followed by multidimensional item response theory (MIRT) analyses were used to select items that defined factors. Scores were derived with summation and MIRT approaches; inter-factor relationships and relationships of factor scores to assigned diagnostic codes were assessed. Rasch analyses assessed the constructs\u2019 measurement properties.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Results<\/jats:title>\n<jats:p>Literature review and clinician interviews yielded four hypothesized constructs: psychological distress\/wellbeing, symptom burden, social support, and physical function. Rasch analyses showed that, while all had good measurement properties, only one, function, separated individuals well. In exploratory factor analyses (EFA), 11 factors representing depression, respiratory symptoms, musculoskeletal pain, family support, mobility, activities of daily living, alcohol consumption, weight loss, fatigue, neurological disorders, and fear at home were identified. Based on the agreement between EFA and cluster analyses as well as Cronbach\u2019s alpha, six domains were retained for analyses. Correlations were strong between activities of daily living and mobility (.84), and moderate between pain and mobility (.37) and psychological distress (.59) Known-group validity was supported from the relationships between factor scores and the relevant diagnostic code assignments (.12 to .20).<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Conclusions and discussion<\/jats:title>\n<jats:p>Items from ad hoc clinician-generated patient information questionnaires can be aggregated into valid factors that assess supportive care domains among chronically ill patients. However, the binary response options offered by many screening items limit their information content and consequently, as highlighted by Rasch analyses, their ability to meaningfully discriminate trait levels in these populations.<\/jats:p>\n<\/jats:sec>","DOI":"10.1186\/s12955-020-01287-2","type":"journal-article","created":{"date-parts":[[2020,3,3]],"date-time":"2020-03-03T19:02:53Z","timestamp":1583262173000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Assessing whether ad hoc clinician-generated patient questionnaires provide psychometrically valid information"],"prefix":"10.1186","volume":"18","author":[{"given":"Minji K.","family":"Lee","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7200-7760","authenticated-orcid":false,"given":"Jeffrey R.","family":"Basford","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Allen W.","family":"Heinemann","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea","family":"Cheville","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,3,3]]},"reference":[{"key":"1287_CR1","doi-asserted-by":"publisher","first-page":"369","DOI":"10.1016\/S0140-6736(09)61400-8","volume":"374","author":"CF Snyder","year":"2009","unstructured":"Snyder CF, Aaronson NK. Use of patient-reported outcomes in clinical practice. Lancet. 2009;374:369\u201370.","journal-title":"Lancet"},{"key":"1287_CR2","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1200\/JCO.2015.63.0830","volume":"34","author":"E Basch","year":"2016","unstructured":"Basch E, Deal AM, Kris MG, et al. Symptom monitoring with patient-reported outcomes during routine Cancer treatment: a randomized controlled trial. J Clin Oncol. 2016;34:557\u201365.","journal-title":"J Clin Oncol"},{"key":"1287_CR3","doi-asserted-by":"publisher","first-page":"882","DOI":"10.1177\/2047487314535682","volume":"22","author":"TB Hansen","year":"2015","unstructured":"Hansen TB, Thygesen LC, Zwisler AD, et al. Self-reported health-related quality of life predicts 5-year mortality and hospital readmissions in patients with ischaemic heart disease. Eur J Prev Cardiol. 2015;22:882\u20139.","journal-title":"Eur J Prev Cardiol"},{"key":"1287_CR4","doi-asserted-by":"publisher","first-page":"814","DOI":"10.1001\/jama.2013.879","volume":"309","author":"M Calvert","year":"2013","unstructured":"Calvert M, Blazeby J, Altman DG, Revicki DA, Moher D, Brundage MD. Reporting of patient-reported outcomes in randomized trials: the CONSORT PRO extension. JAMA. 2013;309:814\u201322.","journal-title":"JAMA"},{"key":"1287_CR5","doi-asserted-by":"publisher","first-page":"1889","DOI":"10.1007\/s11136-012-0344-y","volume":"22","author":"BB Reeve","year":"2013","unstructured":"Reeve BB, Wyrwich KW, Wu AW, et al. ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Quality Life Res. 2013;22:1889\u2013905.","journal-title":"Quality Life Res"},{"key":"1287_CR6","doi-asserted-by":"publisher","first-page":"e011060","DOI":"10.1136\/bmjopen-2016-011060","volume":"6","author":"H Zhou","year":"2016","unstructured":"Zhou H, Della PR, Roberts P, Goh L, Dhaliwal SS. Utility of models to predict 28-day or 30-day unplanned hospital readmissions: an updated systematic review. BMJ Open. 2016;6:e011060.","journal-title":"BMJ Open"},{"key":"1287_CR7","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1161\/CIRCHEARTFAILURE.114.001542","volume":"8","author":"SM Dunlay","year":"2015","unstructured":"Dunlay SM, Manemann SM, Chamberlain AM, et al. Activities of daily living and outcomes in heart failure. Circ Heart failure. 2015;8:261\u20137.","journal-title":"Circ Heart failure"},{"key":"1287_CR8","doi-asserted-by":"publisher","first-page":"11","DOI":"10.7326\/0003-4819-157-1-201207030-00004","volume":"157","author":"SM Dunlay","year":"2012","unstructured":"Dunlay SM, Weston SA, Killian JM, Bell MR, Jaffe AS, Roger VL. Thirty-day rehospitalizations after acute myocardial infarction: a cohort study. Ann Intern Med. 2012;157:11\u20138.","journal-title":"Ann Intern Med"},{"key":"1287_CR9","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1002\/jhm.2547","volume":"11","author":"JL Pederson","year":"2016","unstructured":"Pederson JL, Warkentin LM, Majumdar SR, McAlister FA. Depressive symptoms are associated with higher rates of readmission or mortality after medical hospitalization: a systematic review and meta-analysis. J Hosp Med. 2016;11:373\u201380.","journal-title":"J Hosp Med"},{"key":"1287_CR10","doi-asserted-by":"publisher","first-page":"918","DOI":"10.1161\/01.str.0000441948.35804.77","volume":"45","author":"IL Katzan","year":"2014","unstructured":"Katzan IL, Spertus J, Bettger JP, et al. Risk adjustment of ischemic stroke outcomes for comparing hospital performance: a statement for healthcare professionals from the American Heart Association\/American Stroke Association. Stroke. 2014;45:918\u201344.","journal-title":"Stroke"},{"key":"1287_CR11","doi-asserted-by":"publisher","first-page":"1344","DOI":"10.1001\/jama.2014.9473","volume":"312","author":"DA Chokshi","year":"2014","unstructured":"Chokshi DA, Chang JE. Preventing early readmissions. JAMA. 2014;312:1344\u20135.","journal-title":"JAMA"},{"key":"1287_CR12","volume-title":"missForest: Nonparametric Missing Value Imputation using Random Forest. R package version 1.4 ed","author":"DJ Stekhoven","year":"2013","unstructured":"Stekhoven DJ. missForest: Nonparametric Missing Value Imputation using Random Forest. R package version 1.4 ed; 2013."},{"key":"1287_CR13","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1093\/bioinformatics\/btr597","volume":"28","author":"DJ Stekhoven","year":"2012","unstructured":"Stekhoven DJ, Buehlmann P. MissForest - non-parametric missing value imputation for mixed-type data. Bioinformatics. 2012;28:112\u20138.","journal-title":"Bioinformatics"},{"key":"1287_CR14","volume-title":"Rating scale analysis: Rasch measurement","author":"B Wright","year":"1982","unstructured":"Wright B, Masters G. Rating scale analysis: Rasch measurement. Chicago: MESA Press; 1982."},{"key":"1287_CR15","volume-title":"Winsteps\u00ae Rasch measurement computer program","author":"JM Linacre","year":"2019","unstructured":"Linacre JM. Winsteps\u00ae Rasch measurement computer program. Oregon: Winsteps.com: Beaverton; 2019."},{"key":"1287_CR16","volume-title":"Psychometric Theory","author":"JC Nunnally","year":"1994","unstructured":"Nunnally JC, Bernstein IH. Psychometric Theory. 3rd ed. New York: McGraw-Hill; 1994.","edition":"3"},{"key":"1287_CR17","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1007\/BF02289447","volume":"30","author":"JL Horn","year":"1965","unstructured":"Horn JL. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965;30:179\u201385.","journal-title":"Psychometrika"},{"key":"1287_CR18","volume-title":"Using multivariate statistics","author":"BGF Tabachnick","year":"2014","unstructured":"Tabachnick BGF, Fidell LS. Using multivariate statistics. 6th ed. Pearson: Harlow, England; 2014.","edition":"6"},{"key":"1287_CR19","volume-title":"Orthogonal versus oblique factor rotation: a review of the literature regarding the pros and cons","author":"KM Kieffer","year":"1998","unstructured":"Kieffer KM. Orthogonal versus oblique factor rotation: a review of the literature regarding the pros and cons. New Orleans: American Educational Research Association; 1998."},{"key":"1287_CR20","volume-title":"Test theory: a unified treatment","author":"RP McDonald","year":"1999","unstructured":"McDonald RP. Test theory: a unified treatment. Lawrence Earlbaum Associates: Mahwah; 1999."},{"key":"1287_CR21","first-page":"53","volume":"6","author":"D Hooper","year":"2008","unstructured":"Hooper D, Coughlan J, Mullan M. Structural equation modelling: guidelines for determining model fit. Electron J Bus Res Methods. 2008;6:53\u201360.","journal-title":"Electron J Bus Res Methods"},{"key":"1287_CR22","volume-title":"Normal-ogive multidimensional model","year":"1997","unstructured":"McDonald RP, editor. Normal-ogive multidimensional model. New York: Springer; 1997."},{"key":"1287_CR23","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1007\/s11336-009-9136-x","volume":"75","author":"L Cai","year":"2010","unstructured":"Cai L. High-dimensional exploratory item factor analysis by a Metropolis-Hastings Robbins-Monro algorithm. Psychometrika. 2010;75:33\u201357.","journal-title":"Psychometrika"},{"key":"1287_CR24","doi-asserted-by":"publisher","first-page":"307","DOI":"10.3102\/1076998609353115","volume":"35","author":"L Cai","year":"2010","unstructured":"Cai L. Metropolis-Hastings Robbins-Monro algorithm for confirmatory item factor analysis. J Educ Behav Stat. 2010;35:307\u201335.","journal-title":"J Educ Behav Stat"},{"key":"1287_CR25","volume-title":"flexMIRT\u00ae user's manual version 2: flexible multilevel multidimensional item analysis and test scoring","author":"CR Houts","year":"2013","unstructured":"Houts CR, Cai L. flexMIRT\u00ae user's manual version 2: flexible multilevel multidimensional item analysis and test scoring. Vector Psychometric Group: Chapel Hill; 2013."},{"key":"1287_CR26","volume-title":"sirt: Supplementary item response theory models. R package version 1.8\u20139","author":"A Robitzsch","year":"2015","unstructured":"Robitzsch A. sirt: Supplementary item response theory models. R package version 1.8\u20139; 2015."},{"key":"1287_CR27","volume-title":"flexMIRT\u00ae version 2: flexible multilevel multidimensional item analysis and test scoring","author":"L Cai","year":"2013","unstructured":"Cai L. flexMIRT\u00ae version 2: flexible multilevel multidimensional item analysis and test scoring. Vector Psychometric Group: Chapel Hill; 2013."},{"key":"1287_CR28","volume-title":"WINSTEPS\u00ae Rasch measurement computer program User's guide","author":"JM Linacre","year":"2019","unstructured":"Linacre JM. WINSTEPS\u00ae Rasch measurement computer program User's guide. Oregon: Winsteps.Com: Beaverton; 2019."},{"key":"1287_CR29","volume-title":"An instructor's guide to understanding test reliability","author":"CS Wells","year":"2003","unstructured":"Wells CS, Wollack J. An instructor's guide to understanding test reliability. Madison: Testing & Evaluation Services, University of Wisconsin; 2003."},{"key":"1287_CR30","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1037\/1082-989X.7.1.19","volume":"7","author":"RC MacCallum","year":"2002","unstructured":"MacCallum RC, Zhang S, Preacher KJ, Rucker DD. On the practice of dichotomization of quantitative variables. Psychol Methods. 2002;7:19\u201340.","journal-title":"Psychol Methods"},{"key":"1287_CR31","doi-asserted-by":"publisher","first-page":"914","DOI":"10.1001\/jama.1963.03060120024016","volume":"185","author":"S Katz","year":"1963","unstructured":"Katz S, Ford AB, Moskowitz RW, Jackson BA, Jaffe MW. Studies of illness in the aged. The index of Adl: a standardized measure of biological and psychosocial function. JAMA. 1963;185:914\u20139.","journal-title":"JAMA"},{"key":"1287_CR32","doi-asserted-by":"publisher","first-page":"382","DOI":"10.1016\/j.jclinepi.2006.02.022","volume":"60","author":"SA Reijneveld","year":"2007","unstructured":"Reijneveld SA, Spijker J, Dijkshoorn H. Katz' ADL index assessed functional performance of Turkish, Moroccan, and Dutch elderly. J Clin Epidemiol. 2007;60:382\u20138.","journal-title":"J Clin Epidemiol"},{"key":"1287_CR33","doi-asserted-by":"publisher","first-page":"789","DOI":"10.1016\/j.jval.2013.04.015","volume":"16","author":"NE Rothrock","year":"2013","unstructured":"Rothrock NE, Jensen SE, Beaumont JL, Abernethy AP, Jacobson PB, Syrjala K, Cella D, et al. Value Health. 2013;16:789\u201396.","journal-title":"Value Health"}],"container-title":["Health and Quality of Life Outcomes"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12955-020-01287-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12955-020-01287-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12955-020-01287-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T00:09:55Z","timestamp":1614730195000},"score":1,"resource":{"primary":{"URL":"https:\/\/hqlo.biomedcentral.com\/articles\/10.1186\/s12955-020-01287-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,3]]},"references-count":33,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["1287"],"URL":"https:\/\/doi.org\/10.1186\/s12955-020-01287-2","relation":{},"ISSN":["1477-7525"],"issn-type":[{"value":"1477-7525","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,3]]},"assertion":[{"value":"1 December 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 February 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 March 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Ethical approval was granted by the Mayo Clinic Rochester Institutional Review Board. The study used retrospective data previously collected in the course of routine. Therefore, clinical informed consent was not obtained.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"50"}}