{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T17:16:30Z","timestamp":1782407790792,"version":"3.54.5"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,4,23]],"date-time":"2021-04-23T00:00:00Z","timestamp":1619136000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,4,23]],"date-time":"2021-04-23T00:00:00Z","timestamp":1619136000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Canadian Institute of Health Research Quality of Life Training Program"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Health Qual Life Outcomes"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Standardized coding of the content presented in patient reported outcome measures can be achieved using classification frameworks, and the resulting data can be used for ascertaining content validity or comparative analyses. The International Classification of Functioning (ICF) is a framework with a detailed conceptual structure that has been successfully utilized for such purposes through established coding procedures. The Item Perspective Classification (IPC) framework is a newly developed relational coding system that classifies the respondent perspective and conceptual domains addressed in items. The purpose of this study was to compare and describe the performance of these two frameworks when used alone, and in conjunction, for the generation of data pertaining to the content of patient reported outcome measures.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>Six health-related quality of life questionnaires with a total of 159 items were classified by two raters using the Item Perspective Classification framework in conjunction with the International Classification of Functioning. Framework performance indicators included: classification capacity (percent of items amenable to successful classification), coding efficiency (number of codes required to classify items), and content overlap detection (percent of items sharing identical classification codes with at least one other item). Inter-rater reliability of item coding was determined using Krippendorff's alpha.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Classification capacity of the IPC framework was 97%, coding efficiency 26, and content overlap detection was 95%; whereas respective values for the ICF were 68%, 114, and 58%. When used in conjunction values were 63%, 129, and 30%. Krippendorff's alpha exceeded 0.97 for all 3 classification indices.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>Inter-rater agreement on classification data was excellent. The IPC framework provided a unique classification of the respondent\u2019s judgment during item response and classified more items using fewer categories, indicated greater content overlap across items and was able to describe the relationship between multiple concepts presented within the context of a single item. The ICF provided a unique classification of item content relating to aspects of disability and generated more detailed and precise descriptions. A combined approach provided a rich description (detailed codes) with each framework providing complementary information. The benefits of this approach in instrument development and content validation require further investigation.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12955-021-01774-0","type":"journal-article","created":{"date-parts":[[2021,4,23]],"date-time":"2021-04-23T13:09:19Z","timestamp":1619183359000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["A comparative performance analysis of the International Classification of Functioning, Disability and Health and the Item-Perspective Classification framework for classifying the content of patient reported outcome measures"],"prefix":"10.1186","volume":"19","author":[{"given":"Derek","family":"Rosa","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9311-7379","authenticated-orcid":false,"given":"Joy","family":"MacDermid","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dorota","family":"Klubowicz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,4,23]]},"reference":[{"key":"1774_CR1","doi-asserted-by":"publisher","first-page":"1295","DOI":"10.1007\/s11136-008-9422-6","volume":"17","author":"NK Aaronson","year":"2008","unstructured":"Aaronson NK, Snyder C. Using patient-reported outcomes in clinical practice: proceedings of an International Society of Quality of Life Research conference. Qual Life Res. 2008;17:1295.","journal-title":"Qual Life Res"},{"issue":"Suppl 1","key":"1774_CR2","doi-asserted-by":"publisher","first-page":"S4","DOI":"10.1111\/j.1524-4733.2004.7s102.x","volume":"7","author":"LC Doward","year":"2004","unstructured":"Doward LC, McKenna SP. Defining patient-reported outcomes. Value Health. 2004;7(Suppl 1):S4-8.","journal-title":"Value Health"},{"key":"1774_CR3","doi-asserted-by":"publisher","first-page":"1125","DOI":"10.1007\/s11136-008-9396-4","volume":"17","author":"JM Valderas","year":"2008","unstructured":"Valderas JM, Alonso J. Patient reported outcome measures: a model-based classification system for research and clinical practice. Qual Life Res. 2008;17:1125\u201335.","journal-title":"Qual Life Res"},{"key":"1774_CR4","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1080\/16501970510040263","volume":"37","author":"A Cieza","year":"2005","unstructured":"Cieza A, Geyh S, Chatterji S, Kostanjsek N, Ustun B, Stucki G. ICF linking rules: an update based on lessons learned. J Rehabil Med. 2005;37:212\u20138.","journal-title":"J Rehabil Med"},{"key":"1774_CR5","doi-asserted-by":"publisher","first-page":"1225","DOI":"10.1007\/s11136-004-4773-0","volume":"14","author":"A Cieza","year":"2005","unstructured":"Cieza A, Stucki G. Content comparison of health-related quality of life (HRQOL) instruments based on the international classification of functioning, disability and health (ICF). Qual Life Res. 2005;14:1225\u201337.","journal-title":"Qual Life Res"},{"key":"1774_CR6","doi-asserted-by":"publisher","first-page":"13","DOI":"10.2165\/00019053-200017010-00002","volume":"17","author":"SJ Coons","year":"2000","unstructured":"Coons SJ, Rao S, Keininger DL, Hays RD. A comparative review of generic quality-of-life instruments. Pharmacoeconomics. 2000;17:13\u201335.","journal-title":"Pharmacoeconomics"},{"key":"1774_CR7","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780195165678.001.0001","volume-title":"Measuring health: a guide to rating scales and questionnaires","author":"I McDowell","year":"2006","unstructured":"McDowell I. Measuring health: a guide to rating scales and questionnaires. New York: Oxford University Press; 2006."},{"key":"1774_CR8","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1007\/s11136-011-9990-8","volume":"21","author":"S Magasi","year":"2012","unstructured":"Magasi S, Ryan G, Revicki D, Lenderking W, Hays R, Brod M, Snyder C, Boers M, Cella D. Content validity of patient-reported outcome measures: perspectives from a PROMIS meeting. Qual Life Res. 2012;21:739\u201346.","journal-title":"Qual Life Res"},{"key":"1774_CR9","unstructured":"Rosa D. Content validation of patient-rated outcomes using the item perspective classification framework: User guide v3.0. https:\/\/sites.google.com\/site\/ipcframework\/"},{"key":"1774_CR10","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1080\/165019702760279189","volume":"34","author":"A Cieza","year":"2002","unstructured":"Cieza A, Brockow T, Ewert T, Amman E, Kollerits B, Chatterji S, Ustun TB, Stucki G. Linking health-status measurements to the international classification of functioning, disability and health. J Rehabil Med. 2002;34:205\u201310.","journal-title":"J Rehabil Med"},{"key":"1774_CR11","unstructured":"World Health Organization. International Classification of Functioning, Disability and Health (ICF). http:\/\/www.who.int\/classifications\/icf\/en\/"},{"key":"1774_CR12","unstructured":"Madden R, Sykes C, Ustun TB. World Health Organization Family of International Classifications: definition, scope and purpose. http:\/\/www.who.int\/classifications\/en\/FamilyDocument2007.pdf"},{"issue":"5","key":"1774_CR13","doi-asserted-by":"publisher","first-page":"574","DOI":"10.3109\/09638288.2016.1145258","volume":"41","author":"A Cieza","year":"2019","unstructured":"Cieza A, Fayed N, Bickenbach J, Prodinger B. Refinements of the ICF Linking Rules to strengthen their potential for establishing comparability of health information. Disabil Rehabil. 2019;41(5):574\u201383. https:\/\/doi.org\/10.3109\/09638288.2016.1145258.","journal-title":"Disabil Rehabil"},{"key":"1774_CR14","doi-asserted-by":"publisher","first-page":"1941","DOI":"10.3109\/09638288.2011.553704","volume":"33","author":"N Fayed","year":"2011","unstructured":"Fayed N, Cieza A, Bickenbach JE. Linking health and health-related information to the ICF: a systematic review of the literature from 2001 to 2008. Disabil Rehabil. 2011;33:1941\u201351.","journal-title":"Disabil Rehabil"},{"key":"1774_CR15","unstructured":"World health Organization. ICF Browser. http:\/\/apps.who.int\/classifications\/icfbrowser\/"},{"key":"1774_CR16","first-page":"1","volume":"8","author":"N Fayed","year":"2009","unstructured":"Fayed N, Kerr EN. Comparing quality of life scales in childhood epilepsy: what\u2019s in the measures? Int J Disabil Commun Rehabil. 2009;8:1\u201311.","journal-title":"Int J Disabil Commun Rehabil"},{"key":"1774_CR17","doi-asserted-by":"publisher","first-page":"621","DOI":"10.1007\/s11136-010-9801-7","volume":"20","author":"N Mayo","year":"2011","unstructured":"Mayo N, Moriello C, Asano M, Spuy S, Finch L. The extent to which common health-related quality of life indices capture constructs beyond symptoms and function. Qual Life Res. 2011;20:621\u20137.","journal-title":"Qual Life Res"},{"key":"1774_CR18","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1186\/1477-7525-8-139","volume":"8","author":"S Riva","year":"2010","unstructured":"Riva S, Bullinger M, Amann E, von Mackensen S. Content comparison of haemophilia specific patient-rated outcome measures with the international classification of functioning, disability and health (ICF, ICF-CY). Health Qual Life Outcomes. 2010;8:139.","journal-title":"Health Qual Life Outcomes"},{"key":"1774_CR19","unstructured":"McWatt A. A critical analysis of Rober Pirsig's Metaphysiscs of Quality. PhD Thesis. University of Liverpool, 2004."},{"key":"1774_CR20","first-page":"552","volume":"73","author":"MJ Fuhrer","year":"1992","unstructured":"Fuhrer MJ, Rintala DH, Hart KA, Clearman R, Young ME. Relationship of life satisfaction to impairment, disability, and handicap among persons with spinal cord injury living in the community. Arch Phys Med Rehabil. 1992;73:552\u20137.","journal-title":"Arch Phys Med Rehabil"},{"key":"1774_CR21","doi-asserted-by":"publisher","first-page":"977","DOI":"10.1016\/S0277-9536(98)00411-0","volume":"48","author":"GL Albrecht","year":"1999","unstructured":"Albrecht GL, Devlieger PJ. The disability paradox: high quality of life against all odds. Soc Sci Med. 1999;48:977\u201388.","journal-title":"Soc Sci Med"},{"key":"1774_CR22","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1016\/j.apmr.2006.12.032","volume":"88","author":"CE Schwartz","year":"2007","unstructured":"Schwartz CE, Andresen EM, Nosek MA, Krahn GL. Response shift theory: important implications for measuring quality of life in people with disability. Arch Phys Med Rehabil. 2007;88:529\u201336.","journal-title":"Arch Phys Med Rehabil"},{"key":"1774_CR23","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1097\/00005650-199206000-00002","volume":"30","author":"JE Ware Jr","year":"1992","unstructured":"Ware JE Jr, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30:473\u201383.","journal-title":"Med Care"},{"key":"1774_CR24","first-page":"185","volume":"35","author":"SM Hunt","year":"1985","unstructured":"Hunt SM, McEwen J, McKenna SP. Measuring health status: a new tool for clinicians and epidemiologists. J R Coll Gen Pract. 1985;35:185\u20138.","journal-title":"J R Coll Gen Pract"},{"key":"1774_CR25","unstructured":"World Health Organization. WHO Disability Assessment Schedule II. http:\/\/www.who.int\/classifications\/icf\/whodasii\/en\/"},{"key":"1774_CR26","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1016\/0168-8510(90)90421-9","volume":"16","author":"The EuroQol Group","year":"1990","unstructured":"The EuroQol Group. EuroQol: a new facility for the measurement of health-related quality of life. Health Policy. 1990;16:199\u2013208.","journal-title":"Health Policy"},{"key":"1774_CR27","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1016\/0021-9681(81)90058-8","volume":"34","author":"WO Spitzer","year":"1981","unstructured":"Spitzer WO, Dobson AJ, Hall J, Chesterman E, Levi J, Shepherd R, Battista RN, Catchlove BR. Measuring the quality of life of cancer patients: a concise QL-index for use by physicians. J Chronic Dis. 1981;34:585\u201397.","journal-title":"J Chronic Dis"},{"key":"1774_CR28","volume-title":"Quality of life assessment: international perspectives","author":"The WHOQOL Group","year":"1994","unstructured":"The WHOQOL Group. The development of the World Health Organization quality of life assessment instrument (The WHOQOL). In: Orley J, Kuyken W, editors. Quality of life assessment: international perspectives. Heidelberg: Springer; 1994."},{"key":"1774_CR29","unstructured":"Krippendorff K. Computing Krippendorff's alpha-reliability. http:\/\/repository.upenn.edu\/cgi\/viewcontent.cgi?article=1043&context=asc_papers"},{"key":"1774_CR30","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1080\/19312450709336664","volume":"1","author":"AF Hayes","year":"2007","unstructured":"Hayes AF, Krippendorff K. Answering the call for a standard reliability measure for coding data. Commun Methods Meas. 2007;1:77\u201389.","journal-title":"Commun Methods Meas"},{"key":"1774_CR31","volume-title":"Content analysis: an introduction to its methodology","author":"K Krippendorff","year":"1980","unstructured":"Krippendorff K. Content analysis: an introduction to its methodology. Beverly Hills: Sage Publications Inc.; 1980."},{"key":"1774_CR32","first-page":"411","volume":"30","author":"K Krippendorff","year":"2004","unstructured":"Krippendorff K. Reliability in content analysis: some common misconceptions and recommendations. Hum Commun Res. 2004;30:411\u201333.","journal-title":"Hum Commun Res"},{"key":"1774_CR33","doi-asserted-by":"publisher","first-page":"1534","DOI":"10.1093\/rheumatology\/kel133","volume":"45","author":"T Stamm","year":"2006","unstructured":"Stamm T, Geyh S, Cieza A, Machold K, Kollerits B, Kloppenburg M, Smolen J, Stucki G. Measuring functioning in patients with hand osteoarthritis\u2013content comparison of questionnaires based on the International Classification of Functioning, Disability and Health (ICF). Rheumatology (Oxford). 2006;45:1534\u201341.","journal-title":"Rheumatology (Oxford)"},{"key":"1774_CR34","doi-asserted-by":"publisher","first-page":"23","DOI":"10.20982\/tqmp.08.1.p023","volume":"8","author":"KA Hallgren","year":"2012","unstructured":"Hallgren KA. Computing inter-rater reliability for observational data: an overview and tutorial. Tutor Quant Methods Psychol. 2012;8:23\u201334.","journal-title":"Tutor Quant Methods Psychol"},{"key":"1774_CR35","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1093\/ptj\/85.3.257","volume":"85","author":"J Sim","year":"2005","unstructured":"Sim J, Wright CC. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther. 2005;85:257\u201368.","journal-title":"Phys Ther"},{"key":"1774_CR36","doi-asserted-by":"publisher","first-page":"881","DOI":"10.2340\/16501977-1194","volume":"45","author":"F Kohler","year":"2013","unstructured":"Kohler F, Connolly C, Sakaria A, Stendara K, Buhagiar M, Mojaddidi M. Can the ICF be used as a rehabilitation outcome measure? A study looking at the inter- and intra-rater reliability of ICF categories derived from an ADL assessment tool. J Rehabil Med. 2013;45:881\u20137.","journal-title":"J Rehabil Med"},{"key":"1774_CR37","doi-asserted-by":"publisher","first-page":"1113","DOI":"10.1016\/j.rmed.2006.11.016","volume":"101","author":"A Stucki","year":"2007","unstructured":"Stucki A, Stucki G, Cieza A, Schuurmans MM, Kostanjsek N, Ruof J. Content comparison of health-related quality of life instruments for COPD. Respir Med. 2007;101:1113\u201322.","journal-title":"Respir Med"},{"key":"1774_CR38","doi-asserted-by":"publisher","first-page":"1247","DOI":"10.1007\/s11136-011-9851-5","volume":"20","author":"N Fayed","year":"2011","unstructured":"Fayed N, Schiariti V, Bostan C, Cieza A, Klassen A. Health status and QOL instruments used in childhood cancer research: deciphering conceptual content using World Health Organization definitions. Qual Life Res. 2011;20:1247\u201358.","journal-title":"Qual Life Res"},{"key":"1774_CR39","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1080\/09638280701216862","volume":"30","author":"H Soberg","year":"2008","unstructured":"Soberg H, Sandvik L, Ostensjo S. Reliability and applicability of the ICF in coding problems, resources and goals of persons with multiple injuries. Disabil Rehabil. 2008;30:98\u2013106.","journal-title":"Disabil Rehabil"},{"key":"1774_CR40","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1097\/01.ajp.0000155344.22064.f4","volume":"22","author":"T Sigl","year":"2006","unstructured":"Sigl T, Cieza A, Brockow T, Chatterji S, Kostanjsek N, Stucki G. Content comparison of low back pain-specific measures based on the international classification of functioning, disability and health (ICF). Clin J Pain. 2006;22:147\u201353.","journal-title":"Clin J Pain"},{"key":"1774_CR41","doi-asserted-by":"publisher","first-page":"1371","DOI":"10.1016\/j.apmr.2003.12.002","volume":"85","author":"LR Tooth","year":"2004","unstructured":"Tooth LR, Ottenbacher KJ. The kappa statistic in rehabilitation research: an examination. Arch Phys Med Rehabil. 2004;85:1371\u20136.","journal-title":"Arch Phys Med Rehabil"}],"container-title":["Health and Quality of Life Outcomes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12955-021-01774-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12955-021-01774-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12955-021-01774-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,23]],"date-time":"2021-04-23T13:15:51Z","timestamp":1619183751000},"score":1,"resource":{"primary":{"URL":"https:\/\/hqlo.biomedcentral.com\/articles\/10.1186\/s12955-021-01774-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,23]]},"references-count":41,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["1774"],"URL":"https:\/\/doi.org\/10.1186\/s12955-021-01774-0","relation":{},"ISSN":["1477-7525"],"issn-type":[{"value":"1477-7525","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,23]]},"assertion":[{"value":"27 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 April 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 April 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"DR and JMD were involved in the development of the item perspective classification framework. DK declares that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"132"}}