{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,19]],"date-time":"2026-09-19T16:22:03Z","timestamp":1789834923207,"version":"4.0.1"},"reference-count":44,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2021,11,5]],"date-time":"2021-11-05T00:00:00Z","timestamp":1636070400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100005225","name":"U.S. Social Security Administration","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100005225","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000098","name":"NIH Clinical Center","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000098","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Rehabilit. Sci."],"abstract":"<jats:p>\n                    <jats:bold>Background:<\/jats:bold>\n                    Invaluable information on patient functioning and the complex interactions that define it is recorded in free text portions of the Electronic Health Record (EHR). Leveraging this information to improve clinical decision-making and conduct research requires natural language processing (NLP) technologies to identify and organize the information recorded in clinical documentation.\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:bold>Methods:<\/jats:bold>\n                    We used natural language processing methods to analyze information about patient functioning recorded in two collections of clinical documents pertaining to claims for federal disability benefits from the U.S. Social Security Administration (SSA). We grounded our analysis in the International Classification of Functioning, Disability, and Health (ICF), and used the Activities and Participation domain of the ICF to classify information about functioning in three key areas: mobility, self-care, and domestic life. After annotating functional status information in our datasets through expert clinical review, we trained machine learning-based NLP models to automatically assign ICF categories to mentions of functional activity.\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:bold>Results:<\/jats:bold>\n                    We found that rich and diverse information on patient functioning was documented in the free text records. Annotation of 289 documents for Mobility information yielded 2,455 mentions of Mobility activities and 3,176 specific actions corresponding to 13 ICF-based categories. Annotation of 329 documents for Self-Care and Domestic Life information yielded 3,990 activity mentions and 4,665 specific actions corresponding to 16 ICF-based categories. NLP systems for automated ICF coding achieved over 80% macro-averaged F-measure on both datasets, indicating strong performance across all ICF categories used.\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:bold>Conclusions:<\/jats:bold>\n                    Natural language processing can help to navigate the tradeoff between flexible and expressive clinical documentation of functioning and standardizable data for comparability and learning. The ICF has practical limitations for classifying functional status information in clinical documentation but presents a valuable framework for organizing the information recorded in health records about patient functioning. This study advances the development of robust, ICF-based NLP technologies to analyze information on patient functioning and has significant implications for NLP-powered analysis of functional status information in disability benefits management, clinical care, and research.\n                  <\/jats:p>","DOI":"10.3389\/fresc.2021.742702","type":"journal-article","created":{"date-parts":[[2021,11,5]],"date-time":"2021-11-05T02:19:11Z","timestamp":1636078751000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":27,"title":["Linking Free Text Documentation of Functioning and Disability to the ICF With Natural Language Processing"],"prefix":"10.3389","volume":"2","author":[{"given":"Denis","family":"Newman-Griffis","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan","family":"Camacho Maldonado","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pei-Shu","family":"Ho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maryanne","family":"Sacco","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rafael","family":"Jimenez Silva","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julia","family":"Porcino","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leighton","family":"Chan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2021,11,5]]},"reference":[{"key":"B1","volume-title":"International Classification of Functioning, Disability and Health: ICF","year":"2001"},{"key":"B2","doi-asserted-by":"publisher","first-page":"1089","DOI":"10.1080\/0963828031000148629","article-title":"Clinical physiotherapy documentation in stroke rehabilitation: an ICIDH-2 beta-2 based analysis","volume":"25","author":"Gustavsen","year":"2003","journal-title":"Disabil Rehabil"},{"key":"B3","doi-asserted-by":"publisher","first-page":"728","DOI":"10.1111\/j.1525-1497.2001.00625.x","article-title":"What does the medical record reveal about functional status?","volume":"16","author":"Bogardus","year":"2001","journal-title":"J Gen Intern Med."},{"key":"B4","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1111\/jgs.15677","article-title":"Making function part of the conversation: clinician perspectives on measuring functional status in primary care","volume":"67","author":"Nicosia","year":"2019","journal-title":"J Am Geriatr Soc."},{"key":"B5","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1136\/jamia.2010.007237","article-title":"Data from clinical notes: a perspective on the tension between structure and flexible documentation","volume":"18","author":"Rosenbloom","year":"2011","journal-title":"J Am Med Inform Assoc."},{"key":"B6","doi-asserted-by":"publisher","first-page":"1288","DOI":"10.1186\/s12889-019-7630-3","article-title":"Broadening horizons: the case for capturing function and the role of health informatics in its use","volume":"19","author":"Newman-Griffis","year":"2019","journal-title":"BMC Public Health."},{"key":"B7","doi-asserted-by":"publisher","first-page":"536","DOI":"10.1097\/PEC.0000000000000484","article-title":"An introduction to natural language processing: how you can get more from those electronic notes you are generating","volume":"31","author":"Kimia","year":"2015","journal-title":"Pediatr Emerg Care."},{"key":"B8","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.jbi.2017.07.012","article-title":"Natural language processing systems for capturing and standardizing unstructured clinical information: a systematic review","volume":"73","author":"Kreimeyer","year":"2017","journal-title":"J Biomed Inform."},{"key":"B9","doi-asserted-by":"publisher","first-page":"508","DOI":"10.1197\/jamia.M2107","article-title":"Human and automated coding of rehabilitation discharge summaries according to the international classification of functioning, disability, and health","volume":"13","author":"Kukafka","year":"2006","journal-title":"J Am Med Informatics Assoc."},{"key":"B10","doi-asserted-by":"publisher","first-page":"1628","DOI":"10.1001\/jamaoncol.2020.2708","article-title":"Use of natural language processing to assess frequency of functional status documentation for patients newly diagnosed with colorectal cancer","volume":"6","author":"Agaronnik","year":"2020","journal-title":"JAMA Oncol."},{"key":"B11","doi-asserted-by":"publisher","first-page":"1739","DOI":"10.1016\/j.apmr.2020.04.024","article-title":"Challenges of developing a natural language processing method with electronic health records to identify persons with chronic mobility disability","volume":"101","author":"Agaronnik","year":"2020","journal-title":"Arch Phys Med Rehabil."},{"key":"B12","doi-asserted-by":"publisher","first-page":"e13039","DOI":"10.2196\/13039","article-title":"Extraction of geriatric syndromes from electronic health record clinical notes: assessment of statistical natural language processing methods","volume":"7","author":"Chen","year":"2019","journal-title":"JMIR Med Inf."},{"key":"B13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18653\/v1\/W18-2301","article-title":"Embedding transfer for low-resource medical named entity recognition: a case study on patient mobility","volume-title":"Proceedings of the BioNLP 2018 workshop. Melbourne, Australia: Association for Computational Linguistics","author":"Newman-Griffis","year":"2018"},{"key":"B14","first-page":"85","article-title":"HARE: a flexible highlighting annotator for ranking and exploration","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP): System Demonstrations. Hong Kong, China: Association for Computational Linguistics","author":"Newman-Griffis","year":"2019"},{"key":"B15","doi-asserted-by":"publisher","first-page":"104351","DOI":"10.1016\/j.ijmedinf.2020.104351","article-title":"A comprehensive study of mobility functioning information in clinical notes: entity hierarchy, corpus annotation, and sequence labeling","volume":"147","author":"Thieu","year":"2021","journal-title":"Int J Med Inform."},{"key":"B16","doi-asserted-by":"publisher","first-page":"620828","DOI":"10.3389\/fdgth.2021.620828","article-title":"Automated coding of under-studied medical concept domains: linking physical activity reports to the international classification of functioning, disability, and health","volume":"3","author":"Newman-Griffis","year":"2021","journal-title":"Front Digit Heal."},{"key":"B17","doi-asserted-by":"publisher","first-page":"881","DOI":"10.2340\/16501977-1194","article-title":"Can the ICF be used as a rehabilitation outcome measure? A study looking at the inter- and intra-rater reliability of ICF categories derived from an ADL assessment tool","volume":"45","author":"Kohler","year":"2013","journal-title":"J Rehabil Med."},{"key":"B18","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1016\/j.jamda.2012.08.014","article-title":"Domains contributing to disability in activities of daily living","volume":"14","author":"den Ouden","year":"2013","journal-title":"J Am Med Dir Assoc."},{"key":"B19","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/0003-9993(94)90384-0","article-title":"The structure and stability of the functional independence measure","volume":"75","author":"Linacre","year":"1994","journal-title":"Arch Phys Med Rehabil."},{"key":"B20","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1197\/jamia.M1733","article-title":"Agreement, the F-measure, and reliability in information retrieval","volume":"12","author":"Hripcsak","year":"2005","journal-title":"J Am Med Informatics Assoc."},{"key":"B21","first-page":"92","article-title":"Proposal for an extension of traditional named entities: from guidelines to evaluation, an overview","volume-title":"Proceedings of the 5th Linguistic Annotation Workshop. Portland, Oregon, USA: Association for Computational Linguistics","author":"Grouin","year":"2011"},{"key":"B22","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1613\/jair.2934","article-title":"From frequency to meaning: vector space models of semantics","volume":"37","author":"Turney","year":"2010","journal-title":"J Artif Intell Res."},{"key":"B23","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1162\/tacl_a_00051","article-title":"Enriching word vectors with subword information","volume":"5","author":"Bojanowski","year":"2017","journal-title":"Trans ACL."},{"key":"B24","first-page":"4171","article-title":"BERT: pre-training of deep bidirectional transformers for language understanding","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Minneapolis, Minnesota: Association for Computational Linguistics","author":"Devlin","year":"2019"},{"key":"B25","doi-asserted-by":"publisher","first-page":"411","DOI":"10.3233\/978-1-60750-588-4-1080","article-title":"spaCy 2: natural language understanding with Bloom embeddings, convolutional neural networks and incremental parsing","volume":"7","author":"Honnibal","year":"2017","journal-title":"To Appear."},{"key":"B26","doi-asserted-by":"publisher","first-page":"160035","DOI":"10.1038\/sdata.2016.35","article-title":"MIMIC-III, a freely accessible critical care database","volume":"3","author":"Johnson","year":"2016","journal-title":"Sci Data."},{"key":"B27","doi-asserted-by":"crossref","first-page":"72","DOI":"10.18653\/v1\/W19-1909","article-title":"Publicly available clinical BERT embeddings","volume-title":"Proceedings of the 2nd Clinical Natural Language Processing Workshop. Minneapolis, Minnesota, USA: Association for Computational Linguistics","author":"Alsentzer","year":"2019"},{"key":"B28","doi-asserted-by":"publisher","first-page":"1565","DOI":"10.1038\/nbt1206-1565","article-title":"What is a support vector machine?","volume":"24","author":"Noble","year":"2006","journal-title":"Nat Biotechnol."},{"key":"B29","unstructured":"An empirical investigation of statistical significance in NLP9951005\n            Berg-KirkpatrickT\n            BurkettD\n            KleinD\n          Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. Association for Computational Linguistics2012"},{"key":"B30","unstructured":"The hitchhiker's guide to testing statistical significance in natural language processing138392\n            DrorR\n            BaumerG\n            ShlomovS\n            ReichartR\n          10.18653\/v1\/P18-1128Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics2018"},{"key":"B31","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1080\/09638280701216862","article-title":"Reliability and applicability of the ICF in coding problems, resources and goals of persons with multiple injuries","volume":"30","author":"Soberg","year":"2008","journal-title":"Disabil Rehabil."},{"key":"B32","volume-title":"Formulating Functional Terminology from the International Classification of Functioning, Disability and Health: Annotation Guideline for Self-Care and Domestic Life Domains","year":"2020"},{"key":"B33","volume-title":"Enabling America: Assessing the Role of Rehabilitation Science and Engineering","author":"Pope","year":"1997"},{"key":"B34","unstructured":"Disability Evaluation Under Social Security2008"},{"key":"B35","unstructured":"Development of natural language processing tools to support determination of federal disability benefits in the U.S16\n            DesmetB\n            PorcinoJ\n            ZiriklyA\n            Newman-GriffisD\n            DivitaG\n            RaschE\n          Proceedings of the 1st Workshop on Language Technologies for Government and Public Administration (LT4Gov). Marseille, France: European Language Resources Association2020"},{"key":"B36","first-page":"1080","article-title":"Development of structured ICD-10 and its application to computer-assisted ICD coding","volume":"160","author":"Imai","year":"2010","journal-title":"Stud Health Technol Inform."},{"key":"B37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/17538157.2018.1496092","article-title":"The implementation of an automated coding system for cause-of-death statistics","volume":"45","author":"Harteloh","year":"2020","journal-title":"Inform Health Soc Care."},{"key":"B38","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1186\/s12911-020-1085-4","article-title":"Construction of a semi-automatic ICD-10 coding system","volume":"20","author":"Zhou","year":"2020","journal-title":"BMC Med Inform Decis Mak."},{"key":"B39","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1016\/j.jclinepi.2018.07.005","article-title":"The development of an ICF-based questionnaire for patients with chronic conditions in primary care","volume":"103","author":"Postma","year":"2018","journal-title":"J Clin Epidemiol."},{"key":"B40","doi-asserted-by":"publisher","first-page":"964","DOI":"10.4338\/ACI-2017050078","article-title":"The international classification of functioning, disability and health (ICF) in electronic health records: a systematic literature review","volume":"8","author":"Maritz","year":"2017","journal-title":"Appl Clin Inform."},{"key":"B41","doi-asserted-by":"publisher","first-page":"1899","DOI":"10.3390\/ijerph15091899","article-title":"Implementation of the international classification of functioning, disability, and health (ICF) core sets for children and youth with cerebral palsy: global initiatives promoting optimal functioning","volume":"15","author":"Schiariti","year":"2018","journal-title":"Int J Environ Res Public Health."},{"key":"B42","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1002\/pri.1559","article-title":"Possibilities and implications of using the ICF and other vocabulary standards in electronic health records","volume":"20","author":"Vreeman","year":"2015","journal-title":"Physiother Res Int."},{"key":"B43","doi-asserted-by":"publisher","first-page":"1226","DOI":"10.1016\/j.apmr.2017.12.029","article-title":"Turning data into information: opportunities to advance rehabilitation quality, research, and policy","volume":"99","author":"Bettger","year":"2018","journal-title":"Arch Phys Med Rehabil"},{"key":"B44","doi-asserted-by":"publisher","first-page":"150","DOI":"10.3414\/ME10-01-0062","article-title":"Development of ICF code selection tools for mental health care","volume":"50","author":"Manabe","year":"2011","journal-title":"Methods Inf Med."}],"container-title":["Frontiers in Rehabilitation Sciences"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fresc.2021.742702\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,11,5]],"date-time":"2021-11-05T02:19:22Z","timestamp":1636078762000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fresc.2021.742702\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,5]]},"references-count":44,"alternative-id":["10.3389\/fresc.2021.742702"],"URL":"https:\/\/doi.org\/10.3389\/fresc.2021.742702","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.08.19.21262308","asserted-by":"object"}]},"ISSN":["2673-6861"],"issn-type":[{"value":"2673-6861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,5]]},"article-number":"742702"}}