{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T05:12:44Z","timestamp":1790745164951,"version":"4.1.0"},"reference-count":64,"publisher":"JMIR Publications Inc.","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Med Inform"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Delirium is an acute neurocognitive disorder that affects up to half of older hospitalized medical patients and can lead to dementia, longer hospital stays, increased health costs, and death. Although delirium can be prevented and treated, it is difficult to identify and predict.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study aimed to improve machine learning models that retrospectively identify the presence of delirium during hospital stays (eg, to measure the effectiveness of delirium prevention interventions) by using the natural language processing (NLP) technique of sentiment analysis (in this case a feature that identifies sentiment toward, or away from, a delirium diagnosis).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Using data from the General Medicine Inpatient Initiative, a Canadian hospital data and analytics network, a detailed manual review of medical records was conducted from nearly 4000 admissions at 6 Toronto area hospitals. Furthermore, 25.74% (994\/3862) of the eligible hospital admissions were labeled as having delirium. Using the data set collected from this study, we developed machine learning models with, and without, the benefit of NLP methods applied to diagnostic imaging reports, and we asked the question \u201ccan NLP improve machine learning identification of delirium?\u201d<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Among the eligible 3862 hospital admissions, 994 (25.74%) admissions were labeled as having delirium. Identification and calibration of the models were satisfactory. The accuracy and area under the receiver operating characteristic curve of the main model with NLP in the independent testing data set were 0.807 and 0.930, respectively. The accuracy and area under the receiver operating characteristic curve of the main model without NLP in the independent testing data set were 0.811 and 0.869, respectively. Model performance was also found to be stable over the 5-year period used in the experiment, with identification for a likely future holdout test set being no worse than identification for retrospective holdout test sets.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Our machine learning model that included NLP (ie, sentiment analysis in medical image description text mining) produced valid identification of delirium with the sentiment analysis, providing significant additional benefit over the model without NLP.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/38161","type":"journal-article","created":{"date-parts":[[2022,9,19]],"date-time":"2022-09-19T21:35:13Z","timestamp":1663623313000},"page":"e38161","source":"Crossref","is-referenced-by-count":31,"title":["Boosting Delirium Identification Accuracy With Sentiment-Based Natural Language Processing: Mixed Methods Study"],"prefix":"10.2196","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4016-4096","authenticated-orcid":false,"given":"Lu","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0682-0961","authenticated-orcid":false,"given":"Yilun","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8120-6905","authenticated-orcid":false,"given":"Mark","family":"Chignell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6204-7814","authenticated-orcid":false,"given":"Baizun","family":"Shan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8700-0809","authenticated-orcid":false,"given":"Kathleen A","family":"Sheehan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9195-7286","authenticated-orcid":false,"given":"Fahad","family":"Razak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6857-931X","authenticated-orcid":false,"given":"Amol","family":"Verma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2022,12,20]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ccc.2017.03.013"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1016\/j.emc.2010.03.005"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1002\/gps.4823"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2017.1246"},{"key":"ref5","first-page":"267","author":"Conn, DK","year":"2007","journal-title":"Practical Psychiatry in the Long-Term Care Home: A Handbook for Staff. 3rd revised and expanded edition"},{"key":"ref6","unstructured":"GageLHoganDB2014 CCSMH Guideline Update: The Assessment and Treatment of DeliriumCanadian Coalition for Seniors' Mental Health20142022-12-07Toronto, CanadaCanadian Coalition for Seniors' Mental Healthhttps:\/\/ccsmh.ca\/wp-content\/uploads\/2016\/03\/2014-ccsmh-Guideline-Update-Delirium.pdf"},{"key":"ref7","unstructured":"WongKTsangALiuBSchwartzRThe Ontario Senior Friendly Hospital Strategy: Delirium and Functional Decline Indicators - A Report of the Senior Friendly Hospital Indicators Working GroupLocal Health Integration Networks of Ontario2012112022-12-07https:\/\/www.rgptoronto.ca\/wp-content\/uploads\/2017\/12\/SFH_Delirium_and_Functional_\u200bDecline_Indicators.pdf"},{"key":"ref8","unstructured":"Australian Commission on Safety and Quality in Health Care20122022-12-07https:\/\/www.safetyandquality.gov.au\/"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1176\/appi.psy.43.3.183"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1002\/cncr.24215"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMra052321"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1001\/archinte.162.4.457"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.h2538"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2010.1995"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1080\/09540260802675031"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1016\/S1474-4422(15)00101-5"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.1093\/ageing\/28.6.551"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.1001\/archinternmed.2007.4"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.1016\/j.jagp.2018.06.007"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM199903043400901"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2318-12-55"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1016\/0735-6757(95)90080-2"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1111\/acem.12332"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1016\/j.psym.2016.06.001"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2017-019223"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1093\/ageing\/afw198"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.1016\/j.jamda.2015.10.020"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.1111\/j.1532-5415.2011.03677.x"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2018.11103"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocaa113"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2015.2434949"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-018-1109-0"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6579\/aaab07"},{"key":"ref34","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-020-5005-1"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.1186\/2047-2501-2-3"},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-018-0300-7"},{"key":"ref37","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2018.11100"},{"key":"ref38","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1109\/CIC.2002.1166854","volume":"29","author":"Saeed, M","year":"2002","journal-title":"Comput Cardiol"},{"key":"ref39","doi-asserted-by":"publisher","DOI":"10.3115\/1118108.1118117"},{"key":"ref40","doi-asserted-by":"publisher","DOI":"10.2196\/23456"},{"key":"ref41","doi-asserted-by":"publisher","DOI":"10.2196\/14782"},{"key":"ref42","doi-asserted-by":"publisher","DOI":"10.2196\/23082"},{"key":"ref43","doi-asserted-by":"publisher","DOI":"10.2196\/16970"},{"key":"ref44","doi-asserted-by":"publisher","DOI":"10.2196\/medinform.6328"},{"key":"ref45","doi-asserted-by":"publisher","DOI":"10.2196\/12239"},{"key":"ref46","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.h1885"},{"key":"ref47","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2015.06.007"},{"key":"ref48","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2016.05.124"},{"key":"ref49","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-018-4591-7"},{"key":"ref50","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocaa225"},{"key":"ref51","first-page":"476","volume":"2022","author":"Wang, L","year":"2022","journal-title":"AMIA Annu Symp Proc"},{"key":"ref52","doi-asserted-by":"publisher","DOI":"10.9778\/cmajo.20170097"},{"key":"ref53","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.2721"},{"key":"ref54","doi-asserted-by":"publisher","DOI":"10.1111\/j.1532-5415.2005.53120.x"},{"key":"ref55","doi-asserted-by":"publisher","DOI":"10.2196\/16862"},{"key":"ref56","doi-asserted-by":"publisher","DOI":"10.1093\/aje\/kwq433"},{"key":"ref57","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0b013e3181589bb6"},{"key":"ref58","doi-asserted-by":"publisher","DOI":"10.1159\/000339789"},{"issue":"6","key":"ref59","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1017\/S148180350000350X","volume":"16","author":"Bullard, MJ","year":"2014","journal-title":"CJEM"},{"key":"ref60","first-page":"2825","volume":"12","author":"Pedregosa, F","year":"2011","journal-title":"J Mach Learn Res"},{"key":"ref61","doi-asserted-by":"publisher","DOI":"10.5770\/cgj.20.276"},{"key":"ref62","doi-asserted-by":"publisher","DOI":"10.1016\/j.gerinurse.2012.12.009"},{"key":"ref63","doi-asserted-by":"publisher","DOI":"10.1097\/NUR.0b013e318234897b"},{"key":"ref64","doi-asserted-by":"publisher","DOI":"10.1111\/j.1532-5415.2006.00667.x"}],"container-title":["JMIR Medical Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/medinform.jmir.org\/2022\/12\/e38161","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:33:39Z","timestamp":1782840819000},"score":1,"resource":{"primary":{"URL":"https:\/\/medinform.jmir.org\/2022\/12\/e38161"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,20]]},"references-count":64,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022]]}},"URL":"https:\/\/doi.org\/10.2196\/38161","relation":{},"ISSN":["2291-9694"],"issn-type":[{"value":"2291-9694","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,20]]}}}