{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T18:24:23Z","timestamp":1775759063198,"version":"3.50.1"},"reference-count":61,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2022,10,1]],"date-time":"2022-10-01T00:00:00Z","timestamp":1664582400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000133","name":"Agency for Healthcare Research and Quality","doi-asserted-by":"publisher","award":["5R01HS026246"],"award-info":[{"award-number":["5R01HS026246"]}],"id":[{"id":"10.13039\/100000133","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Health Informatics J"],"published-print":{"date-parts":[[2022,10]]},"abstract":"<jats:sec><jats:title>Objective<\/jats:title><jats:p> We describe our approach to surveillance of reportable safety events captured in hospital data including free-text clinical notes. We hypothesize that a) some patient safety events are documented only in the clinical notes and not in any other accessible source; and b) large-scale abstraction of event data from clinical notes is feasible. <\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and Methods<\/jats:title><jats:p> We use regular expressions to generate a training data set for a machine learning model and apply this model to the full set of clinical notes and conduct further review to identify safety events of interest. We demonstrate this approach on peripheral intravenous (PIV) infiltrations and extravasations (PIVIEs). <\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p> During Phase 1, we collected 21,362 clinical notes, of which 2342 were reviewed. We identified 125 PIV events, of which 44 cases (35%) were not captured by other patient safety systems. During Phase 2, we collected 60,735 clinical notes and identified 440 infiltrate events. Our classifier demonstrated accuracy above 90%. <\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p> Our method to identify safety events from the free text of clinical documentation offers a feasible and scalable approach to enhance existing patient safety systems. Expert reviewers, using a machine learning model, can conduct routine surveillance of patient safety events. <\/jats:p><\/jats:sec>","DOI":"10.1177\/14604582221132429","type":"journal-article","created":{"date-parts":[[2022,11,4]],"date-time":"2022-11-04T08:44:01Z","timestamp":1667551441000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":20,"title":["Electronic surveillance of patient safety events using natural language processing"],"prefix":"10.1177","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4233-5899","authenticated-orcid":false,"given":"Al","family":"Ozonoff","sequence":"first","affiliation":[{"name":"Boston Children\u2019s Hospital, MA, USA"},{"name":"Harvard Medical School, Boston, MA, USA"}]},{"given":"Carly E","family":"Milliren","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital, MA, USA"}]},{"given":"Kerri","family":"Fournier","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital, MA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2491-677X","authenticated-orcid":false,"given":"Jennifer","family":"Welcher","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital, MA, USA"}]},{"given":"Assaf","family":"Landschaft","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital, Boston, MA, USA"}]},{"given":"Mihail","family":"Samnaliev","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital, MA, USA"},{"name":"Harvard Medical School, Boston, MA, USA"}]},{"given":"Mehmet","family":"Saluvan","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital, MA, USA"}]},{"given":"Mark","family":"Waltzman","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital, MA, USA"},{"name":"Harvard Medical School, Boston, MA, USA"}]},{"given":"Amir A","family":"Kimia","sequence":"additional","affiliation":[{"name":"Boston Children\u2019s Hospital, MA, USA"},{"name":"Harvard Medical School, Boston, MA, USA"}]}],"member":"179","published-online":{"date-parts":[[2022,11,4]]},"reference":[{"key":"bibr1-14604582221132429","volume-title":"To Err Is Human: Building a Safer Health System","author":"IOM","year":"1999"},{"key":"bibr2-14604582221132429","volume-title":"Crossing the Quality Chasm: A New Health System for the 21st Century","author":"IOM","year":"2001"},{"key":"bibr3-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacc.2016.03.545"},{"key":"bibr4-14604582221132429","first-page":"1c","volume":"10","author":"Bowman S","year":"2013","journal-title":"Perspect Health Information Management"},{"key":"bibr5-14604582221132429","first-page":"3","volume":"61","author":"Thacker SB","year":"2012","journal-title":"MMWR Surveill Summ"},{"key":"bibr6-14604582221132429","volume-title":"A dictionary of epidemiology","author":"Porta M","year":"2008"},{"key":"bibr7-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM196301242680405"},{"key":"bibr8-14604582221132429","volume-title":"Disease surveillance: a public health informatics approach","author":"Lombardo JS","year":"2012"},{"key":"bibr9-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1111\/1468-0009.12166"},{"key":"bibr10-14604582221132429","volume-title":"Advances in Patient Safety: New Directions and Alternative Approaches","volume":"1","author":"Pronovost PJ","year":"2008"},{"key":"bibr11-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2015-004732"},{"key":"bibr12-14604582221132429","volume-title":"Hospital Survey on Patient Safety Culture 2016 User Comparative Database Report","author":"Famolaro T YN","year":"2016"},{"key":"bibr13-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1197\/jamia.M1794"},{"key":"bibr14-14604582221132429","volume-title":"Understanding Patient Safety","author":"Wachter R","year":"2017","edition":"3"},{"key":"bibr15-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2017-006975"},{"key":"bibr16-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2014-003432"},{"issue":"5","key":"bibr17-14604582221132429","first-page":"425","volume":"19","author":"Kaafarani HM","year":"2010","journal-title":"Qual Safety Health Care"},{"key":"bibr18-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2015-004405"},{"issue":"3","key":"bibr19-14604582221132429","doi-asserted-by":"crossref","first-page":"e081","DOI":"10.1097\/pq9.0000000000000081","volume":"3","author":"Stockwell DC","year":"2018","journal-title":"Pediatr Qual Saf"},{"key":"bibr20-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1017\/ice.2015.264"},{"key":"bibr21-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2011.1204"},{"key":"bibr22-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1016\/j.apnr.2011.06.002"},{"key":"bibr23-14604582221132429","first-page":"1454","volume":"2011","author":"Waitman LR","year":"2011","journal-title":"AMIA Annu Symp Proceedings AMIA Symp"},{"issue":"6","key":"bibr24-14604582221132429","volume":"20","author":"Lavin MA","year":"2015","journal-title":"Online J Issues Nurs"},{"key":"bibr25-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1197\/jamia.M2196"},{"key":"bibr26-14604582221132429","doi-asserted-by":"publisher","DOI":"10.4338\/ACI-2016-02-R-0023"},{"key":"bibr27-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4939-0847-9_16"},{"key":"bibr28-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1186\/2047-2501-2-3"},{"key":"bibr29-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000501"},{"key":"bibr30-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2012-001458"},{"key":"bibr31-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2015-004853"},{"key":"bibr32-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1016\/S1070-3241(16)30180-8"},{"key":"bibr33-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780195372922.001.0001"},{"key":"bibr34-14604582221132429","volume-title":"Advances in Kernel Methods- Support Vector Learning","author":"Joachims T","year":"1999"},{"key":"bibr35-14604582221132429","volume-title":"sklearn,ensemble. RandomForestClassifier","author":"Scikit"},{"key":"bibr36-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1097\/PEC.0000000000000484"},{"key":"bibr37-14604582221132429","first-page":"949","volume":"2003","author":"Nash SK","year":"2003","journal-title":"AMIA Annu Symp Proc"},{"key":"bibr38-14604582221132429","volume-title":"Mastering Regular Expressions: Understand Your Data and Be More Productive","author":"Friedl JE","year":"2006"},{"issue":"1","key":"bibr39-14604582221132429","first-page":"7","volume":"48","author":"Paroubek P","year":"2007","journal-title":"Traitement Automatique des Langues"},{"key":"bibr40-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2017.07.012"},{"key":"bibr41-14604582221132429","volume-title":"Document Review Tools","author":"Kimia A","year":"2019"},{"key":"bibr42-14604582221132429","volume-title":"Mastering regular expressions","author":"Friedl JE","year":"2002"},{"key":"bibr43-14604582221132429","first-page":"2405","volume":"8","author":"Lebanon G","year":"2007","journal-title":"JMLR"},{"key":"bibr44-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-002411"},{"key":"bibr45-14604582221132429","unstructured":"Ho TK. Random decision forests. In: Proceedings of 3rd international conference on document analysis and recognition, Montreal, QC, 1995, pp. 278\u2013282."},{"key":"bibr46-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1097\/NAN.0000000000000287"},{"issue":"10","key":"bibr47-14604582221132429","first-page":"583","volume":"44","author":"Blanchfield BB","year":"2018","journal-title":"The Joint Comm J Qual Patient Saf"},{"key":"bibr48-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1097\/HMR.0000000000000163"},{"key":"bibr49-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-001914"},{"issue":"2","key":"bibr50-14604582221132429","first-page":"171","volume":"42","author":"Thacker SB","year":"2007","journal-title":"J Athletic Training"},{"key":"bibr51-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1111\/jhq.12058"},{"key":"bibr52-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2016-3494"},{"key":"bibr53-14604582221132429","volume-title":"Patient safety: achieving a new standard for care","author":"Erickson SM","year":"2003"},{"key":"bibr54-14604582221132429","volume-title":"Overview of Influenza Surveillance in the United States","author":"CDC","year":"2019"},{"key":"bibr55-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2013-002757"},{"key":"bibr56-14604582221132429","volume-title":"Health IT Dashboard Quick Stats","author":"HealthIT.gov","year":"2018"},{"key":"bibr57-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMsb1002320"},{"key":"bibr58-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1002\/jhm.905"},{"key":"bibr59-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1197\/jamia.M1216"},{"key":"bibr60-14604582221132429","volume-title":"AHRQ Announces Interest in Research on Health IT Safety","author":"AHRQ","year":"2016"},{"key":"bibr61-14604582221132429","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2018-0496"}],"container-title":["Health Informatics Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/14604582221132429","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/14604582221132429","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/14604582221132429","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,25]],"date-time":"2025-01-25T02:11:03Z","timestamp":1737771063000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/14604582221132429"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10]]},"references-count":61,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,10]]}},"alternative-id":["10.1177\/14604582221132429"],"URL":"https:\/\/doi.org\/10.1177\/14604582221132429","relation":{},"ISSN":["1460-4582","1741-2811"],"issn-type":[{"value":"1460-4582","type":"print"},{"value":"1741-2811","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10]]},"article-number":"14604582221132429"}}