{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,5]],"date-time":"2026-11-05T19:58:28Z","timestamp":1793908708907,"version":"4.8.0"},"reference-count":30,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"6","license":[{"start":{"date-parts":[[2025,6,1]],"date-time":"2025-06-01T00:00:00Z","timestamp":1748736000000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"abstract":"<jats:sec>\n            <jats:title>IMPORTANCE:<\/jats:title>\n            <jats:p>Sepsis is a major cause of morbidity and mortality, with early intervention shown to improve outcomes. Predictive modeling and artificial intelligence (AI) can aid in early sepsis recognition, but there remains a gap between algorithm development and clinical use. Despite the importance of user experience in adopting clinical predictive models, few studies have focused on provider acceptance and feedback.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>OBJECTIVES:<\/jats:title>\n            <jats:p>To evaluate healthcare worker perception and acceptance of a deep learning sepsis prediction model in the emergency department (ED).<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>DESIGN, SETTING, AND PARTICIPANTS:<\/jats:title>\n            <jats:p>COnformal Multidimensional Prediction Of SEpsis Risk (COMPOSER), a deep learning algorithm, is used at two EDs of a large academic medical center to predict sepsis before clear clinical presentation. An internally developed survey following the Checklist for Reporting Results of Internet E-Surveys was distributed to team members who received a COMPOSER alert.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>ANALYSIS:<\/jats:title>\n            <jats:p>Mann-Whitney <jats:italic toggle=\"yes\">U<\/jats:italic> testing was performed on results stratified by provider experience.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>RESULTS:<\/jats:title>\n            <jats:p>A total of 114 responses were received: 76 from doctors of medicine\/doctors of osteopathic medicine, 34 from registered nurses, and four from nurse practicioners\/physician assistants. Of these, 53% were from providers with fewer than 5 years of experience. Seventy-seven percent of respondents had a positive or neutral perception of the alert\u2019s usefulness. Providers with 0\u20135 years of experience were more likely to expect sepsis after the alert (<jats:italic toggle=\"yes\">p<\/jats:italic> = 0.021) and found the alert more useful (<jats:italic toggle=\"yes\">p<\/jats:italic> = 0.016) compared with those with 6+ years of experience. Additionally, physicians with 0\u20135 years of experience were more likely to say the alert changed their patient management (<jats:italic toggle=\"yes\">p<\/jats:italic> = 0.048).<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>CONCLUSIONS:<\/jats:title>\n            <jats:p>Less experienced providers were more likely to perceive benefit from the alert, which was overall received favorably. Future AI implementations might consider tailored alert patterns and education to enhance reception and reduce fatigue.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1097\/cce.0000000000001276","type":"journal-article","created":{"date-parts":[[2025,6,4]],"date-time":"2025-06-04T21:00:19Z","timestamp":1749070819000},"page":"e1276","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":1,"title":["Quantifying Healthcare Provider Perceptions of a Novel Deep Learning Algorithm to Predict Sepsis: Electronic Survey"],"prefix":"10.1097","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2938-7942","authenticated-orcid":false,"given":"Karthik","family":"Ramesh","sequence":"first","affiliation":[{"name":"School of Medicine, University of California San Diego, San Diego, CA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aaron","family":"Boussina","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of California San Diego, San Diego, CA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Supreeth P.","family":"Shashikumar","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of California San Diego, San Diego, CA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atul","family":"Malhotra","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of California San Diego, San Diego, CA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher A.","family":"Longhurst","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of California San Diego, San Diego, CA."},{"name":"Department of Quality, University of California San Diego, San Diego, CA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher S.","family":"Josef","sequence":"additional","affiliation":[{"name":"Clairyon, La Jolla, CA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kimberly","family":"Quintero","sequence":"additional","affiliation":[{"name":"Department of Quality, University of California San Diego, San Diego, CA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jake","family":"Del Rosso","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Cottage Hospital, Santa Barbara, CA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shamim","family":"Nemati","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of California San Diego, San Diego, CA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gabriel","family":"Wardi","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of California San Diego, San Diego, CA."},{"name":"Department of Emergency Medicine, University of California San Diego, San Diego, CA."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2025,6,4]]},"reference":[{"key":"R1-20250604","doi-asserted-by":"crossref","first-page":"1241","DOI":"10.1001\/jama.2017.13836","article-title":"Incidence and trends of sepsis in US hospitals using clinical vs claims data, 2009\u20132014.","volume":"318","author":"Rhee","year":"2017","journal-title":"JAMA"},{"key":"R2-20250604","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1001\/jama.2016.0288","article-title":"Assessment of clinical criteria for sepsis: For the third international consensus definitions for sepsis and septic shock (Sepsis-3).","volume":"315","author":"Seymour","year":"2016","journal-title":"JAMA"},{"key":"R3-20250604","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1001\/jama.2016.0287","article-title":"The third international consensus definitions for sepsis and septic shock (Sepsis-3).","volume":"315","author":"Singer","year":"2016","journal-title":"JAMA"},{"key":"R4-20250604","doi-asserted-by":"crossref","first-page":"1620","DOI":"10.1007\/s00134-015-3906-y","article-title":"The Surviving Sepsis Campaign bundles and outcome: Results from the International Multicentre Prevalence Study on Sepsis (the IMPreSS study).","volume":"41","author":"Rhodes","year":"2015","journal-title":"Intensive Care Med"},{"key":"R5-20250604","doi-asserted-by":"crossref","first-page":"1907","DOI":"10.1097\/CCM.0000000000001142","article-title":"The impact of timing of antibiotics on outcomes in severe sepsis and septic shock: A systematic review and meta-analysis.","volume":"43","author":"Sterling","year":"2015","journal-title":"Crit Care Med"},{"key":"R6-20250604","doi-asserted-by":"crossref","first-page":"1749","DOI":"10.1097\/CCM.0000000000000330","article-title":"Empiric antibiotic treatment reduces mortality in severe sepsis and septic shock from the first hour: Results from a guideline-based performance improvement program.","volume":"42","author":"Ferrer","year":"2014","journal-title":"Crit Care Med"},{"key":"R7-20250604","doi-asserted-by":"crossref","first-page":"2235","DOI":"10.1056\/NEJMoa1703058","article-title":"Time to treatment and mortality during mandated emergency care for sepsis.","volume":"376","author":"Seymour","year":"2017","journal-title":"N Engl J Med"},{"key":"R8-20250604","doi-asserted-by":"crossref","first-page":"707","DOI":"10.1001\/jamainternmed.2020.0183","article-title":"Association of a care bundle for early sepsis management with mortality among patients with hospital-onset or community-onset sepsis.","volume":"180","author":"Baghdadi","year":"2020","journal-title":"JAMA Intern Med"},{"key":"R9-20250604","doi-asserted-by":"crossref","first-page":"1347","DOI":"10.1056\/NEJMra1814259","article-title":"Machine learning in medicine.","volume":"380","author":"Rajkomar","year":"2019","journal-title":"N Engl J Med"},{"key":"R10-20250604","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1038\/s41746-021-00504-6","article-title":"Artificial intelligence sepsis prediction algorithm learns to say \u201cI don\u2019t know\u201d.","volume":"4","author":"Shashikumar","year":"2021","journal-title":"NPJ Digit Med"},{"key":"R11-20250604","doi-asserted-by":"crossref","first-page":"1455","DOI":"10.1038\/s41591-022-01894-0","article-title":"Prospective, multi-site study of patient outcomes after implementation of the TREWS machine learning-based early warning system for sepsis.","volume":"28","author":"Adams","year":"2022","journal-title":"Nat Med"},{"key":"R12-20250604","doi-asserted-by":"crossref","first-page":"102036","DOI":"10.1016\/j.artmed.2021.102036","article-title":"DeepAISE\u2014an interpretable and recurrent neural survival model for early prediction of sepsis.","volume":"113","author":"Shashikumar","year":"2021","journal-title":"Artif Intell Med"},{"key":"R13-20250604","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1097\/CCM.0000000000005894","article-title":"Bringing the promise of artificial intelligence to critical care: What the experience with sepsis analytics can teach us.","volume":"51","author":"Wardi","year":"2023","journal-title":"Crit Care Med"},{"key":"R14-20250604","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.ijmedinf.2018.03.013","article-title":"Concurrence of big data analytics and healthcare: A systematic review.","volume":"114","author":"Mehta","year":"2018","journal-title":"Int J Med Inform"},{"key":"R15-20250604","doi-asserted-by":"crossref","first-page":"1065","DOI":"10.1001\/jamainternmed.2021.2626","article-title":"External validation of a widely implemented proprietary sepsis prediction model in hospitalized patients.","volume":"181","author":"Wong","year":"2021","journal-title":"JAMA Intern Med"},{"key":"R16-20250604","doi-asserted-by":"crossref","first-page":"e41056","DOI":"10.2196\/41056","article-title":"Assessing barriers to implementation of machine learning and artificial intelligence-based tools in critical care: Web-based survey study.","volume":"6","author":"Mlodzinski","year":"2023","journal-title":"JMIR Perioper Med"},{"key":"R18-20250604","doi-asserted-by":"crossref","first-page":"2310","DOI":"10.1377\/hlthaff.2010.1111","article-title":"Clinical decision support systems could be modified to reduce \u201calert fatigue\u201d while still minimizing the risk of litigation.","volume":"30","author":"Kesselheim","year":"2011","journal-title":"Health Aff (Millwood)"},{"key":"R19-20250604","first-page":"195","article-title":"Clinical decision support alert appropriateness: A review and proposal for improvement.","volume":"14","author":"McCoy","year":"2014","journal-title":"Ochsner J"},{"key":"R20-20250604","doi-asserted-by":"crossref","first-page":"1447","DOI":"10.1038\/s41591-022-01895-z","article-title":"Factors driving provider adoption of the TREWS machine learning-based early warning system and its effects on sepsis treatment timing.","volume":"28","author":"Henry","year":"2022","journal-title":"Nat Med"},{"key":"R21-20250604","doi-asserted-by":"crossref","first-page":"1477","DOI":"10.1097\/CCM.0000000000003803","article-title":"Clinician perception of a machine learning-based early warning system designed to predict severe sepsis and septic shock.","volume":"47","author":"Ginestra","year":"2019","journal-title":"Crit Care Med"},{"key":"R22-20250604","article-title":"Development & deployment of a real-time healthcare predictive analytics platform.","author":"Boussina","journal-title":"medRxiv"},{"key":"R23-20250604","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1038\/s41746-023-00986-6","article-title":"Impact of a deep learning sepsis prediction model on quality of care and survival.","volume":"7","author":"Boussina","year":"2024","journal-title":"NPJ Digit Med"},{"key":"R24-20250604","doi-asserted-by":"crossref","first-page":"e34","DOI":"10.2196\/jmir.6.3.e34","article-title":"Improving the quality of web surveys: The checklist for reporting results of Internet e-surveys (CHERRIES).","volume":"6","author":"Eysenbach","year":"2004","journal-title":"J Med Internet Res"},{"key":"R25-20250604","doi-asserted-by":"crossref","first-page":"e100233","DOI":"10.1136\/bmjhci-2020-100233","article-title":"Clinician and computer: A study on patient perceptions of artificial intelligence in skeletal radiography.","volume":"27","author":"York","year":"2020","journal-title":"BMJ Health Care Inform"},{"key":"R26-20250604","doi-asserted-by":"crossref","first-page":"1159","DOI":"10.1111\/j.1365-2702.2008.02607.x","article-title":"Nurses\u2019 use of computerised clinical decision support systems: A case site analysis.","volume":"18","author":"Dowding","year":"2009","journal-title":"J Clin Nurs"},{"key":"R27-20250604","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1038\/s41746-020-0221-y","article-title":"An overview of clinical decision support systems: Benefits, risks, and strategies for success.","volume":"3","author":"Sutton","year":"2020","journal-title":"NPJ Digit Med"},{"key":"R28-20250604","doi-asserted-by":"crossref","first-page":"e43486","DOI":"10.2196\/43486","article-title":"Optimizing the implementation of clinical predictive models to minimize national costs: Sepsis case study.","volume":"25","author":"Rogers","year":"2023","journal-title":"J Med Internet Res"},{"key":"R29-20250604","doi-asserted-by":"crossref","first-page":"CAT.21.0457","DOI":"10.1056\/CAT.21.0457","article-title":"Using AI to empower collaborative team workflows: Two implementations for advance care planning and care escalation.","volume":"3","author":"Li","year":"2022","journal-title":"NEJM Catalyst"},{"key":"R30-20250604","doi-asserted-by":"crossref","first-page":"1592","DOI":"10.1097\/CCM.0000000000003260","article-title":"Presenting symptoms independently predict mortality in septic shock: Importance of a previously unmeasured confounder.","volume":"46","author":"Filbin","year":"2018","journal-title":"Crit Care Med"},{"key":"R31-20250604","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1038\/s41746-022-00737-z","article-title":"AI in the hands of imperfect users.","volume":"5","author":"Kostick-Quenet","year":"2022","journal-title":"NPJ Digital Med"}],"container-title":["Critical Care Explorations"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/10.1097\/CCE.0000000000001276","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,4]],"date-time":"2025-06-04T21:00:24Z","timestamp":1749070824000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/10.1097\/CCE.0000000000001276"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6]]},"references-count":30,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2025]]}},"URL":"https:\/\/doi.org\/10.1097\/cce.0000000000001276","relation":{},"ISSN":["2639-8028"],"issn-type":[{"value":"2639-8028","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6]]}}}