{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T02:44:23Z","timestamp":1773888263979,"version":"3.50.1"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,8,31]],"date-time":"2023-08-31T00:00:00Z","timestamp":1693440000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,31]],"date-time":"2023-08-31T00:00:00Z","timestamp":1693440000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Shanghai Hospital Development Center Foundation","award":["SHDC22022206"],"award-info":[{"award-number":["SHDC22022206"]}]},{"name":"Shanghai Hospital Development Center Foundation","award":["SHDC22022206"],"award-info":[{"award-number":["SHDC22022206"]}]},{"name":"Shanghai Hospital Development Center Foundation","award":["SHDC22022206"],"award-info":[{"award-number":["SHDC22022206"]}]},{"name":"Shanghai Hospital Development Center Foundation","award":["SHDC22022206"],"award-info":[{"award-number":["SHDC22022206"]}]},{"name":"Shanghai Hospital Development Center Foundation","award":["SHDC22022206"],"award-info":[{"award-number":["SHDC22022206"]}]},{"name":"Shanghai Hospital Development Center Foundation","award":["SHDC22022206"],"award-info":[{"award-number":["SHDC22022206"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>Anti-thrombotic therapy is the basis of thrombosis prevention and treatment. Bleeding is the main adverse event of anti-thrombosis. Existing laboratory indicators cannot accurately reflect the real-time coagulation function. It is necessary to develop tools to dynamically evaluate the risk and benefits of anti-thrombosis to prescribe accurate anti-thrombotic therapy.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The prediction model,daily prediction of bleeding risk in ICU patients treated with anti-thrombotic therapy, was built using deep learning algorithm recurrent neural networks, and the model results and performance were compared with clinicians.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>There was no significant statistical discrepancy in the baseline. ROC curves of the four models in the validation and test set were drawn, respectively. One-layer GRU of the validation set had a larger AUC (0.9462; 95%CI, 0.9147\u20130.9778). Analysis was conducted in the test set, and the ROC curve showed the superiority of two layers LSTM over one-layer GRU, while the former AUC was 0.8391(95%CI, 0.7786\u20130.8997). One-layer GRU in the test set possessed a better specificity (sensitivity 0.5942; specificity 0.9300). The Fleiss\u2019 k of junior clinicians, senior clinicians, and machine learning classifiers is 0.0984, 0.4562, and 0.8012, respectively.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Recurrent neural networks were first applied for daily prediction of bleeding risk in ICU patients treated with anti-thrombotic therapy. Deep learning classifiers are more reliable and consistent than human classifiers. The machine learning classifier suggested strong reliability. The deep learning algorithm significantly outperformed human classifiers in prediction time.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12911-023-02274-5","type":"journal-article","created":{"date-parts":[[2023,8,31]],"date-time":"2023-08-31T05:04:27Z","timestamp":1693458267000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Application of artificial neural network in daily prediction of bleeding in ICU patients treated with anti-thrombotic therapy"],"prefix":"10.1186","volume":"23","author":[{"given":"Daonan","family":"Chen","sequence":"first","affiliation":[]},{"given":"Rui","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Yihan","family":"Jiang","sequence":"additional","affiliation":[]},{"given":"Zijian","family":"Xing","sequence":"additional","affiliation":[]},{"given":"Qiuyang","family":"Sheng","sequence":"additional","affiliation":[]},{"given":"Xiaoqing","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Ruilan","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Hui","family":"Xie","sequence":"additional","affiliation":[]},{"given":"Lina","family":"Zhao","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,8,31]]},"reference":[{"key":"2274_CR1","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1007\/s11739-014-1176-2","volume":"10","author":"M Levi","year":"2014","unstructured":"Levi M, Sivapalaratnam S. Hemostatic abnormalities in critically ill patients. Intern Emerg Med. 2014;10:287\u201396.","journal-title":"Intern Emerg Med"},{"key":"2274_CR2","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1016\/j.ccm.2008.11.003","volume":"30","author":"PW Marks","year":"2009","unstructured":"Marks PW. Coagulation Disorders in the ICU. Clin Chest Med. 2009;30:123\u20139.","journal-title":"Clin Chest Med"},{"key":"2274_CR3","doi-asserted-by":"publisher","first-page":"540","DOI":"10.1097\/MCC.0000000000000558","volume":"24","author":"JD Chodakowski","year":"2018","unstructured":"Chodakowski JD, Courtney DM. Pulmonary embolism critical care update. Curr Opin Crit Care. 2018;24:540\u20136.","journal-title":"Curr Opin Crit Care"},{"key":"2274_CR4","doi-asserted-by":"publisher","first-page":"1000","DOI":"10.14336\/AD.2021.0311","volume":"12","author":"M Hollist","year":"2021","unstructured":"Hollist M, Morgan L, Cabatbat R, Au K, Kirmani MF, Kirmani BF. Acute Stroke Management: overview and recent updates. Aging Dis. 2021;12:1000.","journal-title":"Aging Dis"},{"key":"2274_CR5","first-page":"103300","volume":"69","author":"D Chen","year":"2021","unstructured":"Chen D. Heparin beyond anti-coagulation. Curr Res Transl Med. 2021;69:103300.","journal-title":"Curr Res Transl Med"},{"key":"2274_CR6","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1186\/s13054-019-2347-3","volume":"23","author":"DR Spahn","year":"2019","unstructured":"Spahn DR, Bouillon B, Cerny V, Duranteau J, Filipescu D, Hunt BJ, et al. The european guideline on management of major bleeding and coagulopathy following trauma: fifth edition. Crit Care. 2019;23:98.","journal-title":"Crit Care"},{"key":"2274_CR7","doi-asserted-by":"publisher","first-page":"648","DOI":"10.1007\/s00134-016-4242-6","volume":"42","author":"J Villar","year":"2016","unstructured":"Villar J, P\u00e9rez-M\u00e9ndez L, Kacmarek RM. The Berlin definition met our needs: no. Intensive Care Med. 2016;42:648\u201350.","journal-title":"Intensive Care Med"},{"key":"2274_CR8","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1097\/MCC.0000000000000591","volume":"25","author":"FH Saner","year":"2019","unstructured":"Saner FH, Bezinover D. Assessment and management of coagulopathy in critically-ill patients with liver failure. Curr Opin Crit Care. 2019;25:179\u201386.","journal-title":"Curr Opin Crit Care"},{"key":"2274_CR9","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1007\/s12028-018-0614-9","volume":"30","author":"KM Sauro","year":"2018","unstructured":"Sauro KM, Soo A, Kramer A, Couillard P, Kromm J, Zygun D, et al. Venous thromboembolism Prophylaxis in Neurocritical Care Patients: Are Current Practices. Best Practices? Neurocrit Care. 2018;30:355\u201363.","journal-title":"Best Practices? Neurocrit Care"},{"key":"2274_CR10","first-page":"e5827","volume":"11","author":"S Farr","year":"2019","unstructured":"Farr S, Toor H, Patchana T, Podkovik S, Wiginton JG, Sweiss R, et al. Risks, benefits, and the optimal time to resume deep vein thrombosis Prophylaxis in patients with intracranial hemorrhage. Cureus. 2019;11:e5827.","journal-title":"Cureus"},{"key":"2274_CR11","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1055\/s-0039-1678720","volume":"45","author":"S Schulman","year":"2019","unstructured":"Schulman S, Piran S. Thromboprophylaxis in patients with Acute spinal cord Injury: a narrative review. Semin Thromb Hemost. 2019;45:150\u20136.","journal-title":"Semin Thromb Hemost"},{"key":"2274_CR12","doi-asserted-by":"publisher","first-page":"985","DOI":"10.1097\/CCM.0000000000004350","volume":"48","author":"HA Rayes","year":"2020","unstructured":"Rayes HA, Subat YW, Weister T, Johnson MQ, Hanson A, Schulte PJ, et al. Concomitant aspirin and anticoagulation is Associated with increased risk for major bleeding in Surgical Patients requiring postoperative intensive care. Crit Care Medicine. 2020;48:985\u201392.","journal-title":"Crit Care Medicine"},{"key":"2274_CR13","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1161\/CIRCULATIONAHA.106.612812","volume":"114","author":"JW Eikelboom","year":"2006","unstructured":"Eikelboom JW, Mehta SR, Anand SS, Xie C, Fox KAA, Yusuf S. Adverse impact of bleeding on prognosis in patients with Acute Coronary Syndromes. Circulation. 2006;114:774\u201382.","journal-title":"Circulation"},{"key":"2274_CR14","doi-asserted-by":"publisher","first-page":"1705","DOI":"10.1111\/j.1538-7836.2011.04432.x","volume":"9","author":"M LEVI","year":"2011","unstructured":"LEVI M, KAMPHUISEN EERENBERGE. Bleeding risk and reversal strategies for old and new anticoagulants and antiplatelet agents. J Thromb Haemost. 2011;9:1705\u201312.","journal-title":"J Thromb Haemost"},{"key":"2274_CR15","doi-asserted-by":"publisher","first-page":"e419S","DOI":"10.1378\/chest.11-2301","volume":"141","author":"C Kearon","year":"2012","unstructured":"Kearon C, Akl EA, Comerota AJ, Prandoni P, Bounameaux H, Goldhaber SZ, et al. Antithrombotic therapy for VTE Disease. Chest. 2012;141:e419S\u201396.","journal-title":"Chest"},{"key":"2274_CR16","doi-asserted-by":"publisher","first-page":"542","DOI":"10.14309\/ajg.0000000000001627","volume":"117","author":"NS Abraham","year":"2022","unstructured":"Abraham NS, Barkun AN, Sauer BG, Douketis J, Laine L, Noseworthy PA, et al. American College of Gastroenterology-Canadian Association of Gastroenterology Clinical Practice Guideline: management of Anticoagulants and Antiplatelets during Acute gastrointestinal bleeding and the Periendoscopic Period. Am J Gastroenterol. 2022;117:542\u201358.","journal-title":"Am J Gastroenterol"},{"key":"2274_CR17","doi-asserted-by":"publisher","first-page":"055010","DOI":"10.1088\/1361-6579\/ab8cb2","volume":"41","author":"Y Chen","year":"2020","unstructured":"Chen Y, Yoon JH, Pinsky MR, Ma T, Clermont G. Development of hemorrhage identification model using non-invasive vital signs. Physiol Meas. 2020;41:055010.","journal-title":"Physiol Meas"},{"key":"2274_CR18","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1016\/j.thromres.2020.12.031","volume":"199","author":"MA de Winter","year":"2021","unstructured":"de Winter MA, van Es N, B\u00fcller HR, Visseren FLJ, Nijkeuter M. Prediction models for recurrence and bleeding in patients with venous thromboembolism: a systematic review and critical appraisal. Thromb Res. 2021;199:85\u201396.","journal-title":"Thromb Res"},{"key":"2274_CR19","doi-asserted-by":"publisher","first-page":"266","DOI":"10.1136\/heartjnl-2021-319702","volume":"108","author":"O Barnett-Griness","year":"2021","unstructured":"Barnett-Griness O, Stein N, Kotler A, Saliba W, Gronich N. Novel bleeding prediction model in atrial fibrillation patients on new oral anticoagulants. Heart. 2021;108:266\u201373.","journal-title":"Heart"},{"key":"2274_CR20","unstructured":"Lipton ZC. A Critical Review of Recurrent Neural Networks for Sequence Learning. arXiv.org. 2015."},{"key":"2274_CR21","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1093\/jamia\/ocx084","volume":"25","author":"AEW Johnson","year":"2017","unstructured":"Johnson AEW, Stone DJ, Celi LA, Pollard TJ. The MIMIC Code Repository: enabling reproducibility in critical care research. J Am Med Inform Assoc. 2017;25:32\u20139.","journal-title":"J Am Med Inform Assoc"},{"key":"2274_CR22","doi-asserted-by":"publisher","first-page":"160035","DOI":"10.1038\/sdata.2016.35","volume":"3","author":"AEW Johnson","year":"2016","unstructured":"Johnson AEW, Pollard TJ, Shen L, Lehman LH, Feng M, Ghassemi M, et al. MIMIC-III, a freely accessible critical care database. Sci Data. 2016;3:160035.","journal-title":"Sci Data"},{"key":"2274_CR23","doi-asserted-by":"publisher","first-page":"e183451","DOI":"10.1001\/jamanetworkopen.2018.3451","volume":"1","author":"M Taggart","year":"2018","unstructured":"Taggart M, Chapman WW, Steinberg BA, Ruckel S, Pregenzer-Wenzler A, Du Y, et al. Comparison of 2 Natural Language Processing methods for identification of bleeding among critically ill patients. JAMA Netw Open. 2018;1:e183451.","journal-title":"JAMA Netw Open"},{"key":"2274_CR24","doi-asserted-by":"publisher","first-page":"1788","DOI":"10.1182\/blood.2019003603","volume":"135","author":"AJ Darzi","year":"2020","unstructured":"Darzi AJ, Karam SG, Charide R, Etxeandia-Ikobaltzeta I, Cushman M, Gould MK, et al. Prognostic factors for VTE and bleeding in hospitalized medical patients: a systematic review and meta-analysis. Blood. 2020;135:1788\u2013810.","journal-title":"Blood"},{"key":"2274_CR25","doi-asserted-by":"publisher","first-page":"2557","DOI":"10.1182\/bloodadvances.2020001937","volume":"4","author":"AJ Darzi","year":"2020","unstructured":"Darzi AJ, Karam SG, Spencer FA, Spyropoulos AC, Mbuagbaw L, Woller SC, et al. Risk models for VTE and bleeding in medical inpatients: systematic identification and expert assessment. Blood Adv. 2020;4:2557\u201366.","journal-title":"Blood Adv"},{"key":"2274_CR26","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","volume":"22","author":"ML McHugh","year":"2012","unstructured":"McHugh ML. Interrater reliability: the kappa statistic. Biochem Med. 2012;22:276\u201382.","journal-title":"Biochem Med"},{"key":"2274_CR27","doi-asserted-by":"publisher","DOI":"10.48550\/arxiv.1412.3555","author":"J Chung","year":"2014","unstructured":"Chung J, Gulcehre C, Cho K, Bengio Y. Empirical evaluation of gated recurrent neural networks on sequence modeling. ArXiv. 2014. https:\/\/doi.org\/10.48550\/arxiv.1412.3555.","journal-title":"ArXiv"},{"key":"2274_CR28","doi-asserted-by":"publisher","first-page":"8827","DOI":"10.1038\/s41598-021-88226-3","volume":"11","author":"D Shung","year":"2021","unstructured":"Shung D, Huang J, Castro E, Tay JK, Simonov M, Laine L, et al. Neural network predicts need for red blood cell transfusion for patients with acute gastrointestinal bleeding admitted to the intensive care unit. Sci Rep. 2021;11:8827.","journal-title":"Sci Rep"},{"key":"2274_CR29","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2021.2626","author":"A Wong","year":"2021","unstructured":"Wong A, Otles E, Donnelly JP, Krumm A, McCullough J, DeTroyer-Cooley O, et al. External validation of a widely implemented proprietary Sepsis prediction model in hospitalized patients. JAMA Intern Med. 2021. https:\/\/doi.org\/10.1001\/jamainternmed.2021.2626.","journal-title":"JAMA Intern Med"},{"key":"2274_CR30","doi-asserted-by":"publisher","first-page":"366","DOI":"10.4037\/ajcc2022426","volume":"31","author":"S Grieshop","year":"2022","unstructured":"Grieshop S. Alarm fatigue. Am J Crit Care. 2022;31:366\u20136.","journal-title":"Am J Crit Care"},{"key":"2274_CR31","doi-asserted-by":"publisher","first-page":"4820","DOI":"10.1021\/acs.jcim.2c01034","volume":"62","author":"Q-H Kha","year":"2022","unstructured":"Kha Q-H, Ho Q-T, Le NQK. Identifying SNARE Proteins using an alignment-free Method based on Multiscan Convolutional neural network and PSSM Profiles. J Chem Inf Model. 2022;62:4820\u20136.","journal-title":"J Chem Inf Model"},{"key":"2274_CR32","doi-asserted-by":"publisher","first-page":"1455","DOI":"10.1038\/s41591-022-01894-0","volume":"28","author":"R Adams","year":"2022","unstructured":"Adams R, Henry KE, Sridharan A, Soleimani H, Zhan A, Rawat N, et al. Prospective, multi-site study of patient outcomes after implementation of the TREWS machine learning-based early warning system for sepsis. Nat Med. 2022;28:1455\u201360.","journal-title":"Nat Med"},{"key":"2274_CR33","doi-asserted-by":"publisher","first-page":"3962","DOI":"10.3390\/s23083962","volume":"23","author":"Q-H Kha","year":"2023","unstructured":"Kha Q-H, Le V-H, Hung TNK, Nguyen NTK, Le NQK. Development and validation of an explainable machine learning-based prediction model for drug\u2013food interactions from Chemical Structures. Sensors. 2023;23:3962.","journal-title":"Sensors"},{"key":"2274_CR34","unstructured":"Shrikumar A, Greenside P, Kundaje A. Learning Important Features Through Propagating Activation Differences. International Conference on Machine Learning. 2017;70:3145\u201353."}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02274-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-023-02274-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02274-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,18]],"date-time":"2023-11-18T00:20:39Z","timestamp":1700266839000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-023-02274-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,31]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["2274"],"URL":"https:\/\/doi.org\/10.1186\/s12911-023-02274-5","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-2799427\/v1","asserted-by":"object"}]},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,31]]},"assertion":[{"value":"10 April 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 August 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The ethics committees of the Massachusetts Institute of Technology and Beth Israel Deaconess Medical Centre have approved the implementation of the project. Requirements for individual patient consent and an ethical approval statement were waived in Shanghai General Hospital because the project do no harm to humans, there\u2019s no commercial interest, and did not impact clinical care and the data used in this database was anonymous.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"171"}}