{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T08:12:45Z","timestamp":1780647165024,"version":"3.54.1"},"reference-count":61,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,7,12]],"date-time":"2022-07-12T00:00:00Z","timestamp":1657584000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,12]],"date-time":"2022-07-12T00:00:00Z","timestamp":1657584000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Accurate prediction of postoperative mortality is important for not only successful postoperative patient care but also for information-based shared decision-making with patients and efficient allocation of medical resources. This study aimed to create a machine-learning prediction model for 30-day mortality after a non-cardiac surgery that adapts to the manageable amount of clinical information as input features and is validated against multi-centered rather than single-centered data. Data were collected from 454,404 patients over 18 years of age who underwent non-cardiac surgeries from four independent institutions. We performed a retrospective analysis of the retrieved data. Only 12\u201318 clinical variables were used for model training. Logistic regression, random forest classifier, extreme gradient boosting (XGBoost), and deep neural network methods were applied to compare the prediction performances. To reduce overfitting and create a robust model, bootstrapping and grid search with tenfold cross-validation were performed. The XGBoost method in Seoul National University Hospital (SNUH) data delivers the best performance in terms of the area under receiver operating characteristic curve (AUROC) (0.9376) and the area under the precision-recall curve (0.1593). The predictive performance was the best when the SNUH model was validated with Ewha Womans University Medical Center data (AUROC, 0.941). Preoperative albumin, prothrombin time, and age were the most important features in the model for each hospital. It is possible to create a robust artificial intelligence prediction model applicable to multiple institutions through a light predictive model using only minimal preoperative information that can be automatically extracted from each hospital.<\/jats:p>","DOI":"10.1038\/s41746-022-00625-6","type":"journal-article","created":{"date-parts":[[2022,7,12]],"date-time":"2022-07-12T21:12:34Z","timestamp":1657660354000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":48,"title":["Multi-center validation of machine learning model for preoperative prediction of postoperative mortality"],"prefix":"10.1038","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4371-5703","authenticated-orcid":false,"given":"Seung Wook","family":"Lee","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hyung-Chul","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jungyo","family":"Suh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7010-5284","authenticated-orcid":false,"given":"Kyung Hyun","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Heonyi","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suryang","family":"Seo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tae Kyong","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2967-9670","authenticated-orcid":false,"given":"Sang-Wook","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yi-Jun","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,7,12]]},"reference":[{"key":"625_CR1","doi-asserted-by":"publisher","first-page":"S11","DOI":"10.1016\/S0140-6736(15)60806-6","volume":"385","author":"TG Weiser","year":"2015","unstructured":"Weiser, T. G. et al. Estimate of the global volume of surgery in 2012: an assessment supporting improved health outcomes. Lancet 385, S11 (2015).","journal-title":"Lancet"},{"key":"625_CR2","doi-asserted-by":"publisher","first-page":"e316","DOI":"10.1016\/S2214-109X(15)70115-4","volume":"3","author":"BC Alkire","year":"2015","unstructured":"Alkire, B. C. et al. Global access to surgical care: a modelling study. Lancet Glob. Health 3, e316\u2013e323 (2015).","journal-title":"Lancet Glob. Health"},{"key":"625_CR3","doi-asserted-by":"publisher","first-page":"2540","DOI":"10.1016\/j.mayocp.2020.03.008","volume":"95","author":"C Stephenson","year":"2020","unstructured":"Stephenson, C. et al. Management of common postoperative complications. Mayo Clin. Proc. 95, 2540\u20132554 (2020).","journal-title":"Mayo Clin. Proc."},{"key":"625_CR4","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1016\/j.amjsurg.2012.11.009","volume":"206","author":"O Anderson","year":"2013","unstructured":"Anderson, O., Davis, R., Hanna, G. B. & Vincent, C. A. Surgical adverse events: a systematic review. Am. J. Surg. 206, 253\u2013262 (2013).","journal-title":"Am. J. Surg."},{"key":"625_CR5","doi-asserted-by":"publisher","first-page":"370","DOI":"10.1056\/NEJM199102073240604","volume":"324","author":"TA Brennan","year":"1991","unstructured":"Brennan, T. A. et al. Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical practice study I. N. Engl. J. Med. 324, 370\u2013376 (1991).","journal-title":"N. Engl. J. Med."},{"key":"625_CR6","doi-asserted-by":"publisher","first-page":"216","DOI":"10.1136\/qshc.2007.023622","volume":"17","author":"EN de Vries","year":"2008","unstructured":"de Vries, E. N., Ramrattan, M. A., Smorenburg, S. M., Gouma, D. J. & Boermeester, M. A. The incidence and nature of in-hospital adverse events: a systematic review. Qual. Saf. Health Care 17, 216\u2013223 (2008).","journal-title":"Qual. Saf. Health Care"},{"key":"625_CR7","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1016\/j.jss.2013.01.032","volume":"181","author":"SE Tevis","year":"2013","unstructured":"Tevis, S. E. & Kennedy, G. D. Postoperative complications and implications on patient-centered outcomes. J. Surg. Res. 181, 106\u2013113 (2013).","journal-title":"J. Surg. Res."},{"key":"625_CR8","doi-asserted-by":"publisher","first-page":"505","DOI":"10.1016\/j.surg.2011.07.045","volume":"150","author":"NE Mayo","year":"2011","unstructured":"Mayo, N. E. et al. Impact of preoperative change in physical function on postoperative recovery: argument supporting prehabilitation for colorectal surgery. Surgery 150, 505\u2013514 (2011).","journal-title":"Surgery"},{"key":"625_CR9","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1136\/bmj.319.7204.241","volume":"319","author":"K Gunning","year":"1999","unstructured":"Gunning, K. & Rowan, K. ABC of intensive care: outcome data and scoring systems. BMJ 319, 241\u2013244 (1999).","journal-title":"BMJ"},{"key":"625_CR10","doi-asserted-by":"publisher","first-page":"347","DOI":"10.7326\/0003-4819-126-5-199703010-00002","volume":"126","author":"M Pine","year":"1997","unstructured":"Pine, M., Norusis, M., Jones, B. & Rosenthal, G. E. Predictions of hospital mortality rates: a comparison of data sources. Ann. Intern Med. 126, 347\u2013354 (1997).","journal-title":"Ann. Intern Med."},{"key":"625_CR11","doi-asserted-by":"publisher","first-page":"682","DOI":"10.1097\/SLA.0b013e31819eda21","volume":"249","author":"ME Cohen","year":"2009","unstructured":"Cohen, M. E., Bilimoria, K. Y., Ko, C. Y., Richards, K. & Hall, B. L. Effect of subjective preoperative variables on risk-adjusted assessment of hospital morbidity and mortality. Ann. Surg. 249, 682\u2013689 (2009).","journal-title":"Ann. Surg."},{"key":"625_CR12","doi-asserted-by":"publisher","first-page":"833","DOI":"10.1016\/j.jamcollsurg.2013.07.385","volume":"217","author":"KY Bilimoria","year":"2013","unstructured":"Bilimoria, K. Y. et al. Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J. Am. Coll. Surg. 217, 833\u2013842 (2013).","journal-title":"J. Am. Coll. Surg."},{"key":"625_CR13","doi-asserted-by":"publisher","first-page":"1288","DOI":"10.1002\/bjs.5058","volume":"92","author":"MJ Brooks","year":"2005","unstructured":"Brooks, M. J., Sutton, R. & Sarin, S. Comparison of surgical risk score, POSSUM and p-POSSUM in higher-risk surgical patients. Br. J. Surg. 92, 1288\u20131292 (2005).","journal-title":"Br. J. Surg."},{"key":"625_CR14","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1002\/bjs.1800780327","volume":"78","author":"GP Copeland","year":"1991","unstructured":"Copeland, G. P., Jones, D. & Walters, M. POSSUM: a scoring system for surgical audit. Br. J. Surg. 78, 355\u2013360 (1991).","journal-title":"Br. J. Surg."},{"key":"625_CR15","doi-asserted-by":"publisher","first-page":"1217","DOI":"10.1046\/j.1365-2168.1998.00840.x","volume":"85","author":"DR Prytherch","year":"1998","unstructured":"Prytherch, D. R. et al. POSSUM and Portsmouth POSSUM for predicting mortality. Physiological and operative severity score for the enUmeration of mortality and morbidity. Br. J. Surg. 85, 1217\u20131220 (1998).","journal-title":"Br. J. Surg."},{"key":"625_CR16","doi-asserted-by":"publisher","first-page":"1774","DOI":"10.1002\/bjs.9638","volume":"101","author":"KL Protopapa","year":"2014","unstructured":"Protopapa, K. L., Simpson, J. C., Smith, N. C. & Moonesinghe, S. R. Development and validation of the surgical outcome risk tool (SORT). Br. J. Surg. 101, 1774\u20131783 (2014).","journal-title":"Br. J. Surg."},{"key":"625_CR17","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1016\/j.jamcollsurg.2006.11.011","volume":"204","author":"AA Gawande","year":"2007","unstructured":"Gawande, A. A., Kwaan, M. R., Regenbogen, S. E., Lipsitz, S. A. & Zinner, M. J. An Apgar score for surgery. J. Am. Coll. Surg. 204, 201\u2013208 (2007).","journal-title":"J. Am. Coll. Surg."},{"key":"625_CR18","doi-asserted-by":"publisher","first-page":"1133","DOI":"10.1097\/SLA.0000000000003297","volume":"272","author":"CJ Chiew","year":"2020","unstructured":"Chiew, C. J., Liu, N., Wong, T. H., Sim, Y. E. & Abdullah, H. R. Utilizing machine learning methods for preoperative prediction of postsurgical mortality and intensive care unit admission. Ann. Surg. 272, 1133\u20131139 (2020).","journal-title":"Ann. Surg."},{"key":"625_CR19","doi-asserted-by":"publisher","first-page":"688","DOI":"10.1016\/j.bja.2019.07.025","volume":"123","author":"BA Fritz","year":"2019","unstructured":"Fritz, B. A. et al. Deep-learning model for predicting 30-day postoperative mortality. Br. J. Anaesth. 123, 688\u2013695 (2019).","journal-title":"Br. J. Anaesth."},{"key":"625_CR20","doi-asserted-by":"publisher","first-page":"877","DOI":"10.1016\/j.bja.2019.07.030","volume":"123","author":"BL Hill","year":"2019","unstructured":"Hill, B. L. et al. An automated machine learning-based model predicts postoperative mortality using readily-extractable preoperative electronic health record data. Br. J. Anaesth. 123, 877\u2013886 (2019).","journal-title":"Br. J. Anaesth."},{"key":"625_CR21","doi-asserted-by":"publisher","first-page":"649","DOI":"10.1097\/ALN.0000000000002186","volume":"129","author":"CK Lee","year":"2018","unstructured":"Lee, C. K., Hofer, I., Gabel, E., Baldi, P. & Cannesson, M. Development and validation of a deep neural network model for prediction of postoperative in-hospital mortality. Anesthesiology 129, 649\u2013662 (2018).","journal-title":"Anesthesiology"},{"key":"625_CR22","doi-asserted-by":"publisher","first-page":"e0246640","DOI":"10.1371\/journal.pone.0246640","volume":"16","author":"T Seki","year":"2021","unstructured":"Seki, T., Kawazoe, Y. & Ohe, K. Machine learning-based prediction of in-hospital mortality using admission laboratory data: a retrospective, single-site study using electronic health record data. PLoS One 16, e0246640 (2021).","journal-title":"PLoS One"},{"key":"625_CR23","doi-asserted-by":"publisher","first-page":"818","DOI":"10.1097\/00003246-198510000-00009","volume":"13","author":"WA Knaus","year":"1985","unstructured":"Knaus, W. A., Draper, E. A., Wagner, D. P. & Zimmerman, J. E. APACHE II: a severity of disease classification system. Crit. Care Med. 13, 818\u2013829 (1985).","journal-title":"Crit. Care Med."},{"key":"625_CR24","doi-asserted-by":"publisher","first-page":"1619","DOI":"10.1378\/chest.100.6.1619","volume":"100","author":"WA Knaus","year":"1991","unstructured":"Knaus, W. A. et al. The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest 100, 1619\u20131636 (1991).","journal-title":"Chest"},{"key":"625_CR25","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1097\/00003246-198108000-00008","volume":"9","author":"WA Knaus","year":"1981","unstructured":"Knaus, W. A., Zimmerman, J. E., Wagner, D. P., Draper, E. A. & Lawrence, D. E. APACHE-acute physiology and chronic health evaluation: a physiologically based classification system. Crit. Care Med. 9, 591\u2013597 (1981).","journal-title":"Crit. Care Med."},{"key":"625_CR26","doi-asserted-by":"publisher","first-page":"1297","DOI":"10.1097\/01.CCM.0000215112.84523.F0","volume":"34","author":"JE Zimmerman","year":"2006","unstructured":"Zimmerman, J. E., Kramer, A. A., McNair, D. S. & Malila, F. M. Acute physiology and chronic health evaluation (APACHE) IV: hospital mortality assessment for today\u2019s critically ill patients. Crit. Care Med. 34, 1297\u20131310 (2006).","journal-title":"Crit. Care Med."},{"key":"625_CR27","doi-asserted-by":"publisher","first-page":"2957","DOI":"10.1001\/jama.1993.03510240069035","volume":"270","author":"JR Le Gall","year":"1993","unstructured":"Le Gall, J. R., Lemeshow, S. & Saulnier, F. A new simplified acute physiology score (SAPS II) based on a European\/North American multicenter study. JAMA 270, 2957\u20132963 (1993).","journal-title":"JAMA"},{"key":"625_CR28","doi-asserted-by":"publisher","first-page":"975","DOI":"10.1097\/00003246-198411000-00012","volume":"12","author":"JR Le Gall","year":"1984","unstructured":"Le Gall, J. R. et al. A simplified acute physiology score for ICU patients. Crit. Care Med. 12, 975\u2013977 (1984).","journal-title":"Crit. Care Med."},{"key":"625_CR29","doi-asserted-by":"publisher","first-page":"1345","DOI":"10.1007\/s00134-005-2763-5","volume":"31","author":"RP Moreno","year":"2005","unstructured":"Moreno, R. P. et al. SAPS 3-From evaluation of the patient to evaluation of the intensive care unit. Part 2: development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med. 31, 1345\u20131355 (2005).","journal-title":"Intensive Care Med."},{"key":"625_CR30","doi-asserted-by":"publisher","first-page":"707","DOI":"10.1007\/BF01709751","volume":"22","author":"JL Vincent","year":"1996","unstructured":"Vincent, J. L. et al. The SOFA (sepsis-related organ failure assessment) score to describe organ dysfunction\/failure. On behalf of the working group on sepsis-related problems of the European society of intensive care medicine. Intensive Care Med. 22, 707\u2013710 (1996).","journal-title":"Intensive Care Med."},{"key":"625_CR31","doi-asserted-by":"publisher","first-page":"1920","DOI":"10.1161\/CIRCULATIONAHA.115.001593","volume":"132","author":"RC Deo","year":"2015","unstructured":"Deo, R. C. Machine learning in medicine. Circulation 132, 1920\u20131930 (2015).","journal-title":"Circulation"},{"key":"625_CR32","doi-asserted-by":"publisher","first-page":"1156","DOI":"10.1136\/heartjnl-2017-311198","volume":"104","author":"K Shameer","year":"2018","unstructured":"Shameer, K., Johnson, K. W., Glicksberg, B. S., Dudley, J. T. & Sengupta, P. P. Machine learning in cardiovascular medicine: are we there yet? Heart 104, 1156\u20131164 (2018).","journal-title":"Heart"},{"key":"625_CR33","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1016\/j.resuscitation.2018.09.021","volume":"133","author":"OC Redfern","year":"2018","unstructured":"Redfern, O. C. et al. Predicting in-hospital mortality and unanticipated admissions to the intensive care unit using routinely collected blood tests and vital signs: development and validation of a multivariable model. Resuscitation 133, 75\u201381 (2018).","journal-title":"Resuscitation"},{"key":"625_CR34","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1038\/s41746-018-0029-1","volume":"1","author":"A Rajkomar","year":"2018","unstructured":"Rajkomar, A. et al. Scalable and accurate deep learning with electronic health records. NPJ Digit. Med. 1, 18 (2018).","journal-title":"NPJ Digit. Med."},{"key":"625_CR35","doi-asserted-by":"crossref","unstructured":"Chen, T. Q. & Guestrin, C. XGBoost: a scalable tree boosting system. In Kdd'16: Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining. 785\u2013794 (ACM, 2016).","DOI":"10.1145\/2939672.2939785"},{"key":"625_CR36","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436\u2013444 (2015).","journal-title":"Nature"},{"key":"625_CR37","first-page":"1805","volume":"38","author":"BA Goldstein","year":"2017","unstructured":"Goldstein, B. A., Navar, A. M. & Carter, R. E. Moving beyond regression techniques in cardiovascular risk prediction: applying machine learning to address analytic challenges. Eur. Heart J. 38, 1805\u20131814 (2017).","journal-title":"Eur. Heart J."},{"key":"625_CR38","doi-asserted-by":"crossref","unstructured":"Johnson, J. M. & Khoshgoftaar,T. M. Survey on deep learning with class imbalance. J. Big Data 27 (2019).","DOI":"10.1186\/s40537-019-0192-5"},{"key":"625_CR39","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1097\/ALN.0000000000002960","volume":"132","author":"DA Hashimoto","year":"2020","unstructured":"Hashimoto, D. A., Witkowski, E., Gao, L., Meireles, O. & Rosman, G. Artificial intelligence in anesthesiology: current techniques, clinical applications, and limitations. Anesthesiology 132, 379\u2013394 (2020).","journal-title":"Anesthesiology"},{"key":"625_CR40","unstructured":"Lundberg, S. M. & Lee, S.-I. A unified approach to interpreting model predictions. in NIPS'17: Proceedings of the 31st International Conference on Neural Information Processing Systems. (eds von Luxburg, U. et al.) 4765-4774 (Curran Associates Inc., 2017)."},{"key":"625_CR41","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/j.maturitas.2015.02.009","volume":"81","author":"S Cabrerizo","year":"2015","unstructured":"Cabrerizo, S. et al. Serum albumin and health in older people: review and meta analysis. Maturitas 81, 17\u201327 (2015).","journal-title":"Maturitas"},{"key":"625_CR42","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1002\/jpen.1451","volume":"43","author":"PB Soeters","year":"2019","unstructured":"Soeters, P. B., Wolfe, R. R. & Shenkin, A. Hypoalbuminemia: pathogenesis and clinical significance. JPEN J. Parenter. Enteral. Nutr. 43, 181\u2013193 (2019).","journal-title":"JPEN J. Parenter. Enteral. Nutr."},{"key":"625_CR43","doi-asserted-by":"publisher","first-page":"1212","DOI":"10.1111\/aas.12601","volume":"59","author":"MJ Scott","year":"2015","unstructured":"Scott, M. J. et al. Enhanced recovery after surgery (ERAS) for gastrointestinal surgery, part 1: pathophysiological considerations. Acta Anaesth. Scand. 59, 1212\u20131231 (2015).","journal-title":"Acta Anaesth. Scand."},{"key":"625_CR44","doi-asserted-by":"publisher","first-page":"382","DOI":"10.1093\/icvts\/ivs224","volume":"15","author":"V Arnekian","year":"2012","unstructured":"Arnekian, V. et al. Use of prothrombin complex concentrate for excessive bleeding after cardiac surgery. Interact. Cardiovasc. Thorac. Surg. 15, 382\u2013389 (2012).","journal-title":"Interact. Cardiovasc. Thorac. Surg."},{"key":"625_CR45","doi-asserted-by":"publisher","first-page":"772","DOI":"10.1055\/s-0029-1145259","volume":"34","author":"H Wada","year":"2008","unstructured":"Wada, H., Usui, M. & Sakuragawa, N. Hemostatic abnormalities and liver diseases. Semin. Thromb. Hemost. 34, 772\u2013778 (2008).","journal-title":"Semin. Thromb. Hemost."},{"key":"625_CR46","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1097\/00004311-200404230-00007","volume":"42","author":"JWV Lee","year":"2004","unstructured":"Lee, J. W. V. Willebrand disease, hemophilia A and B, and other factor deficiencies. Int. Anesthesiol. Clin. 42, 59\u201376 (2004).","journal-title":"Int. Anesthesiol. Clin."},{"key":"625_CR47","doi-asserted-by":"publisher","first-page":"1940","DOI":"10.1016\/j.jtcvs.2020.06.052","volume":"161","author":"H Ishwaran","year":"2021","unstructured":"Ishwaran, H. & O\u2019Brien, R. Commentary: the problem of class imbalance in biomedical data. J. Thorac. Cardiovasc. Surg. 161, 1940\u20131941 (2021).","journal-title":"J. Thorac. Cardiovasc. Surg."},{"key":"625_CR48","doi-asserted-by":"publisher","first-page":"103291","DOI":"10.1016\/j.jbi.2019.103291","volume":"99","author":"L Huang","year":"2019","unstructured":"Huang, L. et al. Patient clustering improves efficiency of federated machine learning to predict mortality and hospital stay time using distributed electronic medical records. J. Biomed. Inf. 99, 103291 (2019).","journal-title":"J. Biomed. Inf."},{"key":"625_CR49","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-69250-1","volume":"10","author":"MJ Sheller","year":"2020","unstructured":"Sheller, M. J. et al. Federated learning in medicine: facilitating multi-institutional collaborations without sharing patient data. Sci. Rep. 10, 12598 (2020).","journal-title":"Sci. Rep."},{"key":"625_CR50","doi-asserted-by":"publisher","first-page":"e323","DOI":"10.2196\/jmir.5870","volume":"18","author":"W Luo","year":"2016","unstructured":"Luo, W. et al. Guidelines for developing and reporting machine learning predictive models in biomedical research: a multidisciplinary view. J. Med. Internet Res. 18, e323 (2016).","journal-title":"J. Med. Internet Res."},{"key":"625_CR51","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa, F. et al. Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825\u20132830 (2011).","journal-title":"J. Mach. Learn. Res."},{"key":"625_CR52","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1111\/j.2517-6161.1958.tb00292.x","volume":"20","author":"DR Cox","year":"1958","unstructured":"Cox, D. R. The regression analysis of binary sequences. J. R. Stat. Soc. Ser. B (Methodol.) 20, 215\u2013242 (1958).","journal-title":"J. R. Stat. Soc. Ser. B (Methodol.)"},{"key":"625_CR53","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"B L","year":"2001","unstructured":"L, B. Random forest. Mach. Learn. 45, 5\u201332 (2001).","journal-title":"Mach. Learn."},{"key":"625_CR54","doi-asserted-by":"publisher","unstructured":"Agarap, A. F. M. Deep learning using rectified linear units (ReLU). Preprint at https:\/\/doi.org\/10.48550\/arXiv.1803.08375 (2019).","DOI":"10.48550\/arXiv.1803.08375"},{"key":"625_CR55","doi-asserted-by":"publisher","unstructured":"Zhang, Z. & Sabuncu, M. R. Generalized cross entropy loss for training deep neural networks with noisy labels. in NIPS'18: Proceedings of the 32nd International Conference on Neural Information Processing Systems. (eds Bengio, S. & Wallach, H. M.) 8792-8802 (Curran Associates Inc., 2018). https:\/\/doi.org\/10.48550\/arXiv.1805.07836.","DOI":"10.48550\/arXiv.1805.07836"},{"key":"625_CR56","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1080\/10485252.2017.1404598","volume":"30","author":"Y Jung","year":"2018","unstructured":"Jung, Y. Multiple predicting K-fold cross-validation for model selection. J. Nonparametr. Stat. 30, 197\u2013215 (2018).","journal-title":"J. Nonparametr. Stat."},{"key":"625_CR57","unstructured":"Shekar, B. H. G. D. Proc. 2019 Second International Conference on Advanced Computational and Communication Paradigms (ICACCP). (IEEE, 2019)."},{"key":"625_CR58","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1613\/jair.953","volume":"16","author":"NV Chawla","year":"2002","unstructured":"Chawla, N. V., Bowyer, K. W., Hall, L. O. & Kegelmeyer, W. P. SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16, 321\u2013357 (2002).","journal-title":"J. Artif. Intell. Res."},{"key":"625_CR59","doi-asserted-by":"publisher","first-page":"837","DOI":"10.2307\/2531595","volume":"44","author":"ER Delong","year":"1988","unstructured":"Delong, E. R., Delong, D. M. & Clarkepearson, D. I. Comparing the areas under 2 or more correlated receiver operating characteristic curves - a nonparametric approach. Biometrics 44, 837\u2013845 (1988).","journal-title":"Biometrics"},{"key":"625_CR60","doi-asserted-by":"publisher","first-page":"1389","DOI":"10.1109\/LSP.2014.2337313","volume":"21","author":"X Sun","year":"2014","unstructured":"Sun, X. & Xu, W. C. Fast implementation of DeLong\u2019s algorithm for comparing the areas under correlated receiver operating characteristic curves. IEEE Signal Proc. Let. 21, 1389\u20131393 (2014).","journal-title":"IEEE Signal Proc. Let."},{"key":"625_CR61","unstructured":"D. S. Moore, G. P. McCabe, W. M. Duckworth, S. L. Sclove. The Practice of Business Statistics: Companion Chapter 18, Bootstrap Methods and Permutation Tests 1st edn (W. H. Freeman, 2002)."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00625-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00625-6","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00625-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,29]],"date-time":"2024-09-29T00:14:12Z","timestamp":1727568852000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00625-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,12]]},"references-count":61,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["625"],"URL":"https:\/\/doi.org\/10.1038\/s41746-022-00625-6","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,12]]},"assertion":[{"value":"7 February 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 June 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 July 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"91"}}