{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T07:42:20Z","timestamp":1770709340115,"version":"3.49.0"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T00:00:00Z","timestamp":1680739200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T00:00:00Z","timestamp":1680739200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"2019 IT Promotion fund","award":["S1015-19-1001"],"award-info":[{"award-number":["S1015-19-1001"]}]},{"name":"AI Ambulance project"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>This study aimed to develop a prediction model for transferring patients to an inappropriate hospital for suspected cardiovascular emergency diseases at the pre-hospital stage, using variables obtained from an integrated nationwide dataset, and to assess the performance of this model.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We integrated three nationwide datasets and developed a two-step prediction model utilizing a machine learning algorithm. Ninety-eight clinical characteristics of patients identified at the pre-hospital stage and 13 hospital components were used as input data for the model. The primary endpoint of the model was the prediction of transfer to an inappropriate hospital.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>A total of 94,256 transferred patients in the public pre-hospital care system matched the National Emergency Department Information System data of patients with a pre-hospital cardiovascular registry created in South Korea between July 2017 and December 2018. Of these, 1,770 (6.26%) patients failed to be transferred to a capable hospital. The area under the receiver operating characteristic curve of the final predictive model was 0.813 (0.800\u20130.825), and the area under the receiver precision-recall curve was 0.286 (0.265\u20130.308).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Our prediction model used machine learning to show favorable performance in transferring patients with suspected cardiovascular disease to a capable hospital. For our results to lead to changes in the pre-hospital care system, a digital platform for sharing real-time information should be developed.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-023-02149-9","type":"journal-article","created":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T12:03:18Z","timestamp":1680782598000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Prediction of inappropriate pre-hospital transfer of patients with suspected cardiovascular emergency diseases using machine learning: a retrospective observational study"],"prefix":"10.1186","volume":"23","author":[{"given":"Ji Hoon","family":"Kim","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bomgyeol","family":"Kim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Min Joung","family":"Kim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Heejung","family":"Hyun","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hyeon Chang","family":"Kim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hyuk-Jae","family":"Chang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,4,6]]},"reference":[{"key":"2149_CR1","unstructured":"Anjum S. Systematic approach to acute cardiovascular emergencies. 2018. https:\/\/www.intechopen.com\/chapters\/60421. Accessed 04 Jan 2023."},{"issue":"9859","key":"2149_CR2","doi-asserted-by":"publisher","first-page":"2197","DOI":"10.1016\/S0140-6736(12)61689-4","volume":"380","author":"CJ Murray","year":"2012","unstructured":"Murray CJ, Vos T, Lozano R, Naghavi M, Flaxman AD, Michaud C, Ezzati M, Shibuya K, Salomon JA, Abdalla S, et al. Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990\u20132010: a systematic analysis for the global burden of Disease Study 2010. Lancet. 2012;380(9859):2197\u2013223.","journal-title":"Lancet"},{"issue":"22","key":"2149_CR3","doi-asserted-by":"publisher","first-page":"2308","DOI":"10.1056\/NEJMsa063117","volume":"355","author":"EH Bradley","year":"2006","unstructured":"Bradley EH, Herrin J, Wang Y, Barton BA, Webster TR, Mattera JA, et al. Strategies for reducing the door-to-balloon time in acute myocardial infarction. N Engl J Med. 2006;355(22):2308\u201320.","journal-title":"N Engl J Med"},{"issue":"2","key":"2149_CR4","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/j.jacc.2008.09.030","volume":"53","author":"DB Diercks","year":"2009","unstructured":"Diercks DB, Kontos MC, Chen AY, Pollack CV Jr, Wiviott SD, Rumsfeld JS, et al. Utilization and impact of pre-hospital electrocardiograms for patients with acute ST-segment elevation myocardial infarction: data from the NCDR (National Cardiovascular Data Registry) ACTION (Acute Coronary treatment and intervention outcomes Network) Registry. J Am Coll Cardiol. 2009;53(2):161\u20136.","journal-title":"J Am Coll Cardiol"},{"issue":"20","key":"2149_CR5","doi-asserted-by":"publisher","first-page":"2371","DOI":"10.1001\/jama.298.20.joc70124","volume":"298","author":"JG Jollis","year":"2007","unstructured":"Jollis JG, Roettig ML, Aluko AO, Anstrom KJ, Applegate RJ, Babb JD, et al. Implementation of a statewide system for coronary reperfusion for ST-segment elevation myocardial infarction. JAMA. 2007;298(20):2371\u201380.","journal-title":"JAMA"},{"issue":"5","key":"2149_CR6","doi-asserted-by":"publisher","first-page":"520","DOI":"10.1016\/j.annemergmed.2007.03.013","volume":"50","author":"PL Kraft","year":"2007","unstructured":"Kraft PL, Newman S, Hanson D, Anderson W, Bastani A. Emergency physician discretion to activate the cardiac catheterization team decreases door-to-balloon time for acute ST-elevation myocardial infarction. Ann Emerg Med. 2007;50(5):520\u20136.","journal-title":"Ann Emerg Med"},{"issue":"5","key":"2149_CR7","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1016\/j.annemergmed.2007.03.018","volume":"50","author":"MC Kurz","year":"2007","unstructured":"Kurz MC, Babcock C, Sinha S, Tupesis JP, Allegretti J. The impact of emergency physician-initiated primary percutaneous coronary intervention on mean door-to-balloon time in patients with ST-segment-elevation myocardial infarction. Ann Emerg Med. 2007;50(5):527\u201334.","journal-title":"Ann Emerg Med"},{"issue":"8","key":"2149_CR8","doi-asserted-by":"publisher","first-page":"864","DOI":"10.3346\/jkms.2012.27.8.864","volume":"27","author":"YH Park","year":"2012","unstructured":"Park YH, Kang GH, Song BG, Chun WJ, Lee JH, Hwang SY, et al. Factors related to prehospital time delay in acute ST-segment elevation myocardial infarction. J Korean Med Sci. 2012;27(8):864\u20139.","journal-title":"J Korean Med Sci"},{"issue":"7","key":"2149_CR9","doi-asserted-by":"publisher","first-page":"1182","DOI":"10.1016\/j.ajem.2017.12.003","volume":"36","author":"A Frisch","year":"2018","unstructured":"Frisch A, Heidle KJ, Frisch SO, Ata A, Kramer B, Colleran C, et al. Factors associated with advanced cardiac care in prehospital chest pain patients. Am J Emerg Med. 2018;36(7):1182\u20137.","journal-title":"Am J Emerg Med"},{"issue":"1","key":"2149_CR10","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1017\/S1049023X17007154","volume":"33","author":"JP Stopyra","year":"2018","unstructured":"Stopyra JP, Harper WS, Higgins TJ, Prokesova JV, Winslow JE, Nelson RD, et al. Prehospital modified HEART score predictive of 30-Day adverse cardiac events. Prehosp Disaster Med. 2018;33(1):58\u201362.","journal-title":"Prehosp Disaster Med"},{"key":"2149_CR11","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1016\/j.ijcard.2016.06.066","volume":"219","author":"K Wibring","year":"2016","unstructured":"Wibring K, Herlitz J, Christensson L, Lingman M, B\u00e5ng A. Prehospital factors associated with an acute life-threatening condition in non-traumatic chest pain patients - a systematic review. Int J Cardiol. 2016;219:373\u20139.","journal-title":"Int J Cardiol"},{"key":"2149_CR12","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1016\/j.ijcard.2017.06.032","volume":"248","author":"N Rawshani","year":"2017","unstructured":"Rawshani N, Rawshani A, Gelang C, Herlitz J, B\u00e5ng A, Andersson JO, et al. Association between use of pre-hospital ECG and 30-day mortality: a large cohort study of patients experiencing chest pain. Int J Cardiol. 2017;248:77\u201381.","journal-title":"Int J Cardiol"},{"issue":"25","key":"2149_CR13","doi-asserted-by":"publisher","first-page":"2074","DOI":"10.1161\/CIRCULATIONAHA.116.022954","volume":"134","author":"N Karam","year":"2016","unstructured":"Karam N, Bataille S, Marijon E, Giovannetti O, Tafflet M, Savary D, et al. Identifying patients at risk for prehospital sudden cardiac arrest at the early phase of myocardial infarction: the e-MUST study (evaluation en M\u00e9decine d\u2019Urgence des Strat\u00e9gies Th\u00e9rapeutiques des infarctus du myocarde). Circulation. 2016;134(25):2074\u201383.","journal-title":"Circulation"},{"issue":"4","key":"2149_CR14","doi-asserted-by":"publisher","first-page":"e285","DOI":"10.1097\/CCM.0000000000004236","volume":"48","author":"KJ Cho","year":"2020","unstructured":"Cho KJ, Kwon O, Kwon JM, Lee Y, Park H, Jeon KH, et al. Detecting patient deterioration using artificial intelligence in a rapid response system. Crit Care Med. 2020;48(4):e285\u2013e9.","journal-title":"Crit Care Med"},{"key":"2149_CR15","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1016\/j.resuscitation.2019.04.007","volume":"139","author":"JM Kwon","year":"2019","unstructured":"Kwon JM, Jeon KH, Kim HM, Kim MJ, Lim S, Kim KH, et al. Deep-learning-based out-of-hospital cardiac arrest prognostic system to predict clinical outcomes. Resuscitation. 2019;139:84\u201391.","journal-title":"Resuscitation"},{"key":"2149_CR16","doi-asserted-by":"crossref","unstructured":"Kwon JM, Lee Y, Lee Y, Lee S, Park J. An algorithm based on deep learning for predicting in-hospital cardiac arrest. J Am Heart Assoc. 2018;7(13).","DOI":"10.1161\/JAHA.118.008678"},{"issue":"1","key":"2149_CR17","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1016\/j.annemergmed.2016.07.028","volume":"69","author":"YS Ro","year":"2017","unstructured":"Ro YS, Shin SD, Lee YJ, Lee SC, Song KJ, Ryoo HW, et al. Effect of dispatcher-assisted cardiopulmonary resuscitation program and location of out-of-hospital cardiac arrest on survival and neurologic outcome. Ann Emerg Med. 2017;69(1):52\u201361.","journal-title":"Ann Emerg Med"},{"issue":"3","key":"2149_CR18","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1016\/j.ajem.2018.05.060","volume":"37","author":"EN Kim","year":"2019","unstructured":"Kim EN, Kim MJ, You JS, Shin HJ, Park IC, Chung SP, et al. Effects of an emergency transfer coordination center on secondary overtriage in an emergency department. Am J Emerg Med. 2019;37(3):395\u2013400.","journal-title":"Am J Emerg Med"},{"issue":"1","key":"2149_CR19","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1186\/s12911-021-01679-4","volume":"21","author":"JH Kim","year":"2021","unstructured":"Kim JH, Han SG, Cho A, Shin HJ, Baek SE. Effect of deep learning-based assistive technology use on chest radiograph interpretation by emergency department physicians: a prospective interventional simulation-based study. BMC Med Inform Decis Mak. 2021;21(1):311.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"2149_CR20","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1038\/s42256-019-0138-9","volume":"2","author":"SM Lundberg","year":"2020","unstructured":"Lundberg SM, Erion G, Chen H, DeGrave A, Prutkin JM, Nair B, et al. From local explanations to global understanding with explainable AI for trees. Nat Mach Intell. 2020;2(1):56\u201367.","journal-title":"Nat Mach Intell"},{"issue":"1","key":"2149_CR21","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1186\/s13049-019-0616-4","volume":"27","author":"M \u017burowska-Wolak","year":"2019","unstructured":"\u017burowska-Wolak M, Piekos P, J\u0105ka\u0142a J, Mikos M. The effects of prehospital system delays on the treatment efficacy of STEMI patients. Scand J Trauma Resusc Emerg Med. 2019;27(1):39.","journal-title":"Scand J Trauma Resusc Emerg Med"},{"issue":"16","key":"2149_CR22","doi-asserted-by":"publisher","first-page":"1362","DOI":"10.1136\/heartjnl-2017-312517","volume":"104","author":"CY Foo","year":"2018","unstructured":"Foo CY, Bonsu KO, Nallamothu BK, Reid CM, Dhippayom T, Reidpath DD, et al. Coronary intervention door-to-balloon time and outcomes in ST-elevation myocardial infarction: a meta-analysis. Heart. 2018;104(16):1362\u20139.","journal-title":"Heart"},{"key":"2149_CR23","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1054\/jelc.2000.20299","volume":"33","author":"M Grzybowski","year":"2000","unstructured":"Grzybowski M, Zalenski RJ, Ross MA, Bock B. A prediction model for prehospital triage of patients with suspected cardiac ischemia. J Electrocardiol. 2000;33:253\u20138.","journal-title":"J Electrocardiol"},{"issue":"3","key":"2149_CR24","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1016\/j.jemermed.2017.08.013","volume":"54","author":"JH Kim","year":"2018","unstructured":"Kim JH, Kim MJ, You JS, Song MK, Cho SI. Do emergency physicians improve the appropriateness of emergency transfer in rural areas? J Emerg Med. 2018;54(3):287\u201394.","journal-title":"J Emerg Med"},{"issue":"3","key":"2149_CR25","doi-asserted-by":"publisher","first-page":"450","DOI":"10.1093\/neuros\/nyw124","volume":"81","author":"CM Holland","year":"2017","unstructured":"Holland CM, Lovasik BP, Howard BM, McClure EW, Samuels OB, Barrow DL. Interhospital transfer of neurosurgical patients: implications of timing on hospital course and clinical outcomes. Neurosurgery. 2017;81(3):450\u20137.","journal-title":"Neurosurgery"},{"issue":"6","key":"2149_CR26","doi-asserted-by":"publisher","first-page":"e0198272","DOI":"10.1371\/journal.pone.0198272","volume":"13","author":"D Javat","year":"2018","unstructured":"Javat D, Heal C, Banks J, Buchholz S, Zhang Z. Regional to tertiary inter-hospital transfer versus in-house percutaneous coronary intervention in acute coronary syndrome. PLoS ONE. 2018;13(6):e0198272.","journal-title":"PLoS ONE"},{"issue":"8","key":"2149_CR27","doi-asserted-by":"publisher","first-page":"763","DOI":"10.1001\/jamasurg.2013.2132","volume":"148","author":"MJ Sorensen","year":"2013","unstructured":"Sorensen MJ, von Recklinghausen FM, Fulton G, Burchard KW. Secondary overtriage: the burden of unnecessary interfacility transfers in a rural trauma system. JAMA Surg. 2013;148(8):763\u20138.","journal-title":"JAMA Surg"},{"issue":"12","key":"2149_CR28","doi-asserted-by":"publisher","first-page":"2877","DOI":"10.1016\/j.spinee.2014.01.065","volume":"14","author":"JE Bible","year":"2014","unstructured":"Bible JE, Kadakia RJ, Kay HF, Zhang CE, Casimir GE, Devin CJ. How often are interfacility transfers of spine injury patients truly necessary? Spine J. 2014;14(12):2877\u201384.","journal-title":"Spine J"},{"issue":"12","key":"2149_CR29","doi-asserted-by":"publisher","first-page":"1136","DOI":"10.3349\/ymj.2021.62.12.1136","volume":"62","author":"SJ Lee","year":"2021","unstructured":"Lee SJ, Choi A, Ryoo HW, Pak YS, Kim HC, Kim JH. Changes in clinical characteristics among febrile patients visiting the emergency department before and after the COVID-19 outbreak. Yonsei Med J. 2021;62(12):1136\u201344.","journal-title":"Yonsei Med J"},{"issue":"1","key":"2149_CR30","doi-asserted-by":"publisher","first-page":"3966","DOI":"10.1038\/s41467-020-17804-2","volume":"11","author":"S Al-Zaiti","year":"2020","unstructured":"Al-Zaiti S, Besomi L, Bouzid Z, Faramand Z, Frisch S, Martin-Gill C, et al. Machine learning-based prediction of acute coronary syndrome using only the pre-hospital 12-lead electrocardiogram. Nat Commun. 2020;11(1):3966.","journal-title":"Nat Commun"},{"issue":"1","key":"2149_CR31","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1016\/j.hlpt.2020.01.002","volume":"9","author":"H Kim","year":"2020","unstructured":"Kim H, Kim S-W, Park E, Kim JH, Chang H. The role of fifth-generation mobile technology in prehospital emergency care: an opportunity to support paramedics. Health Policy and Technology. 2020;9(1):109\u201314.","journal-title":"Health Policy and Technology"},{"issue":"2","key":"2149_CR32","doi-asserted-by":"publisher","first-page":"e33960","DOI":"10.2196\/33960","volume":"9","author":"JM Schwartz","year":"2022","unstructured":"Schwartz JM, George M, Rossetti SC, Dykes PC, Minshall SR, Lucas E, et al. Factors influencing clinician trust in predictive clinical decision support systems for in-hospital deterioration: qualitative descriptive study. JMIR Hum Factors. 2022;9(2):e33960.","journal-title":"JMIR Hum Factors"},{"issue":"2","key":"2149_CR33","doi-asserted-by":"publisher","first-page":"e25187","DOI":"10.2196\/25187","volume":"23","author":"S Muralitharan","year":"2021","unstructured":"Muralitharan S, Nelson W, Di S, McGillion M, Devereaux PJ, Barr NG, et al. Machine learning-based early warning systems for clinical deterioration: systematic scoping review. J Med Internet Res. 2021;23(2):e25187.","journal-title":"J Med Internet Res"},{"key":"2149_CR34","unstructured":"Prokhorenkova L, Gusev G, Vorobev A, Dorogush AV, Gulin A. CatBoost: unbiased boosting with categorical features. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems. Montr\u00e9al, Canada: Curran Associates Inc.; 2018. p.\u00a06639\u201349."},{"issue":"C","key":"2149_CR35","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1016\/j.inffus.2021.11.011","volume":"81","author":"R Shwartz-Ziv","year":"2022","unstructured":"Shwartz-Ziv R, Armon A. Tabular data: deep learning is not all you need. Inf Fusion. 2022;81(C):84\u201390.","journal-title":"Inf Fusion"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02149-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-023-02149-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02149-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T12:09:07Z","timestamp":1680782947000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-023-02149-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,6]]},"references-count":35,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["2149"],"URL":"https:\/\/doi.org\/10.1186\/s12911-023-02149-9","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,6]]},"assertion":[{"value":"17 August 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 April 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The study protocol was approved, and informed consent was waived by the Institutional Review Board of Severance Hospital, South Korea (approval number 4-2020-0110). The present study adhered to the ethical standards of the Declaration of Helsinki.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests. AITRICS is the institution of one of the co-authors and had no rule in the design of the study; in the collection, analysis, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"56"}}