{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"Research Square"}],"indexed":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T06:40:12Z","timestamp":1747204812877,"version":"3.40.5"},"posted":{"date-parts":[[2023,10,31]]},"group-title":"In Review","reference-count":60,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2023,10,31]],"date-time":"2023-10-31T00:00:00Z","timestamp":1698710400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2023,9,18]]},"abstract":"<title>Abstract<\/title>\n        <p>Determining the etiology of an acute ischemic stroke (AIS) is fundamental to secondary stroke prevention efforts but can be diagnostically challenging. We trained and validated an automated classification machine intelligence tool, <italic>StrokeClassifier<\/italic>, using electronic health record (EHR) text data from 2,039 non-cryptogenic AIS patients at 2 academic hospitals to predict the 4-level outcome of stroke etiology determined by agreement of at least 2 board-certified vascular neurologists\u2019 review of the stroke hospitalization EHR. <italic>StrokeClassifier<\/italic> is an ensemble consensus meta-model of 9 machine learning classifiers applied to features extracted from discharge summary texts by natural language processing. <italic>StrokeClassifier<\/italic> was externally validated in 406 discharge summaries from the MIMIC-III dataset reviewed by a vascular neurologist to ascertain stroke etiology. Compared with stroke etiologies adjudicated by vascular neurologists, nine base classifiers performed well with a mean cross-validated area under the receiver operating curve (AUCROC) of 0.90. Their ensemble meta-model, <italic>StrokeClassifier<\/italic>, achieved a mean cross-validated accuracy of 0.74 and weighted F1 of 0.74. In the MIMIC-III cohort, the accuracy and weighted F1 of <italic>StrokeClassifier<\/italic> were 0.70, and 0.71, respectively. SHapley Additive exPlanation analysis revealed that the top 5 features contributing to stroke etiology prediction were atrial fibrillation, age, middle cerebral artery occlusion, internal carotid artery occlusion, and frontal stroke location. We then designed a certainty heuristic to deem a <italic>StrokeClassifier<\/italic> diagnosis as confidently non-cryptogenic by the degree of consensus among the 9 classifiers, and applied it to 788 cryptogenic patients. This reduced the percentage of the cryptogenic strokes from 25.2\u20137.2% of all ischemic strokes.  <italic>StrokeClassifier<\/italic> is a validated artificial intelligence tool that rivals the performance of vascular neurologists in classifying ischemic stroke etiology for individual patients. With further training, <italic>StrokeClassifier<\/italic> may have downstream applications including its use as a clinical decision support system.<\/p>","DOI":"10.21203\/rs.3.rs-3367169\/v1","type":"posted-content","created":{"date-parts":[[2023,10,31]],"date-time":"2023-10-31T16:25:53Z","timestamp":1698769553000},"source":"Crossref","is-referenced-by-count":3,"title":["StrokeClassifier: Ischemic Stroke Etiology Classification by Ensemble Consensus Modeling Using Electronic Health Records"],"prefix":"10.21203","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3616-5387","authenticated-orcid":false,"given":"Ho-Joon","family":"Lee","sequence":"first","affiliation":[{"name":"Department of Genetics and Yale Center for Genome Analysis, Yale School of Medicine, New Haven, CT"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0592-9145","authenticated-orcid":false,"given":"Lee H.","family":"Schwamm","sequence":"additional","affiliation":[{"name":"Department of Neurology and Comprehensive Stroke Center, Massachusetts General Hospital and Harvard Medical School Boston, MA; Department of Neurology, Yale School of Medicine, New Haven, CT"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lauren","family":"Sansing","sequence":"additional","affiliation":[{"name":"Department of Neurology, Yale School of Medicine, New Haven, CT"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hooman","family":"Kamel","sequence":"additional","affiliation":[{"name":"Department of Neurology, Weill Cornell Medicine, New York City, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adam","family":"de Havenon","sequence":"additional","affiliation":[{"name":"Department of Neurology, Yale School of Medicine, New Haven, CT"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ashby C.","family":"Turner","sequence":"additional","affiliation":[{"name":"Department of Neurology and Comprehensive Stroke Center, Massachusetts General Hospital and Harvard Medical School Boston, MA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2003-5473","authenticated-orcid":false,"given":"Kevin N.","family":"Sheth","sequence":"additional","affiliation":[{"name":"Department of Neurology, Yale School of Medicine, New Haven, CT"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5823-1985","authenticated-orcid":false,"given":"Smita","family":"Krishnaswamy","sequence":"additional","affiliation":[{"name":"Departments of Genetics and Computer Science, Yale School of Medicine, New Haven, CT"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cynthia","family":"Brandt","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics and Data Science, Yale School of Medicine, New Haven, CT"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1195-9607","authenticated-orcid":false,"given":"Hongyu","family":"Zhao","sequence":"additional","affiliation":[{"name":"Departments of Biostatistics, Yale School of Public Health, New Haven, CT"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2046-127X","authenticated-orcid":false,"given":"Harlan","family":"Krumholz","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, Yale School of Medicine, New Haven, CT"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Richa","family":"Sharma","sequence":"additional","affiliation":[{"name":"Department of Neurology, Yale School of Medicine, New Haven, CT"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"e56-e528","DOI":"10.1161\/cir.0000000000000659","article-title":"Heart Disease and Stroke Statistics-2019 Update: A Report From the American Heart Association","volume":"139","author":"Benjamin EJ","year":"2019","unstructured":"Benjamin, E. J. et al. Heart Disease and Stroke Statistics-2019 Update: A Report From the American Heart Association. Circulation 139, e56-e528, doi:10.1161\/cir.0000000000000659 (2019).","journal-title":"Circulation"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"e29-322","DOI":"10.1161\/cir.0000000000000152","article-title":"Heart disease and stroke statistics\u20132015 update: a report from the American Heart Association","volume":"131","author":"Mozaffarian D","year":"2015","unstructured":"Mozaffarian, D. et al. Heart disease and stroke statistics\u20132015 update: a report from the American Heart Association. Circulation 131, e29-322, doi:10.1161\/cir.0000000000000152 (2015).","journal-title":"Circulation"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1161\/01.str.24.1.35","article-title":"Classification of subtype of acute ischemic stroke. Definitions for use in a multicenter clinical trial. TOAST. Trial of Org 10172 in Acute Stroke Treatment","volume":"24","author":"Adams HP","year":"1993","unstructured":"Adams, H. P., Jr. et al. Classification of subtype of acute ischemic stroke. Definitions for use in a multicenter clinical trial. TOAST. Trial of Org 10172 in Acute Stroke Treatment. Stroke 24, 35\u201341, doi:10.1161\/01.str.24.1.35 (1993).","journal-title":"Stroke"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1159\/000047697","article-title":"Yonsei Stroke Registry. Analysis of 1,000 patients with acute cerebral infarctions","volume":"12","author":"Lee BI","year":"2001","unstructured":"Lee, B. I., Nam, H. S., Heo, J. H. & Kim, D. I. Yonsei Stroke Registry. Analysis of 1,000 patients with acute cerebral infarctions. Cerebrovasc Dis 12, 145\u2013151, doi:10.1159\/000047697 (2001).","journal-title":"Cerebrovasc Dis"},{"key":"ref5","doi-asserted-by":"publisher","first-page":"903","DOI":"10.1016\/s1474-4422(15)00132-5","article-title":"Incidence, outcome, risk factors, and long-term prognosis of cryptogenic transient ischaemic attack and ischaemic stroke: a population-based study","volume":"14","author":"Li L","year":"2015","unstructured":"Li, L. et al. Incidence, outcome, risk factors, and long-term prognosis of cryptogenic transient ischaemic attack and ischaemic stroke: a population-based study. Lancet Neurol 14, 903\u2013913, doi:10.1016\/s1474-4422(15)00132-5 (2015).","journal-title":"Lancet Neurol"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"814","DOI":"10.1161\/strokeaha.117.020031","article-title":"Distribution and Temporal Trends From 1993 to 2015 of Ischemic Stroke Subtypes: A Systematic Review and Meta-Analysis","volume":"49","author":"Ornello R","year":"2018","unstructured":"Ornello, R. et al. Distribution and Temporal Trends From 1993 to 2015 of Ischemic Stroke Subtypes: A Systematic Review and Meta-Analysis. Stroke 49, 814\u2013819, doi:10.1161\/strokeaha.117.020031 (2018).","journal-title":"Stroke"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"382","DOI":"10.1002\/ana.410250410","article-title":"Infarcts of undetermined cause: The NINCDS stroke data bank","volume":"25","author":"Sacco RL","year":"1989","unstructured":"Sacco, R. L. et al. Infarcts of undetermined cause: The NINCDS stroke data bank. Annals of Neurology 25, 382\u2013390, doi:https:\/\/doi.org\/10.1002\/ana.410250410 (1989).","journal-title":"Annals of Neurology"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"2735","DOI":"10.1161\/hs1201.100209","article-title":"Epidemiology of Ischemic Stroke Subtypes According to TOAST Criteria","volume":"32","author":"Kolominsky-Rabas PL","year":"2001","unstructured":"Kolominsky-Rabas, P. L., Weber, M., Gefeller, O., Neundoerfer, B. & Heuschmann, P. U. Epidemiology of Ischemic Stroke Subtypes According to TOAST Criteria. Stroke 32, 2735\u20132740, doi:doi:10.1161\/hs1201.100209 (2001).","journal-title":"Stroke"},{"key":"ref9","doi-asserted-by":"publisher","first-page":"867","DOI":"10.1161\/strokeaha.116.016414","article-title":"Embolic Stroke of Undetermined Source: A Systematic Review and Clinical Update","volume":"48","author":"Hart RG","year":"2017","unstructured":"Hart, R. G., Catanese, L., Perera, K. S., Ntaios, G. & Connolly, S. J. Embolic Stroke of Undetermined Source: A Systematic Review and Clinical Update. Stroke 48, 867\u2013872, doi:10.1161\/strokeaha.116.016414 (2017).","journal-title":"Stroke"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1161\/STROKEAHA.122.040524","article-title":"Risk Factors and Causes of Ischemic Stroke in 1322 Young Adults","volume":"54","author":"Ekker MS","year":"2023","unstructured":"Ekker, M. S. et al. Risk Factors and Causes of Ischemic Stroke in 1322 Young Adults. Stroke 54, 439\u2013447, doi:doi:10.1161\/STROKEAHA.122.040524 (2023).","journal-title":"Stroke"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1016\/s1474-4422(13)70310-7","article-title":"Embolic strokes of undetermined source: the case for a new clinical construct","volume":"13","author":"Hart RG","year":"2014","unstructured":"Hart, R. G. et al. Embolic strokes of undetermined source: the case for a new clinical construct. Lancet Neurol 13, 429\u2013438, doi:10.1016\/s1474-4422(13)70310-7 (2014).","journal-title":"Lancet Neurol"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"569","DOI":"10.1212\/01.wnl.0000110311.09970.83","article-title":"Early risk of recurrence by subtype of ischemic stroke in population-based incidence studies","volume":"62","author":"Lovett JK","year":"2004","unstructured":"Lovett, J. K., Coull, A. J. & Rothwell, P. M. Early risk of recurrence by subtype of ischemic stroke in population-based incidence studies. Neurology 62, 569\u2013573, doi:10.1212\/01.wnl.0000110311.09970.83 (2004).","journal-title":"Neurology"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"983","DOI":"10.1161\/01.str.20.8.983","article-title":"Determinants of early recurrence of cerebral infarction","volume":"20","author":"Sacco RL","year":"1989","unstructured":"Sacco, R. L. et al. Determinants of early recurrence of cerebral infarction. The Stroke Data Bank. Stroke 20, 983\u2013989, doi:10.1161\/01.str.20.8.983 (1989).","journal-title":"The Stroke Data Bank. Stroke"},{"key":"ref14","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1186\/s12883-023-03155-0","article-title":"Underlying causes of cryptogenic stroke and TIA in The Nordic Atrial Fibrillation and Stroke (NOR-FIB) Study \u2013 the importance of comprehensive clinical evaluation","volume":"23","author":"Ratajczak-Tretel B","year":"2023","unstructured":"Ratajczak-Tretel, B. et al. Underlying causes of cryptogenic stroke and TIA in The Nordic Atrial Fibrillation and Stroke (NOR-FIB) Study \u2013 the importance of comprehensive clinical evaluation. BMC Neurology 23, 115, doi:10.1186\/s12883-023-03155-0 (2023).","journal-title":"BMC Neurology"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1161\/strokeaha.115.009334","author":"Ntaios G","year":"2015","unstructured":"Ntaios, G. et al. Embolic Strokes of Undetermined Source in the Athens Stroke Registry: An Outcome Analysis. Stroke 46, 2087\u20132093, doi:10.1161\/strokeaha.115.009334 (2015)."},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1161\/STR.0000000000000375","author":"Kleindorfer DO","year":"2021","unstructured":"Kleindorfer, D. O. et al. 2021 Guideline for the Prevention of Stroke in Patients With Stroke and Transient Ischemic Attack: A Guideline From the American Heart Association\/American Stroke Association. Stroke 52, e364-e467, doi:doi:10.1161\/STR.0000000000000375 (2021)."},{"key":"ref17","doi-asserted-by":"publisher","first-page":"e2653-e2660","DOI":"10.1212\/wnl.0000000000007570","article-title":"Lower carotid revascularization rates after stroke in racial\/ethnic minority-serving US hospitals","volume":"92","author":"Faigle R","year":"2019","unstructured":"Faigle, R., Cooper, L. A. & Gottesman, R. F. Lower carotid revascularization rates after stroke in racial\/ethnic minority-serving US hospitals. Neurology 92, e2653-e2660, doi:10.1212\/wnl.0000000000007570 (2019).","journal-title":"Neurology"},{"key":"ref18","doi-asserted-by":"publisher","first-page":"106980","DOI":"10.1016\/j.jstrokecerebrovasdis.2023.106980","article-title":"Anticoagulation under-utilization in atrial fibrillation patients is responsible for a large proportion of strokes requiring endovascular therapy","volume":"32","author":"Shakibajahromi B","year":"2023","unstructured":"Shakibajahromi, B., Kasner, S. E., Schmitt, C. & Favilla, C. G. Anticoagulation under-utilization in atrial fibrillation patients is responsible for a large proportion of strokes requiring endovascular therapy. Journal of Stroke and Cerebrovascular Diseases 32, 106980, doi:https:\/\/doi.org\/10.1016\/j.jstrokecerebrovasdis.2023.106980 (2023).","journal-title":"Journal of Stroke and Cerebrovascular Diseases"},{"key":"ref19","first-page":"1703","article-title":"Underuse of statins in patients with atherosclerotic ischemic stroke in China","volume":"125","author":"Li X","year":"2012","unstructured":"Li, X. et al. Underuse of statins in patients with atherosclerotic ischemic stroke in China. Chin Med J (Engl) 125, 1703\u20131707 (2012).","journal-title":"Chin Med J (Engl)"},{"key":"ref20","doi-asserted-by":"publisher","first-page":"e2224157-e2224157","DOI":"10.1001\/jamanetworkopen.2022.24157","article-title":"Analysis of Prescriptions for Dual Antiplatelet Therapy After Acute Ischemic Stroke","volume":"5","author":"Xian Y","year":"2022","unstructured":"Xian, Y. et al. Analysis of Prescriptions for Dual Antiplatelet Therapy After Acute Ischemic Stroke. JAMA Network Open 5, e2224157-e2224157, doi:10.1001\/jamanetworkopen.2022.24157 (2022).","journal-title":"JAMA Network Open"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"2435","DOI":"10.1161\/STROKEAHA.120.028992","article-title":"Risk and Secondary Prevention of Stroke Recurrence","volume":"51","author":"Flach C","year":"2020","unstructured":"Flach, C., Muruet, W., Wolfe, C. D. A., Bhalla, A. & Douiri, A. Risk and Secondary Prevention of Stroke Recurrence. Stroke 51, 2435\u20132444, doi:doi:10.1161\/STROKEAHA.120.028992 (2020).","journal-title":"Stroke"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1161\/jaha.116.005097","article-title":"Practice Patterns for Acute Ischemic Stroke Workup: A Longitudinal Population-Based Study","volume":"6","author":"Loftspring MC","year":"2017","unstructured":"Loftspring, M. C. et al. Practice Patterns for Acute Ischemic Stroke Workup: A Longitudinal Population-Based Study. J Am Heart Assoc 6, doi:10.1161\/jaha.116.005097 (2017).","journal-title":"J Am Heart Assoc"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"822","DOI":"10.1161\/STROKEAHA.111.000466","article-title":"The Growing Shortage of Vascular Neurologists in The Era of Health Reform","volume":"44","author":"Leira EC","year":"2013","unstructured":"Leira, E. C., Kaskie, B., Froehler, M. T. & Adams, H. P. The Growing Shortage of Vascular Neurologists in The Era of Health Reform. Stroke 44, 822\u2013827, doi:doi:10.1161\/STROKEAHA.111.000466 (2013).","journal-title":"Stroke"},{"key":"ref24","doi-asserted-by":"publisher","first-page":"3431","DOI":"10.1161\/strokeaha.119.027076","article-title":"Fast Automatic Detection of Large Vessel Occlusions on CT Angiography","volume":"50","author":"Amukotuwa SA","year":"2019","unstructured":"Amukotuwa, S. A., Straka, M., Dehkharghani, S. & Bammer, R. Fast Automatic Detection of Large Vessel Occlusions on CT Angiography. Stroke 50, 3431\u20133438, doi:10.1161\/strokeaha.119.027076 (2019).","journal-title":"Stroke"},{"key":"ref25","doi-asserted-by":"publisher","first-page":"1026609","DOI":"10.3389\/fneur.2022.1026609","article-title":"Head-to-head comparison of commercial artificial intelligence solutions for detection of large vessel occlusion at a comprehensive stroke center","volume":"13","author":"Schlossman J","year":"2022","unstructured":"Schlossman, J. et al. Head-to-head comparison of commercial artificial intelligence solutions for detection of large vessel occlusion at a comprehensive stroke center. Front Neurol 13, 1026609, doi:10.3389\/fneur.2022.1026609 (2022).","journal-title":"Front Neurol"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"408","DOI":"10.1177\/1971400921998952","article-title":"Validation of an artificial intelligence-driven large vessel occlusion detection algorithm for acute ischemic stroke patients","volume":"34","author":"Rava RA","year":"2021","unstructured":"Rava, R. A. et al. Validation of an artificial intelligence-driven large vessel occlusion detection algorithm for acute ischemic stroke patients. Neuroradiol J 34, 408\u2013417, doi:10.1177\/1971400921998952 (2021).","journal-title":"Neuroradiol J"},{"key":"ref27","doi-asserted-by":"publisher","first-page":"2045","DOI":"10.1016\/j.jstrokecerebrovasdis.2019.02.004","article-title":"Automating Ischemic Stroke Subtype Classification Using Machine Learning and Natural Language Processing","volume":"28","author":"Garg R","year":"2019","unstructured":"Garg, R., Oh, E., Naidech, A., Kording, K. & Prabhakaran, S. Automating Ischemic Stroke Subtype Classification Using Machine Learning and Natural Language Processing. J Stroke Cerebrovasc Dis 28, 2045\u20132051, doi:10.1016\/j.jstrokecerebrovasdis.2019.02.004 (2019).","journal-title":"J Stroke Cerebrovasc Dis"},{"key":"ref28","doi-asserted-by":"publisher","first-page":"e203-e210","DOI":"10.1161\/STROKEAHA.120.029305","article-title":"Machine Learning Prediction of Stroke Mechanism in Embolic Strokes of Undetermined Source","volume":"51","author":"Kamel H","year":"2020","unstructured":"Kamel, H. et al. Machine Learning Prediction of Stroke Mechanism in Embolic Strokes of Undetermined Source. Stroke 51, e203-e210, doi:doi:10.1161\/STROKEAHA.120.029305 (2020).","journal-title":"Stroke"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.3389\/fnagi.2022.788637","article-title":"Causative Classification of Ischemic Stroke by the Machine Learning Algorithm Random Forests","volume":"14","author":"Wang J","year":"2022","unstructured":"Wang, J. et al. Causative Classification of Ischemic Stroke by the Machine Learning Algorithm Random Forests. Frontiers in Aging Neuroscience 14, doi:10.3389\/fnagi.2022.788637 (2022).","journal-title":"Frontiers in Aging Neuroscience"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.3389\/fnagi.2022.857521","article-title":"Comparison of Conventional Logistic Regression and Machine Learning Methods for Predicting Delayed Cerebral Ischemia After Aneurysmal Subarachnoid Hemorrhage: A Multicentric Observational Cohort Study","volume":"14","author":"Hu P","year":"2022","unstructured":"Hu, P. et al. Comparison of Conventional Logistic Regression and Machine Learning Methods for Predicting Delayed Cerebral Ischemia After Aneurysmal Subarachnoid Hemorrhage: A Multicentric Observational Cohort Study. Frontiers in Aging Neuroscience 14, doi:10.3389\/fnagi.2022.857521 (2022).","journal-title":"Frontiers in Aging Neuroscience"},{"key":"ref31","doi-asserted-by":"crossref","first-page":"1138","DOI":"10.3390\/biomedicines11041138","article-title":"Artificial Intelligence in Acute Ischemic Stroke Subtypes According to Toast Classification: A Comprehensive Narrative Review","volume":"11","author":"Miceli G","year":"2023","unstructured":"Miceli, G. et al. Artificial Intelligence in Acute Ischemic Stroke Subtypes According to Toast Classification: A Comprehensive Narrative Review. Biomedicines 11, 1138 (2023).","journal-title":"Biomedicines"},{"key":"ref32","doi-asserted-by":"crossref","first-page":"3538","DOI":"10.1212\/WNL.98.18_supplement.3538","article-title":"A Machine Learning Approach to Automate Ischemic Stroke Subtyping (N2.001)","volume":"98","author":"Turner A","year":"2022","unstructured":"Turner, A. et al. A Machine Learning Approach to Automate Ischemic Stroke Subtyping (N2.001). Neurology 98, 3538 (2022).","journal-title":"Neurology"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.1161\/STROKEAHA.123.042496","article-title":"Deep Learning Versus Neurologists: Functional Outcome Prediction in LVO Stroke Patients Undergoing Mechanical Thrombectomy","author":"Herzog L","unstructured":"Herzog, L. et al. Deep Learning Versus Neurologists: Functional Outcome Prediction in LVO Stroke Patients Undergoing Mechanical Thrombectomy. Stroke 0, doi:doi:10.1161\/STROKEAHA.123.042496.","journal-title":"Stroke"},{"key":"ref34","doi-asserted-by":"publisher","first-page":"379","DOI":"10.2217\/fon-2017-0450","article-title":"Comparison of three prognostic models for predicting cancer-specific survival among patients with gastrointestinal stromal tumors","volume":"14","author":"Oweira H","year":"2018","unstructured":"Oweira, H. et al. Comparison of three prognostic models for predicting cancer-specific survival among patients with gastrointestinal stromal tumors. Future Oncol 14, 379\u2013389, doi:10.2217\/fon-2017-0450 (2018).","journal-title":"Future Oncol"},{"key":"ref35","doi-asserted-by":"publisher","first-page":"E215-220","DOI":"10.1161\/01.cir.101.23.e215","article-title":"PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals","volume":"101","author":"Goldberger AL","year":"2000","unstructured":"Goldberger, A. L. et al. PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation 101, E215-220, doi:10.1161\/01.cir.101.23.e215 (2000).","journal-title":"Circulation"},{"key":"ref36","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1161\/circulationaha.108.783688","article-title":"Get With the Guidelines-Stroke is associated with sustained improvement in care for patients hospitalized with acute stroke or transient ischemic attack","volume":"119","author":"Schwamm LH","year":"2009","unstructured":"Schwamm, L. H. et al. Get With the Guidelines-Stroke is associated with sustained improvement in care for patients hospitalized with acute stroke or transient ischemic attack. Circulation 119, 107\u2013115, doi:10.1161\/circulationaha.108.783688 (2009).","journal-title":"Circulation"},{"key":"ref37","doi-asserted-by":"publisher","DOI":"10.1001\/jamacardio.2022.1900","article-title":"Machine Learning\u2013Based Models Incorporating Social Determinants of Health vs Traditional Models for Predicting In-Hospital Mortality in Patients With Heart Failure","author":"Segar MW","year":"2022","unstructured":"Segar, M. W. et al. Machine Learning\u2013Based Models Incorporating Social Determinants of Health vs Traditional Models for Predicting In-Hospital Mortality in Patients With Heart Failure. JAMA Cardiology, doi:10.1001\/jamacardio.2022.1900 (2022).","journal-title":"JAMA Cardiology"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1136\/jamia.2009.002733","article-title":"An overview of MetaMap: historical perspective and recent advances","volume":"17","author":"Aronson AR","year":"2010","unstructured":"Aronson, A. R. & Lang, F. M. An overview of MetaMap: historical perspective and recent advances. Journal of the American Medical Informatics Association: JAMIA 17, 229\u2013236, doi:10.1136\/jamia.2009.002733 (2010).","journal-title":"Journal of the American Medical Informatics Association: JAMIA"},{"key":"ref39","doi-asserted-by":"publisher","first-page":"D267-270","DOI":"10.1093\/nar\/gkh061","article-title":"The Unified Medical Language System (UMLS): integrating biomedical terminology","volume":"32","author":"Bodenreider O","year":"2004","unstructured":"Bodenreider, O. The Unified Medical Language System (UMLS): integrating biomedical terminology. Nucleic acids research 32, D267-270, doi:10.1093\/nar\/gkh061 (2004).","journal-title":"Nucleic acids research"},{"key":"ref40","first-page":"184","article-title":"UMLS knowledge for biomedical language processing","volume":"81","author":"McCray AT","year":"1993","unstructured":"McCray, A. T. et al. UMLS knowledge for biomedical language processing. Bull Med Libr Assoc 81, 184\u2013194 (1993).","journal-title":"Bull Med Libr Assoc"},{"key":"ref41","doi-asserted-by":"publisher","first-page":"2017","DOI":"10.1093\/jamia\/ocab084","article-title":"The use of SNOMED CT, 2013\u20132020: a literature review","volume":"28","author":"Chang E","year":"2021","unstructured":"Chang, E. & Mostafa, J. The use of SNOMED CT, 2013\u20132020: a literature review. Journal of the American Medical Informatics Association: JAMIA 28, 2017\u20132026, doi:10.1093\/jamia\/ocab084 (2021).","journal-title":"Journal of the American Medical Informatics Association: JAMIA"},{"key":"ref42","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.08.025","author":"Shivade C","year":"2015","unstructured":"Shivade, C., Malewadkar, P., Fosler-Lussier, E. & Lai, A. M. Comparison of UMLS terminologies to identify risk of heart disease using clinical notes. J Biomed Inform 58 Suppl, S103-s110, doi:10.1016\/j.jbi.2015.08.025 (2015)."},{"key":"ref43","doi-asserted-by":"publisher","first-page":"3426","DOI":"10.1038\/s41596-019-0227-6","article-title":"High-throughput phenotyping with electronic medical record data using a common semi-supervised approach (PheCAP)","volume":"14","author":"Zhang Y","year":"2019","unstructured":"Zhang, Y. et al. High-throughput phenotyping with electronic medical record data using a common semi-supervised approach (PheCAP). Nature protocols 14, 3426\u20133444, doi:10.1038\/s41596-019-0227-6 (2019).","journal-title":"Nature protocols"},{"author":"Bai L","key":"ref44","unstructured":"Bai, L., Mulvenna, M. D., Wang, Z. & Bond, R. in 2021 32nd Irish Signals and Systems Conference (ISSC). 1\u20136."},{"key":"ref45","doi-asserted-by":"publisher","first-page":"833","DOI":"10.1200\/cci.21.00017","article-title":"Customizable Natural Language Processing Biomarker Extraction Tool","volume":"5","author":"Holmes B","year":"2021","unstructured":"Holmes, B. et al. Customizable Natural Language Processing Biomarker Extraction Tool. JCO Clin Cancer Inform 5, 833\u2013841, doi:10.1200\/cci.21.00017 (2021).","journal-title":"JCO Clin Cancer Inform"},{"key":"ref46","doi-asserted-by":"publisher","DOI":"10.1136\/svn-2021-001170","article-title":"Frequency, predictors and cardiovascular outcomes associated with transthoracic echocardiographic findings during acute ischaemic stroke hospitalisation","author":"Sharma R","year":"2022","unstructured":"Sharma, R., Silverman, S., Patel, S., Schwamm, L. H. & Sanborn, D. Y. Frequency, predictors and cardiovascular outcomes associated with transthoracic echocardiographic findings during acute ischaemic stroke hospitalisation. Stroke Vasc Neurol, doi:10.1136\/svn-2021-001170 (2022).","journal-title":"Stroke Vasc Neurol"},{"key":"ref47","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1002\/mpr.329","article-title":"Multiple imputation by chained equations: what is it and how does it work?","volume":"20","author":"Azur MJ","year":"2011","unstructured":"Azur, M. J., Stuart, E. A., Frangakis, C. & Leaf, P. J. Multiple imputation by chained equations: what is it and how does it work? Int J Methods Psychiatr Res 20, 40\u201349, doi:10.1002\/mpr.329 (2011).","journal-title":"Int J Methods Psychiatr Res"},{"key":"ref48","first-page":"85","article-title":"W. A multivariate technique for multiply imputing missing values using a sequence of regression models","volume":"27","author":"Raghunathan TE","year":"2001","unstructured":"Raghunathan, T. E., Lepkowski, J. M., Hoewyk, J. V. & Solenberger, P. W. A multivariate technique for multiply imputing missing values using a sequence of regression models. Survey Methodology 27, 85\u201395 (2001).","journal-title":"Survey Methodology"},{"key":"ref49","first-page":"169","article-title":"Popular ensemble methods: an empirical study","volume":"11","author":"Opitz D","year":"1999","unstructured":"Opitz, D. & Maclin, R. Popular ensemble methods: an empirical study. J. Artif. Int. Res. 11, 169\u2013198 (1999).","journal-title":"J. Artif. Int. Res."},{"key":"ref50","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1109\/MCAS.2006.1688199","article-title":"Ensemble based systems in decision making","volume":"6","author":"Polikar R","year":"2006","unstructured":"Polikar, R. Ensemble based systems in decision making. IEEE Circuits and Systems Magazine 6, 21\u201345, doi:10.1109\/MCAS.2006.1688199 (2006).","journal-title":"IEEE Circuits and Systems Magazine"},{"key":"ref51","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10462-009-9124-7","article-title":"Ensemble-based classifiers","volume":"33","author":"Rokach L","year":"2010","unstructured":"Rokach, L. Ensemble-based classifiers. Artificial Intelligence Review 33, 1\u201339, doi:10.1007\/s10462-009-9124-7 (2010).","journal-title":"Artificial Intelligence Review"},{"key":"ref52","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1016\/S0893-6080(05)80023-1","article-title":"Stacked generalization","volume":"5","author":"Wolpert DH","year":"1992","unstructured":"Wolpert, D. H. Stacked generalization. Neural Networks 5, 241\u2013259, doi:https:\/\/doi.org\/10.1016\/S0893-6080(05)80023-1 (1992).","journal-title":"Neural Networks"},{"key":"ref53","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","article-title":"The Measurement of Observer Agreement for Categorical Data","volume":"33","author":"Landis JR","year":"1977","unstructured":"Landis, J. R. & Koch, G. G. The Measurement of Observer Agreement for Categorical Data. Biometrics 33, 159\u2013174, doi:10.2307\/2529310 (1977).","journal-title":"Biometrics"},{"key":"ref54","first-page":"4765","volume-title":"Advances in Neural Information Processing Systems 30","author":"Lundberg SM","year":"2017","unstructured":"Lundberg, S. M. & Lee, S.-I. in Advances in Neural Information Processing Systems 30 (eds I. Guyon et al.) 4765\u20134774 (Curran Associates, Inc., 2017)."},{"key":"ref55","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1038\/s42256-019-0138-9","article-title":"From local explanations to global understanding with explainable AI for trees","volume":"2","author":"Lundberg SM","year":"2020","unstructured":"Lundberg, S. M. et al. From local explanations to global understanding with explainable AI for trees. Nature Machine Intelligence 2, 56\u201367, doi:10.1038\/s42256-019-0138-9 (2020).","journal-title":"Nature Machine Intelligence"},{"key":"ref56","doi-asserted-by":"publisher","DOI":"10.1101\/2021.11.07.467640","author":"Lee H-J","year":"2021","unstructured":"Lee, H.-J. An interactome landscape of SARS-CoV-2 virus-human protein-protein interactions by protein sequence-based multi-label classifiers. bioRxiv, 2021.2011.2007.467640, doi:10.1101\/2021.11.07.467640 (2021)."},{"key":"ref57","doi-asserted-by":"publisher","DOI":"10.1016\/j.isci.2021.103730","author":"Smith K","year":"2022","unstructured":"Smith, K., Shen, F., Lee, H. J. & Chandrasekaran, S. Metabolic signatures of regulation by phosphorylation and acetylation. iScience, 103730, doi:https:\/\/doi.org\/10.1016\/j.isci.2021.103730 (2022)."},{"key":"ref58","doi-asserted-by":"publisher","first-page":"1797","DOI":"10.1161\/STROKEAHA.119.028669","article-title":"Potential Embolic Sources and Outcomes in Embolic Stroke of Undetermined Source in the NAVIGATE-ESUS Trial","volume":"51","author":"Ntaios G","year":"2020","unstructured":"Ntaios, G. et al. Potential Embolic Sources and Outcomes in Embolic Stroke of Undetermined Source in the NAVIGATE-ESUS Trial. Stroke 51, 1797\u20131804, doi:10.1161\/STROKEAHA.119.028669 (2020).","journal-title":"Stroke"},{"key":"ref59","doi-asserted-by":"publisher","first-page":"E773-778","DOI":"10.1001\/amajethics.2020.773","article-title":"Believing in Overcoming Cognitive Biases","volume":"22","author":"Doherty TS","year":"2020","unstructured":"Doherty, T. S. & Carroll, A. E. Believing in Overcoming Cognitive Biases. AMA J Ethics 22, E773-778, doi:10.1001\/amajethics.2020.773 (2020).","journal-title":"AMA J Ethics"},{"key":"ref60","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1161\/01.STR.31.1.19","article-title":"Geographic Variation in Stroke Risk in the United States","volume":"31","author":"Obisesan TO","year":"2000","unstructured":"Obisesan, T. O., Vargas, C. M. & Gillum, R. F. Geographic Variation in Stroke Risk in the United States. Stroke 31, 19\u201325, doi:doi:10.1161\/01.STR.31.1.19 (2000).","journal-title":"Stroke"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/www.researchsquare.com\/article\/rs-3367169\/v1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.researchsquare.com\/article\/rs-3367169\/v1.html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,18]],"date-time":"2024-05-18T07:09:49Z","timestamp":1716016189000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.researchsquare.com\/article\/rs-3367169\/v1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,31]]},"references-count":60,"URL":"https:\/\/doi.org\/10.21203\/rs.3.rs-3367169\/v1","relation":{"is-preprint-of":[{"id-type":"doi","id":"10.1038\/s41746-024-01120-w","asserted-by":"subject"}]},"subject":[],"published":{"date-parts":[[2023,10,31]]},"subtype":"preprint"}}