{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T17:45:20Z","timestamp":1787161520280,"version":"build-2736575974"},"reference-count":23,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"5","license":[{"start":{"date-parts":[[2021,2,6]],"date-time":"2021-02-06T00:00:00Z","timestamp":1612569600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neurosurg.","NEUROS"],"published-print":{"date-parts":[[2021,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>BACKGROUND<\/jats:title>\n                    <jats:p>Predicting outcome after aneurysmal subarachnoid hemorrhage (aSAH) is known to be challenging and complex. Machine learning approaches, of which feedforward artificial neural networks (ffANNs) are the most widely used, could contribute to the patient-specific outcome prediction.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>OBJECTIVE<\/jats:title>\n                    <jats:p>To investigate the prediction capacity of an ffANN for the patient-specific clinical outcome and the occurrence of delayed cerebral ischemia (DCI) and compare those results with the predictions of 2 internationally used scoring systems.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>METHODS<\/jats:title>\n                    <jats:p>A prospective database was used to predict (1) death during hospitalization (ie, mortality) (n\u00a0=\u00a0451), (2) unfavorable modified Rankin Scale (mRS) at 6 mo (n\u00a0=\u00a0413), and (3) the occurrence of DCI (n\u00a0=\u00a0362). Additionally, the predictive capacities of the ffANN were compared to those of Subarachnoid Haemorrhage International Trialists (SAHIT) and VASOGRADE to predict clinical outcome and occurrence of DCI.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>RESULTS<\/jats:title>\n                    <jats:p>The area under the curve (AUC) of the ffANN showed to be 88%, 85%, and 72% for predicting mortality, an unfavorable mRS, and the occurrence of DCI, respectively. Sensitivity\/specificity rates of the ffANN for mortality, unfavorable mRS, and the occurrence of DCI were 82%\/80%, 94%\/80%, and 74%\/68%. The ffANN and SAHIT calculator showed similar AUCs for predicting personalized outcome. The presented ffANN and VASOGRADE were found to perform equally with regard to personalized prediction of occurrence of DCI.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>CONCLUSION<\/jats:title>\n                    <jats:p>The presented ffANN showed equal performance when compared with VASOGRADE and SAHIT scoring systems while using less individual cases. The web interface launched simultaneously with the publication of this manuscript allows for usage of the ffANN-based prediction tool for individual data (https:\/\/nutshell-tool.com\/).<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/neuros\/nyaa581","type":"journal-article","created":{"date-parts":[[2020,12,15]],"date-time":"2020-12-15T15:13:59Z","timestamp":1608045239000},"page":"E427-E434","source":"Crossref","is-referenced-by-count":62,"title":["Prediction Models in Aneurysmal Subarachnoid Hemorrhage: Forecasting Clinical Outcome With Artificial Intelligence"],"prefix":"10.1227","volume":"88","author":[{"given":"Guido","family":"de Jong","sequence":"first","affiliation":[{"name":"Department of Neurosurgery, Radboud University Medical Center, Nijmegen, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ren\u00e9","family":"Aquarius","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, Radboud University Medical Center, Nijmegen, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Barof","family":"Sanaan","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, Radboud University Medical Center, Nijmegen, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ronald H M A","family":"Bartels","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, Radboud University Medical Center, Nijmegen, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J Andr\u00e9","family":"Grotenhuis","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, Radboud University Medical Center, Nijmegen, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3915-3034","authenticated-orcid":false,"given":"Dylan J H A","family":"Henssen","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, Radboud University Medical Center, Nijmegen, the Netherlands"},{"name":"Donders Institute for Brain, Cognition and Behavior, Radboud University Medical Center, Nijmegen, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hieronymus D","family":"Boogaarts","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, Radboud University Medical Center, Nijmegen, the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2021,5]]},"reference":[{"issue":"5","key":"bib1-20231011","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1001\/jamaneurol.2019.0006","article-title":"Worldwide incidence of aneurysmal subarachnoid hemorrhage according to region, time period, blood pressure, and smoking prevalence in the population","volume":"76","author":"Etminan","year":"2019","journal-title":"JAMA Neurol"},{"issue":"6","key":"bib2-20231011","first-page":"985","article-title":"Report of World Federation of Neurological Surgeons Committee on a Universal Subarachnoid Hemorrhage Grading Scale","volume":"68","author":"Drake","year":"1988","journal-title":"J Neurosurg"},{"key":"bib3-20231011","doi-asserted-by":"crossref","first-page":"j5745","DOI":"10.1136\/bmj.j5745","article-title":"Development and validation of outcome prediction models for aneurysmal subarachnoid haemorrhage: the SAHIT multinational cohort study","volume":"360","author":"Jaja","year":"2018","journal-title":"BMJ"},{"issue":"7","key":"bib4-20231011","doi-asserted-by":"crossref","first-page":"1826","DOI":"10.1161\/STROKEAHA.115.008728","article-title":"The VASOGRADE: a simple grading scale for prediction of delayed cerebral ischemia after subarachnoid hemorrhage","volume":"46","author":"de Oliveira Manoel","year":"2015","journal-title":"Stroke"},{"issue":"2","key":"bib5-20231011","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1093\/neuros\/nyx384","article-title":"Natural and artificial intelligence in neurosurgery: a systematic review","volume":"83","author":"Senders","year":"2018","journal-title":"Neurosurgery"},{"key":"bib6-20231011","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1016\/j.wneu.2017.09.149","article-title":"Machine learning and neurosurgical outcome prediction: a systematic review","volume":"109","author":"Senders","year":"2018","journal-title":"World Neurosurg"},{"issue":"5","key":"bib7-20231011","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1109\/TITB.2009.2020434","article-title":"Predicting the outcome of patients with subarachnoid hemorrhage using machine learning techniques","volume":"13","author":"Toledo","year":"2009","journal-title":"IEEE T Inf Technol B"},{"issue":"1","key":"bib8-20231011","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.wneu.2010.07.007","article-title":"Prediction of symptomatic cerebral vasospasm after aneurysmal subarachnoid hemorrhage with an artificial neural network: feasibility and comparison with logistic regression models","volume":"75","author":"Dumont","year":"2011","journal-title":"World Neurosurg"},{"key":"bib9-20231011","first-page":"904860","article-title":"Clinical outcome prediction in aneurysmal subarachnoid hemorrhage using bayesian neural networks with fuzzy logic inferences","volume":"2013","author":"Lo","year":"2013","journal-title":"Comput Math Method M"},{"issue":"1","key":"bib10-20231011","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/s10877-018-0132-5","article-title":"Predicting delayed cerebral ischemia after subarachnoid hemorrhage using physiological time series data","volume":"33","author":"Park","year":"2019","journal-title":"J Clin Monit Comput"},{"key":"bib11-20231011"},{"key":"bib12-20231011"},{"key":"bib13-20231011"},{"key":"bib14-20231011"},{"issue":"10","key":"bib15-20231011","doi-asserted-by":"crossref","first-page":"2391","DOI":"10.1161\/STROKEAHA.110.589275","article-title":"Definition of delayed cerebral ischemia after aneurysmal subarachnoid hemorrhage as an outcome event in clinical trials and observational studies: proposal of a multidisciplinary research group","volume":"41","author":"Vergouwen","year":"2010","journal-title":"Stroke"},{"key":"bib19-20231011","first-page":"315","article-title":"Deep sparse rectifier neural networks","volume":"15","author":"Glorot","year":"2011","journal-title":"Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics"},{"key":"bib20-20231011","article-title":"Adam: a method for stochastic optimization","author":"Kingma"},{"issue":"1","key":"bib21-20231011","first-page":"1929","article-title":"Dropout: a simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J Machine Learn Res"},{"issue":"5","key":"bib23-20231011","doi-asserted-by":"crossref","first-page":"1530","DOI":"10.3171\/2016.1.JNS152554","article-title":"External validation of the practical risk chart for the prediction of delayed cerebral ischemia following aneurysmal subarachnoid hemorrhage","volume":"126","author":"Foreman","year":"2017","journal-title":"J Neurosurg"},{"issue":"5","key":"bib24-20231011","doi-asserted-by":"crossref","first-page":"1288","DOI":"10.1161\/STROKEAHA.113.001125","article-title":"Early prediction of delayed cerebral ischemia after subarachnoid hemorrhage: development and validation of a practical risk chart","volume":"44","author":"de Rooij","year":"2013","journal-title":"Stroke"},{"issue":"3","key":"bib25-20231011","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1161\/STROKEAHA.111.638403","article-title":"Predicting the lack of development of delayed cerebral ischemia after aneurysmal subarachnoid hemorrhage","volume":"43","author":"Crobeddu","year":"2012","journal-title":"Stroke"},{"issue":"2","key":"bib26-20231011","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1161\/STROKEAHA.117.019328","article-title":"Predictors of in-hospital death after aneurysmal subarachnoid hemorrhage: analysis of a nationwide database (Swiss SOS [Swiss Study on Aneurysmal Subarachnoid Hemorrhage])","volume":"49","author":"Stienen","year":"2018","journal-title":"Stroke"},{"issue":"1","key":"bib27-20231011","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1007\/s10143-017-0843-y","article-title":"Comparative evaluation of H&H and WFNS grading scales with modified H&H (sans systemic disease): a study on 1000 patients with subarachnoid hemorrhage","volume":"41","author":"Aggarwal","year":"2018","journal-title":"Neurosurg Rev"}],"container-title":["Neurosurgery"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/neurosurgery\/article-pdf\/88\/5\/E427\/37052456\/nyaa581.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/www.ovid.com\/10.1093\/neuros\/nyaa581","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T16:47:05Z","timestamp":1786121225000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ovid.com\/10.1093\/neuros\/nyaa581"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,6]]},"references-count":23,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021]]}},"URL":"https:\/\/doi.org\/10.1093\/neuros\/nyaa581","relation":{},"ISSN":["0148-396X","1524-4040"],"issn-type":[{"value":"0148-396X","type":"print"},{"value":"1524-4040","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,6]]}}}