{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,25]],"date-time":"2026-01-25T12:15:25Z","timestamp":1769343325324,"version":"3.49.0"},"reference-count":24,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,5,3]],"date-time":"2021-05-03T00:00:00Z","timestamp":1620000000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,5,3]],"date-time":"2021-05-03T00:00:00Z","timestamp":1620000000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>In many cases, both the rupture rate of cerebral arteriovenous malformation (bAVM) in patients and the risk of endovascular or surgical treatment (when radiosurgery is not appropriate) are not low, it is important to assess the risk of rupture more cautiously before treatment. Based on the current high-risk predictors and clinical data, different sample sizes, sampling times and algorithms were used to build prediction models for the risk of hemorrhage in bAVM, and the accuracy and stability of the models were investigated. Our purpose was to remind researchers that there may be some pitfalls in developing similar prediction models.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>The clinical data of 353 patients with bAVMs were collected. During the creation of prediction models for bAVM rupture, we changed the ratio of the training dataset to the test dataset, increased the number of sampling times, and built models for predicting bAVM rupture by the logistic regression (LR) algorithm and random forest (RF) algorithm. The area under the curve (AUC) was used to evaluate the predictive performances of those models.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The performances of the prediction models built by both algorithms were not ideal (AUCs: 0.7 or less). The AUCs from the models built by the LR algorithm with different sample sizes were better than those built by the RF algorithm (0.70 vs 0.68, <jats:italic>p<\/jats:italic>\u2009&lt;\u20090.001). The standard deviations (SDs) of the AUCs from both prediction models with different sample sizes displayed wide ranges (max range &gt;\u20090.1).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Based on the current risk predictors, it may be difficult to build a stable and accurate prediction model for the hemorrhagic risk of bAVMs. Compared with sample size and algorithms, meaningful predictors are more important in establishing an accurate and stable prediction model.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-021-01511-z","type":"journal-article","created":{"date-parts":[[2021,5,3]],"date-time":"2021-05-03T14:50:54Z","timestamp":1620053454000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Factors affecting the performance of brain arteriovenous malformation rupture prediction models"],"prefix":"10.1186","volume":"21","author":[{"given":"Wengui","family":"Tao","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Langchao","family":"Yan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ming","family":"Zeng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fenghua","family":"Chen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,5,3]]},"reference":[{"issue":"19","key":"1511_CR1","doi-asserted-by":"crossref","first-page":"1859","DOI":"10.1056\/NEJMra1607407","volume":"376","author":"RA Solomon","year":"2017","unstructured":"Solomon RA, Connolly ES Jr. Arteriovenous malformations of the brain. N Engl J Med. 2017;376(19):1859\u201366.","journal-title":"N Engl J Med"},{"issue":"6","key":"1511_CR2","doi-asserted-by":"crossref","first-page":"1059","DOI":"10.1007\/s00701-017-3154-8","volume":"159","author":"M Cenzato","year":"2017","unstructured":"Cenzato M, Boccardi E, Beghi E, Vajkoczy P, Szikora I, Motti E, et al. European consensus conference on unruptured brain AVMs treatment (supported by EANS, ESMINT, EGKS, and SINCH). Acta Neurochir (Wien). 2017;159(6):1059\u201364.","journal-title":"Acta Neurochir (Wien)"},{"issue":"2","key":"1511_CR3","doi-asserted-by":"crossref","first-page":"486","DOI":"10.3171\/2015.6.JNS15619","volume":"126","author":"E Magro","year":"2017","unstructured":"Magro E, Gentric JC, Darsaut TE, Ziegler D, Msi Bojanowski MW, et al. Responses to ARUBA: a systematic review and critical analysis for the design of future arteriovenous malformation trials. J Neurosurg. 2017;126(2):486\u201394.","journal-title":"J Neurosurg"},{"key":"1511_CR4","first-page":"1","volume":"95","author":"B Pulli","year":"2019","unstructured":"Pulli B, Chapman PH, Ogilvy CS, Patel AB, Stapleton CJ, Leslie-Mazwi TM, et al. Multimodal cerebral arteriovenous malformation treatment: a 12-year experience and comparison of key outcomes to ARUBA. J Neurosurg. 2019;95:1\u201310.","journal-title":"J Neurosurg"},{"issue":"4","key":"1511_CR5","doi-asserted-by":"crossref","first-page":"932","DOI":"10.1002\/bimj.201900075","volume":"62","author":"N Falconieri","year":"2020","unstructured":"Falconieri N, Van Calster B, Timmerman D, Wynants L. Developing risk models for multicenter data using standard logistic regression produced suboptimal predictions: a simulation study. Biom J. 2020;62(4):932\u201344.","journal-title":"Biom J"},{"issue":"7","key":"1511_CR6","doi-asserted-by":"crossref","first-page":"1703","DOI":"10.1161\/STROKEAHA.119.025054","volume":"50","author":"J Feghali","year":"2019","unstructured":"Feghali J, Yang W, Xu R, Liew J, McDougall CG, Caplan JM, et al. R2eD AVM score. Stroke. 2019;50(7):1703\u201310.","journal-title":"Stroke"},{"key":"1511_CR7","doi-asserted-by":"crossref","first-page":"627","DOI":"10.1016\/j.wneu.2020.04.135","volume":"140","author":"N Fatima","year":"2020","unstructured":"Fatima N, Zheng H, Massaad E, Hadzipasic M, Shankar GM, Shin JH. Development and validation of machine learning algorithms for predicting adverse events after surgery for lumbar degenerative spondylolisthesis. World Neurosurg. 2020;140:627\u201341.","journal-title":"World Neurosurg"},{"issue":"1","key":"1511_CR8","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1186\/s12859-018-2264-5","volume":"19","author":"R Couronne","year":"2018","unstructured":"Couronne R, Probst P, Boulesteix AL. Random forest versus logistic regression: a large-scale benchmark experiment. BMC Bioinform. 2018;19(1):270.","journal-title":"BMC Bioinform"},{"issue":"9","key":"1511_CR9","doi-asserted-by":"crossref","first-page":"1307","DOI":"10.1093\/europace\/euz036","volume":"21","author":"WS Hu","year":"2019","unstructured":"Hu WS, Hsieh MH, Lin CL. A novel atrial fibrillation prediction model for Chinese subjects: a nationwide cohort investigation of 682 237 study participants with random forest model. Europace. 2019;21(9):1307\u201312.","journal-title":"Europace"},{"issue":"8","key":"1511_CR10","doi-asserted-by":"crossref","first-page":"2082","DOI":"10.1016\/j.jstrokecerebrovasdis.2018.03.003","volume":"27","author":"Z Huang","year":"2018","unstructured":"Huang Z, Peng K, Chen C, Zeng F, Wang J, Chen F. A reanalysis of predictors for the risk of hemorrhage in brain arteriovenous malformation. J Stroke Cerebrovasc Dis. 2018;27(8):2082\u20137.","journal-title":"J Stroke Cerebrovasc Dis"},{"key":"1511_CR11","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1186\/1472-6947-12-8","volume":"12","author":"RL Figueroa","year":"2012","unstructured":"Figueroa RL, Zeng-Treitler Q, Kandula S, Ngo LH. Predicting sample size required for classification performance. BMC Med Inform Decis Mak. 2012;12:8.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"5","key":"1511_CR12","doi-asserted-by":"crossref","first-page":"e0176726","DOI":"10.1371\/journal.pone.0176726","volume":"12","author":"A Palazon-Bru","year":"2017","unstructured":"Palazon-Bru A, Folgado-de la Rosa DM, Cortes-Castell E, Lopez-Cascales MT, Gil-Guillen VF. Sample size calculation to externally validate scoring systems based on logistic regression models. PLoS ONE. 2017;12(5):e0176726.","journal-title":"PLoS ONE"},{"key":"1511_CR13","doi-asserted-by":"crossref","first-page":"h3868","DOI":"10.1136\/bmj.h3868","volume":"351","author":"M Pavlou","year":"2015","unstructured":"Pavlou M, Ambler G, Seaman SR, Guttmann O, Elliott P, King M, et al. How to develop a more accurate risk prediction model when there are few events. BMJ. 2015;351:h3868.","journal-title":"BMJ"},{"issue":"7","key":"1511_CR14","doi-asserted-by":"crossref","first-page":"1697","DOI":"10.1161\/01.STR.0000130988.44824.29","volume":"35","author":"AX Halim","year":"2004","unstructured":"Halim AX, Johnston SC, Singh V, McCulloch CE, Bennett JP, Achrol AS, et al. Longitudinal risk of intracranial hemorrhage in patients with arteriovenous malformation of the brain within a defined population. Stroke. 2004;35(7):1697\u2013702.","journal-title":"Stroke"},{"issue":"5","key":"1511_CR15","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1227\/01.NEU.0000330401.82582.5E","volume":"63","author":"JA Hernesniemi","year":"2008","unstructured":"Hernesniemi JA, Dashti R, Juvela S, Vaart K, Niemela M, Laakso A. Natural history of brain arteriovenous malformations: a long-term follow-up study of risk of hemorrhage in 238 patients. Neurosurgery. 2008;63(5):823\u20139 ((discussion 9-31)).","journal-title":"Neurosurgery"},{"issue":"3","key":"1511_CR16","doi-asserted-by":"crossref","first-page":"387","DOI":"10.3171\/jns.1990.73.3.0387","volume":"73","author":"SL Ondra","year":"1990","unstructured":"Ondra SL, Troupp H, George ED, Schwab K. The natural history of symptomatic arteriovenous malformations of the brain: a 24-year follow-up assessment. J Neurosurg. 1990;73(3):387\u201391.","journal-title":"J Neurosurg"},{"issue":"5","key":"1511_CR17","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1007\/s12975-014-0351-0","volume":"5","author":"WC Rutledge","year":"2014","unstructured":"Rutledge WC, Ko NU, Lawton MT, Kim H. Hemorrhage rates and risk factors in the natural history course of brain arteriovenous malformations. Transl Stroke Res. 2014;5(5):538\u201342.","journal-title":"Transl Stroke Res"},{"issue":"9","key":"1511_CR18","doi-asserted-by":"crossref","first-page":"1350","DOI":"10.1212\/01.wnl.0000210524.68507.87","volume":"66","author":"C Stapf","year":"2006","unstructured":"Stapf C, Mast H, Sciacca RR, Choi JH, Khaw AV, Connolly ES, et al. Predictors of hemorrhage in patients with untreated brain arteriovenous malformation. Neurology. 2006;66(9):1350\u20135.","journal-title":"Neurology"},{"issue":"2","key":"1511_CR19","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1161\/hs0202.102335","volume":"33","author":"IC van der Schaaf","year":"2002","unstructured":"van der Schaaf IC, Brilstra EH, Rinkel GJ, Bossuyt PM, van Gijn J. Quality of life, anxiety, and depression in patients with an untreated intracranial aneurysm or arteriovenous malformation. Stroke. 2002;33(2):440\u20133.","journal-title":"Stroke"},{"issue":"5","key":"1511_CR20","doi-asserted-by":"crossref","first-page":"949","DOI":"10.3174\/ajnr.A4224","volume":"36","author":"MD Alexander","year":"2015","unstructured":"Alexander MD, Cooke DL, Nelson J, Guo DE, Dowd CF, Higashida RT, et al. Association between Venous Angioarchitectural Features of Sporadic Brain Arteriovenous Malformations and Intracranial Hemorrhage. AJNR Am J Neuroradiol. 2015;36(5):949\u201352.","journal-title":"AJNR Am J Neuroradiol"},{"key":"1511_CR21","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.jocn.2018.04.010","volume":"53","author":"N Dinc","year":"2018","unstructured":"Dinc N, Platz J, Tritt S, Quick-Weller J, Eibach M, Wolff R, et al. Posterior fossa AVMs: increased risk of bleeding and worse outcome compared to supratentorial AVMs. J Clin Neurosci. 2018;53:171\u20136.","journal-title":"J Clin Neurosci"},{"key":"1511_CR22","doi-asserted-by":"crossref","first-page":"303","DOI":"10.4103\/sni.sni_273_17","volume":"8","author":"F Padilla-Vazquez","year":"2017","unstructured":"Padilla-Vazquez F, Zenteno MA, Balderrama J, Escobar-de la Garma VH, Juan DS, Trenado C. A proposed classification for assessing rupture risk in patients with intracranial arteriovenous malformations. Surg Neurol Int. 2017;8:303.","journal-title":"Surg Neurol Int"},{"issue":"5","key":"1511_CR23","doi-asserted-by":"crossref","first-page":"965","DOI":"10.3171\/JNS-07\/11\/0965","volume":"107","author":"S Yamada","year":"2007","unstructured":"Yamada S, Takagi Y, Nozaki K, Kikuta K, Hashimoto N. Risk factors for subsequent hemorrhage in patients with cerebral arteriovenous malformations. J Neurosurg. 2007;107(5):965\u201372.","journal-title":"J Neurosurg"},{"issue":"476\u201386","key":"1511_CR24","first-page":"e1","volume":"109","author":"JT Senders","year":"2018","unstructured":"Senders JT, Staples PC, Karhade AV, Zaki MM, Gormley WB, Broekman MLD, et al. Machine learning and neurosurgical outcome prediction: a systematic review. World Neurosurg. 2018;109(476\u201386):e1.","journal-title":"World Neurosurg"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-021-01511-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-021-01511-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-021-01511-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,3]],"date-time":"2021-05-03T14:51:18Z","timestamp":1620053478000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-021-01511-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,3]]},"references-count":24,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["1511"],"URL":"https:\/\/doi.org\/10.1186\/s12911-021-01511-z","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,3]]},"assertion":[{"value":"9 February 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 April 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 May 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All procedures in this retrospective study that involved human participants were approved by the ethical committee of our hospital and performed in accordance with the institutional ethical standards, the 1964 Helsinki declaration and its later amendments, or comparable ethical standards. This is a retrospective longitudinal study. The data are anonymous, and the requirement for written informed consent was waived by the Institutional Review Board.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"142"}}