{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T12:27:25Z","timestamp":1787315245106,"version":"build-2736575974"},"reference-count":45,"publisher":"Oxford University Press (OUP)","issue":"1168","license":[{"start":{"date-parts":[[2025,1,29]],"date-time":"2025-01-29T00:00:00Z","timestamp":1738108800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>Artificial intelligence (AI) software including Brainomix \u201ce-CTA\u201d which detect large vessel occlusions (LVO) have clinical potential. We hypothesized that in real world use where prevalence is low, its clinical utility may be overstated.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>In this single centre retrospective service evaluation project, data sent to Brainomix from a medium size acute National Health Service (NHS) Trust hospital between January 3, 2022 and January 3, 2023 was reviewed. 584 intracranial computed tomography angiogram (CTA) datasets were analysed for LVO by e-CTA. The e-CTA output and radiology report were compared to ground truth, defined by a consultant radiologist with fellowship neuroradiology training, with access to subsequent imaging and clinical notes. Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Of 584 cases (45% female, mean age 70\u2009\u00b1\u200916\u2009years), 9% (n\u2009=\u200950) had LVO. e-CTA had a sensitivity of 0.78 (95% CI 0.64-0.88), specificity of 0.93 (0.9-0.95), PPV of 0.5 (0.42-0.58), and NPV of 0.98 (0.96-0.99). e-CTA had an error rate of 9% (52\/584). Erroneous cases were categorized into causes for error. Common causes for false positives included incorrect anatomy (21%, 8\/39) and other pathology (13%, 5\/39), with several uncategorizable cases (39%, 15\/39). Common causes for false negatives included LVO within the terminal internal carotid artery (ICA) (55%, 6\/11) and uncategorizable (18%, 2\/11).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>We demonstrated that PPV of e-CTA is poor in consecutive cases in a real-world NHS setting. We advocate for local validation of AI software prior to clinical use.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Advances in knowledge<\/jats:title>\n                    <jats:p>Common AI errors were due to anatomical misidentification, presence of other pathology, and misidentifying LVO in the terminal ICA.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/bjr\/tqaf019","type":"journal-article","created":{"date-parts":[[2025,1,29]],"date-time":"2025-01-29T11:06:21Z","timestamp":1738148781000},"page":"592-599","source":"Crossref","is-referenced-by-count":7,"title":["Real world clinical experience of using Brainomix e-CTA software in a medium size acute National Health Service Trust"],"prefix":"10.1093","volume":"98","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-7242-6836","authenticated-orcid":false,"given":"Fraser","family":"Merchant","sequence":"first","affiliation":[{"name":"Royal United Hospital , Combe Park , Bath, Avon, BA1 3NG,","place":["United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Choulerton","sequence":"additional","affiliation":[{"name":"Royal United Hospital , Combe Park , Bath, Avon, BA1 3NG,","place":["United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard","family":"James","sequence":"additional","affiliation":[{"name":"Royal United Hospital , Combe Park , Bath, Avon, BA1 3NG,","place":["United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chun Lap","family":"Pang","sequence":"additional","affiliation":[{"name":"Royal United Hospital , Combe Park , Bath, Avon, BA1 3NG,","place":["United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2025,1,29]]},"reference":[{"key":"2025031820384105000_tqaf019-B1","doi-asserted-by":"crossref","first-page":"651","DOI":"10.3389\/fneur.2017.00651","article-title":"Ischemic strokes due to large-vessel occlusions contribute disproportionately to stroke-related dependence and death: a review","volume":"8","author":"Malhotra","year":"2017","journal-title":"Front Neurol"},{"key":"2025031820384105000_tqaf019-B2","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1056\/NEJMoa1411587","article-title":"A randomized trial of intraarterial treatment for acute ischemic stroke","volume":"372","author":"Berkhemer","year":"2015","journal-title":"N Engl J Med"},{"key":"2025031820384105000_tqaf019-B3","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1056\/NEJMoa1706442","article-title":"Thrombectomy 6 to 24 hours after stroke with a mismatch between deficit and infarct","volume":"378","author":"Nogueira","year":"2018","journal-title":"N Engl J Med"},{"key":"2025031820384105000_tqaf019-B4","doi-asserted-by":"crossref","first-page":"1581","DOI":"10.1056\/NEJM199512143332401","article-title":"National Institute of Neurological Disorders and Stroke rt-PA Stroke Study Group. Tissue plasminogen activator for acute ischemic stroke","volume":"333","year":"1995","journal-title":"N Engl J Med"},{"key":"2025031820384105000_tqaf019-B5","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1056\/NEJMoa1414792","article-title":"Endovascular therapy for ischemic stroke with perfusion-imaging selection","volume":"372","author":"Campbell","year":"2015","journal-title":"N Engl J Med"},{"key":"2025031820384105000_tqaf019-B6","doi-asserted-by":"crossref","first-page":"1138","DOI":"10.1016\/S1474-4422(16)30177-6","article-title":"Mechanical thrombectomy after intravenous alteplase versus alteplase alone after stroke (THRACE): a randomised controlled trial","volume":"15","author":"Bracard","year":"2016","journal-title":"Lancet Neurol"},{"key":"2025031820384105000_tqaf019-B7","doi-asserted-by":"crossref","first-page":"2316","DOI":"10.1056\/NEJMoa2000120","article-title":"Thrombectomy for stroke in the public health care system of Brazil","volume":"382","author":"Martins","year":"2020","journal-title":"N Engl J Med"},{"key":"2025031820384105000_tqaf019-B8","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1056\/NEJMoa1713973","article-title":"Thrombectomy for stroke at 6 to 16 hours with selection by perfusion imaging","volume":"378","author":"Albers","year":"2018","journal-title":"N Engl J Med"},{"key":"2025031820384105000_tqaf019-B9","doi-asserted-by":"crossref","first-page":"e344","DOI":"10.1161\/STR.0000000000000211","article-title":"Guidelines for the early management of patients with acute ischemic stroke: 2019 update to the 2018 guidelines for the early management of acute ischemic stroke: a guideline for healthcare professionals from the American Heart Association\/American Stroke Association","volume":"50","author":"Powers","year":"2019","journal-title":"Stroke"},{"key":"2025031820384105000_tqaf019-B10","doi-asserted-by":"crossref","first-page":"1723","DOI":"10.1016\/S0140-6736(16)00163-X","article-title":"Endovascular thrombectomy after large-vessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trials","volume":"387","author":"Goyal","year":"2016","journal-title":"Lancet"},{"key":"2025031820384105000_tqaf019-B11","doi-asserted-by":"crossref","first-page":"1279","DOI":"10.1001\/jama.2016.13647","article-title":"Time to treatment with endovascular thrombectomy and outcomes from ischemic stroke: a meta-analysis","volume":"316","author":"Saver","year":"2016","journal-title":"JAMA"},{"key":"2025031820384105000_tqaf019-B12","doi-asserted-by":"crossref","first-page":"1019","DOI":"10.1056\/NEJMoa1414905","article-title":"Randomized assessment of rapid endovascular treatment of ischemic stroke","volume":"372","author":"Goyal","year":"2015","journal-title":"N Engl J Med"},{"key":"2025031820384105000_tqaf019-B13","doi-asserted-by":"crossref","first-page":"2285","DOI":"10.1056\/NEJMoa1415061","article-title":"Stent-retriever thrombectomy after intravenous t-PA vs. t-PA alone in stroke","volume":"372","author":"Saver","year":"2015","journal-title":"N Engl J Med"},{"key":"2025031820384105000_tqaf019-B14","doi-asserted-by":"crossref","first-page":"2296","DOI":"10.1056\/NEJMoa1503780","article-title":"Thrombectomy within 8 hours after symptom onset in ischemic stroke","volume":"372","author":"Jovin","year":"2015","journal-title":"N Engl J Med"},{"key":"2025031820384105000_tqaf019-B15","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1136\/jnnp-2016-314117","article-title":"Endovascular therapy for acute ischaemic stroke: the Pragmatic Ischaemic Stroke Thrombectomy Evaluation (PISTE) randomised, controlled trial","volume":"88","author":"Muir","year":"2017","journal-title":"J Neurol Neurosurg Psychiatry"},{"key":"2025031820384105000_tqaf019-B16","doi-asserted-by":"crossref","first-page":"e8","DOI":"10.1136\/neurintsurg-2018-014569","article-title":"European Stroke Organisation (ESO) - European Society for Minimally Invasive Neurological Therapy (ESMINT) guidelines on mechanical thrombectomy in acute ischemic stroke","volume":"15","author":"Turc","year":"2023","journal-title":"J Neurointerv Surg"},{"key":"2025031820384105000_tqaf019-B17","doi-asserted-by":"crossref","first-page":"888","DOI":"10.1148\/radiol.2016160204","article-title":"Analysis of workflow and time to treatment and the effects on outcome in endovascular treatment of acute ischemic stroke: results from the SWIFT PRIME randomized controlled trial","volume":"279","author":"Goyal","year":"2016","journal-title":"Radiology"},{"key":"2025031820384105000_tqaf019-B18","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1161\/STROKEAHA.119.027356","article-title":"CTA-for-all: impact of emergency computed tomographic angiography for all patients with stroke presenting within 24 hours of onset","volume":"51","author":"Mayer","year":"2020","journal-title":"Stroke"},{"key":"2025031820384105000_tqaf019-B19","first-page":"S14","article-title":"Neuroimaging in the era of artificial intelligence: current applications","volume":"39","author":"Monsour","year":"2022","journal-title":"Fed Pract"},{"key":"2025031820384105000_tqaf019-B20","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1136\/neurintsurg-2019-015135","article-title":"Artificial intelligence to diagnose ischemic stroke and identify large vessel occlusions: a systematic review","volume":"12","author":"Murray","year":"2020","journal-title":"J Neurointerv Surg"},{"key":"2025031820384105000_tqaf019-B21","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1161\/01.STR.0000196957.55928.ab","article-title":"Time is brain\u2014quantified","volume":"37","author":"Saver","year":"2006","journal-title":"Stroke"},{"key":"2025031820384105000_tqaf019-B22","author":"Government U","year":"2022"},{"key":"2025031820384105000_tqaf019-B23","author":"Brainomix"},{"key":"2025031820384105000_tqaf019-B24","author":"Excellence NIfHaC","year":"2024"},{"key":"2025031820384105000_tqaf019-B25","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1177\/1747493021992592","article-title":"Diagnostic accuracy of automated occlusion detection in CT angiography using e-CTA","volume":"17","author":"Seker","year":"2022","journal-title":"Int J Stroke"},{"key":"2025031820384105000_tqaf019-B26","doi-asserted-by":"crossref","first-page":"607","DOI":"10.3174\/ajnr.A6469","article-title":"CT angiography in evaluating large-vessel occlusion in acute anterior circulation ischemic stroke: factors associated with diagnostic error in clinical practice","volume":"41","author":"Fasen","year":"2020","journal-title":"AJNR Am J Neuroradiol"},{"key":"2025031820384105000_tqaf019-B27","author":"Council","year":"2024"},{"key":"2025031820384105000_tqaf019-B28","doi-asserted-by":"crossref","first-page":"e313","DOI":"10.1016\/j.crad.2022.10.017","article-title":"Diagnostic accuracy of a decision-support software for the detection of intracranial large-vessel occlusion in CT angiography","volume":"78","author":"Andralojc","year":"2023","journal-title":"Clin Radiol"},{"key":"2025031820384105000_tqaf019-B29","author":"Kane"},{"key":"2025031820384105000_tqaf019-B30","doi-asserted-by":"crossref","first-page":"104504","DOI":"10.1016\/j.jstrokecerebrovasdis.2019.104504","article-title":"Large vessel occlusion in acute ischemic stroke patients: a dual-center estimate based on a broad definition of occlusion site","volume":"29","author":"Waqas","year":"2020","journal-title":"J Stroke Cerebrovasc Dis"},{"key":"2025031820384105000_tqaf019-B31"},{"key":"2025031820384105000_tqaf019-B32","author":"Schoonjans","year":"2023"},{"key":"2025031820384105000_tqaf019-B33","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1159\/000519125","article-title":"Automated large artery occlusion detection in stroke: a single-center validation study of an artificial intelligence algorithm","volume":"51","author":"Rodrigues","year":"2022","journal-title":"Cerebrovasc Dis"},{"key":"2025031820384105000_tqaf019-B34","doi-asserted-by":"crossref","first-page":"e2431639","DOI":"10.2214\/AJR.24.31639","article-title":"Prospective evaluation of artificial intelligence triage of intracranial hemorrhage on noncontrast head CT examinations","volume":"223","author":"Savage","year":"2024","journal-title":"AJR Am J Roentgenol"},{"key":"2025031820384105000_tqaf019-B35","doi-asserted-by":"crossref","first-page":"e240067","DOI":"10.1148\/ryai.240067","article-title":"Deep learning to detect intracranial hemorrhage in a national teleradiology program and the impact on interpretation time","volume":"6","author":"Del Gaizo","year":"2024","journal-title":"Radiol Artif Intell"},{"key":"2025031820384105000_tqaf019-B36","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1038\/s41746-024-01116-6","article-title":"The EU passes the AI act and its implications for digital medicine are unclear","volume":"7","author":"Gilbert","year":"2024","journal-title":"NPJ Digit Med"},{"key":"2025031820384105000_tqaf019-B37","doi-asserted-by":"crossref","first-page":"8263","DOI":"10.1007\/s00330-023-09747-1","article-title":"Can incorrect artificial intelligence (AI) results impact radiologists, and if so, what can we do about it? a multi-reader pilot study of lung cancer detection with chest radiography","volume":"33","author":"Bernstein","year":"2023","journal-title":"Eur Radiol"},{"key":"2025031820384105000_tqaf019-B38","doi-asserted-by":"crossref","first-page":"1828","DOI":"10.1001\/jamainternmed.2015.5231","article-title":"Diagnostic accuracy of digital screening mammography with and without computer-aided detection","volume":"175","author":"Lehman","year":"2015","journal-title":"JAMA Intern Med"},{"key":"2025031820384105000_tqaf019-B39","doi-asserted-by":"crossref","first-page":"20190580","DOI":"10.1259\/bjr.20190580","article-title":"CAD and AI for breast cancer\u2014recent development and challenges","volume":"93","author":"Chan","year":"2020","journal-title":"Br J Radiol"},{"key":"2025031820384105000_tqaf019-B40","author":"Brainomix-360-Brochure-us.pdf","year":"2023"},{"key":"2025031820384105000_tqaf019-B41","author":"Brainomix | Triage LVO","year":"2023"},{"key":"2025031820384105000_tqaf019-B42","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1093\/jamia\/ocz192","article-title":"A governance model for the application of AI in health care","volume":"27","author":"Reddy","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2025031820384105000_tqaf019-B43","doi-asserted-by":"crossref","first-page":"890","DOI":"10.1093\/jamia\/ocaa268","article-title":"Trust and medical AI: the challenges we face and the expertise needed to overcome them","volume":"28","author":"Quinn","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2025031820384105000_tqaf019-B44","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1055\/a-2076-6736","article-title":"Artificial intelligence in radiology\u2014beyond the black box","volume":"195","author":"Gall\u00e9e","year":"2023","journal-title":"Rofo"},{"key":"2025031820384105000_tqaf019-B45","article-title":"Redefining radiology: a review of artificial intelligence integration in medical imaging","volume":"13","author":"Najjar","year":"2023","journal-title":"Diagnostics (Basel)"}],"container-title":["British Journal of Radiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bjr\/advance-article-pdf\/doi\/10.1093\/bjr\/tqaf019\/61683514\/tqaf019.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bjr\/article-pdf\/98\/1168\/592\/61683514\/tqaf019.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bjr\/article-pdf\/98\/1168\/592\/61683514\/tqaf019.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,18]],"date-time":"2025-03-18T16:38:55Z","timestamp":1742315935000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bjr\/article\/98\/1168\/592\/7989295"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,29]]},"references-count":45,"journal-issue":{"issue":"1168","published-online":{"date-parts":[[2025,1,29]]},"published-print":{"date-parts":[[2025,4,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bjr\/tqaf019","relation":{},"ISSN":["0007-1285","1748-880X"],"issn-type":[{"value":"0007-1285","type":"print"},{"value":"1748-880X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2025,4]]},"published":{"date-parts":[[2025,1,29]]}}}