{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T04:58:31Z","timestamp":1789707511957,"version":"4.0.1"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,6,15]],"date-time":"2021-06-15T00:00:00Z","timestamp":1623715200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,6,15]],"date-time":"2021-06-15T00:00:00Z","timestamp":1623715200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Better phenotyping of routinely collected coded data would be useful for research and health improvement. For example, the precision of coded data for hemorrhagic stroke (intracerebral hemorrhage [ICH] and subarachnoid hemorrhage [SAH]) may be as poor as\u2009&lt;\u200950%. This work aimed to investigate the feasibility and added value of automated methods applied to clinical radiology reports to improve stroke subtyping.\n<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>From a sub-population of 17,249 Scottish UK Biobank participants, we ascertained those with an incident stroke code in hospital, death record or primary care administrative data by September 2015, and\u2009\u2265\u20091 clinical brain scan report. We used a combination of natural language processing and clinical knowledge inference on brain scan reports to assign a stroke subtype (ischemic vs ICH vs SAH) for each participant and assessed performance by precision and recall at entity and patient levels.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Of 225 participants with an incident stroke code, 207 had a relevant brain scan report and were included in this study. Entity level precision and recall ranged from 78 to 100%. Automated methods showed precision and recall at patient level that were very good for ICH (both 89%), good for SAH (both 82%), but, as expected, lower for ischemic stroke (73%, and 64%, respectively), suggesting coded data remains the preferred method for identifying the latter stroke subtype.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Our automated method applied to radiology reports provides a feasible, scalable and accurate solution to improve disease subtyping when used in conjunction with administrative coded health data. Future research should validate these findings in a different population setting.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-021-01556-0","type":"journal-article","created":{"date-parts":[[2021,6,15]],"date-time":"2021-06-15T02:02:32Z","timestamp":1623722552000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Developing automated methods for disease subtyping in UK Biobank: an exemplar study on stroke"],"prefix":"10.1186","volume":"21","author":[{"given":"Kristiina","family":"Rannikm\u00e4e","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Honghan","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steven","family":"Tominey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"William","family":"Whiteley","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Naomi","family":"Allen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cathie","family":"Sudlow","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"the UK Biobank","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,6,15]]},"reference":[{"key":"1556_CR1","doi-asserted-by":"publisher","first-page":"e1001779","DOI":"10.1371\/journal.pmed.1001779","volume":"12","author":"C Sudlow","year":"2015","unstructured":"Sudlow C, Gallacher J, Allen N, et al. UK Biobank: an open access resource for identifying the causes of a wide range of complex diseases of middle and old age. PLoS Med. 2015;12:e1001779.","journal-title":"PLoS Med"},{"issue":"6","key":"1556_CR2","doi-asserted-by":"publisher","first-page":"e697","DOI":"10.1212\/WNL.0000000000009924","volume":"95","author":"K Rannikm\u00e4e","year":"2020","unstructured":"Rannikm\u00e4e K, Ngoh K, Bush K, et al. Accuracy of identifying incident stroke cases from linked healthcare data in UK Biobank. Neurology. 2020;95(6):e697\u2013707.","journal-title":"Neurology"},{"issue":"8","key":"1556_CR3","doi-asserted-by":"publisher","first-page":"663","DOI":"10.1016\/S1474-4422(18)30243-6","volume":"17","author":"D Woo","year":"2018","unstructured":"Woo D, Anderson CD, Maguire J, et al. Top research priorities for stroke genetics. Lancet Neurol. 2018;17(8):663\u20135.","journal-title":"Lancet Neurol"},{"key":"1556_CR4","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1007\/s10654-019-00499-1","volume":"34","author":"T Wilkinson","year":"2019","unstructured":"Wilkinson T, Schnier C, Bush K, et al. Identifying dementia outcomes in UK Biobank: a validation study of primary care, hospital admissions and mortality data. Eur J Epidemiol. 2019;34:557\u201365.","journal-title":"Eur J Epidemiol"},{"issue":"1","key":"1556_CR5","doi-asserted-by":"publisher","first-page":"e0198736","DOI":"10.1371\/journal.pone.0198736","volume":"14","author":"Z Harding","year":"2019","unstructured":"Harding Z, Wilkinson T, Stevenson A, et al. Identifying Parkinson\u2019s disease and parkinsonism cases using routinely collected healthcare data: a systematic review. PLoS ONE. 2019;14(1):e0198736.","journal-title":"PLoS ONE"},{"key":"1556_CR6","unstructured":"NHS National Service Scotland. PACS Update for the NSS Executive Board. 2017. https:\/\/nhsnss.org\/media\/2425\/b1773-pacs-update.pdf."},{"key":"1556_CR7","unstructured":"NHS Wales. National Image Viewing in the Welsh Clinical Portal. 2020. https:\/\/nwis.nhs.wales\/files\/national-image-viewing-user-guide\/."},{"key":"1556_CR8","unstructured":"NHS England and NHS Improvement. Search Results Web results Transforming imaging services in England\u2014NHS Improvement. 2019. https:\/\/improvement.nhs.uk\/documents\/6119\/Transforming_imaging_services.pdf."},{"key":"1556_CR9","first-page":"70","volume":"5","author":"BCV Campbell","year":"2019","unstructured":"Campbell BCV, De Silva DA, Macleod MR, et al. Ischaemic stroke. Nat Rev. 2019;5:70.","journal-title":"Nat Rev"},{"key":"1556_CR10","doi-asserted-by":"publisher","first-page":"530","DOI":"10.1093\/jamia\/ocx160","volume":"25","author":"H Wu","year":"2018","unstructured":"Wu H, Toti G, Morley KI, et al. SemEHR: a general-purpose semantic search system to surface semantic data from clinical notes for tailored care, trial recruitment, and clinical research. J Am Med Inform Assoc. 2018;25:530\u20137.","journal-title":"J Am Med Inform Assoc"},{"key":"1556_CR11","unstructured":"Gorinski PJ, Wu H, Grover C, et al. Named Entity Recognition for Electronic Health Records: A Comparison of Rule-based and Machine Learning Approaches. 2019. https:\/\/arxiv.org\/abs\/1903.03985."},{"key":"1556_CR12","unstructured":"https:\/\/www.nlm.nih.gov\/research\/umls\/index.html."},{"key":"1556_CR13","unstructured":"https:\/\/github.com\/CogStack\/nlp2phenome."},{"key":"1556_CR14","unstructured":"http:\/\/www.statsdirect.com."},{"issue":"4","key":"1556_CR15","doi-asserted-by":"publisher","first-page":"e14782","DOI":"10.2196\/14782","volume":"7","author":"H Wu","year":"2019","unstructured":"Wu H, Hodgson K, Dyson S, et al. Efficient reuse of natural language processing models for phenotype-mention identification in free-text electronic medical records: a phenotype embedding approach. JMIR Med Inform. 2019;7(4):e14782.","journal-title":"JMIR Med Inform"},{"issue":"8","key":"1556_CR16","doi-asserted-by":"publisher","first-page":"1499","DOI":"10.1111\/jgs.15411","volume":"66","author":"H Kharrazi","year":"2018","unstructured":"Kharrazi H, Anzaldi LJ, Hernandez L, et al. The value of unstructured electronic health record data in geriatric syndrome case identification. J Am Geriatr Soc. 2018;66(8):1499\u2013507.","journal-title":"J Am Geriatr Soc"},{"key":"1556_CR17","doi-asserted-by":"publisher","first-page":"h1885","DOI":"10.1136\/bmj.h1885","volume":"350","author":"KP Liao","year":"2015","unstructured":"Liao KP, Cai T, Savova GK, et al. Development of phenotype algorithms using electronic medical records and incorporating natural language processing. BMJ. 2015;350:h1885.","journal-title":"BMJ"},{"issue":"3","key":"1556_CR18","first-page":"457","volume":"27","author":"S Wu","year":"2019","unstructured":"Wu S, Roberts K, Datta S, et al. Deep learning in clinical natural language processing: a methodical review. JAMIA. 2019;27(3):457\u201370.","journal-title":"JAMIA"},{"issue":"4","key":"1556_CR19","first-page":"364","volume":"26","author":"TA Koleck","year":"2019","unstructured":"Koleck TA, Dreisbach C, Bourne PE, Bakken S. Natural language processing of symptoms documented in free-text narratives of electronic health records: a systematic review. JAMIA. 2019;26(4):364\u201379.","journal-title":"JAMIA"},{"issue":"5","key":"1556_CR20","first-page":"544","volume":"18","author":"PM Nadkarni","year":"2011","unstructured":"Nadkarni PM, Ohno-Machado L, Chapman WW. Natural language processing: an introduction. JAMIA. 2011;18(5):544\u201351.","journal-title":"JAMIA"},{"issue":"5","key":"1556_CR21","first-page":"540","volume":"18","author":"WW Chapman","year":"2011","unstructured":"Chapman WW, Nadkarni PM, Hirschman L, et al. Overcoming barriers to NLP for clinical text: the role of shared tasks and the need for additional creative solutions. JAMIA. 2011;18(5):540\u20133.","journal-title":"JAMIA"},{"issue":"3","key":"1556_CR22","first-page":"353","volume":"25","author":"S Sohn","year":"2017","unstructured":"Sohn S, Wang Y, Wi C-I, et al. Clinical documentation variations and NLP system portability: a case study in asthma birth cohorts across institutions. JAMIA. 2017;25(3):353\u20139.","journal-title":"JAMIA"},{"issue":"5","key":"1556_CR23","first-page":"876","volume":"20","author":"N Kang","year":"2013","unstructured":"Kang N, Singh B, Afzal Z, et al. Using rule-based natural language processing to improve disease normalization in biomedical text. JAMIA. 2013;20(5):876\u201381.","journal-title":"JAMIA"},{"issue":"3","key":"1556_CR24","first-page":"331","volume":"25","author":"E Soysal","year":"2017","unstructured":"Soysal E, Wang J, Jiang M, et al. CLAMP\u2014a toolkit for efficiently building customized clinical natural language processing pipelines. JAMIA. 2017;25(3):331\u20136.","journal-title":"JAMIA"},{"key":"1556_CR25","doi-asserted-by":"publisher","DOI":"10.1093\/database\/bax027","author":"H Wu","year":"2017","unstructured":"Wu H, Oellrich A, Girges C, et al. Automated PDF highlighting to support faster curation of literature for Parkinson\u2019s and Alzheimer\u2019s disease. Database. 2017. https:\/\/doi.org\/10.1093\/database\/bax027.","journal-title":"Database"},{"issue":"1","key":"1556_CR26","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1186\/s12911-018-0623-9","volume":"18","author":"R Jackson","year":"2018","unstructured":"Jackson R, Kartoglu I, Stringer C, et al. CogStack\u2014experiences of deploying integrated information retrieval and extraction services in a large National Health Service Foundation Trust hospital. BMC Med Inform Decis Mak. 2018;18(1):47.","journal-title":"BMC Med Inform Decis Mak"},{"key":"1556_CR27","unstructured":"Gorinski PJ, Wu H, Grover C, et al. Named Entity Recognition for Electronic Health Records: A Comparison of Rule-based and Machine Learning Approaches. 2019. https:\/\/arxiv.org\/abs\/1903.03985. Accessed 20 Feb 2020."},{"key":"1556_CR28","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocaa056","author":"CJ Lu","year":"2020","unstructured":"Lu CJ, Payne A, Mork JG. The unified medical language system SPECIALIST lexicon and lexical tools: development and applications. JAMIA. 2020. https:\/\/doi.org\/10.1093\/jamia\/ocaa056.","journal-title":"JAMIA"},{"issue":"5","key":"1556_CR29","doi-asserted-by":"publisher","first-page":"839","DOI":"10.1016\/j.jbi.2009.05.002","volume":"42","author":"H Harkema","year":"2009","unstructured":"Harkema H, Dowling JN, Thornblade T, Chapman WW. ConText: An algorithm for determining negation, experiencer, and temporal status from clinical reports. J Biomed Inform. 2009;42(5):839\u201351.","journal-title":"J Biomed Inform"},{"issue":"7","key":"1556_CR30","doi-asserted-by":"publisher","first-page":"2045","DOI":"10.1016\/j.jstrokecerebrovasdis.2019.02.004","volume":"28","author":"R Carg","year":"2019","unstructured":"Carg R, Oh E, Naidech A, Kording K, et al. Automating ischemic stroke subtype classification using machine learning and natural language processing. J Stroke Cerebrovasc Dis. 2019;28(7):2045\u201351.","journal-title":"J Stroke Cerebrovasc Dis"},{"issue":"10","key":"1556_CR31","doi-asserted-by":"publisher","first-page":"2922","DOI":"10.1109\/JBHI.2020.2976931","volume":"24","author":"SF Sung","year":"2020","unstructured":"Sung SF, Lin CY, Hu YH. EMR-based phenotyping of ischemic stroke using supervised machine learning and text mining techniques. IEEE J Biomed Health Inform. 2020;24(10):2922\u201331.","journal-title":"IEEE J Biomed Health Inform"},{"key":"1556_CR32","doi-asserted-by":"publisher","first-page":"118426","DOI":"10.1109\/ACCESS.2020.3004977","volume":"8","author":"G Fang","year":"2020","unstructured":"Fang G, Xu P, Liu W. Automated ischemic stroke subtyping based on machine learning approach. IEEE Access. 2020;8:118426\u201332.","journal-title":"IEEE Access"},{"issue":"Suppl 1","key":"1556_CR33","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1186\/s13326-019-0211-7","volume":"10","author":"B Alex","year":"2019","unstructured":"Alex B, Grover C, Tobin R. Text mining brain imaging reports. J Biomed Semant. 2019;10(Suppl 1):23.","journal-title":"J Biomed Semant"},{"issue":"3","key":"1556_CR34","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1093\/ije\/dys084","volume":"42","author":"BH Smith","year":"2013","unstructured":"Smith BH, Campbell A, Linksted P, Fitzpatrick B, et al. Cohort profile: Generation Scotland: Scottish Family Health Study (GS:SFHS). The study, its participants and their potential for genetic research on health and illness. Int J Epidemiol. 2013;42(3):689\u2013700.","journal-title":"Int J Epidemiol"},{"key":"1556_CR35","unstructured":"https:\/\/saildatabank.com\/saildata\/sail-datasets\/"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-021-01556-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-021-01556-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-021-01556-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,6,15]],"date-time":"2021-06-15T02:02:43Z","timestamp":1623722563000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-021-01556-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,15]]},"references-count":35,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["1556"],"URL":"https:\/\/doi.org\/10.1186\/s12911-021-01556-0","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,15]]},"assertion":[{"value":"25 February 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 June 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 June 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"When this study was conducted, NA was senior epidemiologist and CLMS was chief scientist for the UK Biobank study. KR, HW, ST and WW have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"191"}}