{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,11]],"date-time":"2026-11-11T05:48:05Z","timestamp":1794376085019,"version":"4.9.0"},"reference-count":69,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,12,18]],"date-time":"2023-12-18T00:00:00Z","timestamp":1702857600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,12,18]],"date-time":"2023-12-18T00:00:00Z","timestamp":1702857600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["R01AG062517"],"award-info":[{"award-number":["R01AG062517"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["P30AG072972"],"award-info":[{"award-number":["P30AG072972"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["K01AG070326"],"award-info":[{"award-number":["K01AG070326"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["R01AG056519"],"award-info":[{"award-number":["R01AG056519"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000065","name":"National Institute of Neurological Disorders and Stroke","doi-asserted-by":"publisher","award":["1U24NS133949-01"],"award-info":[{"award-number":["1U24NS133949-01"]}],"id":[{"id":"10.13039\/100000065","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["acta neuropathol commun"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Machine learning (ML) has increasingly been used to assist and expand current practices in neuropathology. However, generating large imaging datasets with quality labels is challenging in fields which demand high levels of expertise. Further complicating matters is the often seen disagreement between experts in neuropathology-related tasks, both at the case level and at a more granular level. Neurofibrillary tangles (NFTs) are a hallmark pathological feature of Alzheimer disease, and are associated with disease progression which warrants further investigation and granular quantification at a scale not currently accessible in routine human assessment. In this work, we first provide a baseline of annotator\/rater agreement for the tasks of Braak NFT staging between experts and NFT detection using both experts and novices in neuropathology. We use a whole-slide-image (WSI) cohort of neuropathology cases from Emory University Hospital immunohistochemically stained for Tau. We develop a workflow for gathering annotations of the early stage formation of NFTs (Pre-NFTs) and mature intracellular (iNFTs) and show\u00a0ML models can be trained to learn annotator nuances for the task of NFT detection in WSIs. We utilize a model-assisted-labeling approach and demonstrate ML models can be used to aid in labeling large datasets efficiently. We also show these models can be used to extract case-level features, which predict Braak NFT stages comparable to expert human raters, and do so at scale. This study provides a generalizable workflow for various pathology and related fields, and also provides a technique for accomplishing a high-level neuropathology task with limited human annotations.<\/jats:p>","DOI":"10.1186\/s40478-023-01691-x","type":"journal-article","created":{"date-parts":[[2023,12,18]],"date-time":"2023-12-18T11:02:32Z","timestamp":1702897352000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Toward a generalizable machine learning workflow for neurodegenerative\u00a0disease staging with focus on neurofibrillary tangles"],"prefix":"10.1186","volume":"11","author":[{"given":"Juan C.","family":"Vizcarra","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas M.","family":"Pearce","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brittany N.","family":"Dugger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael J.","family":"Keiser","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marla","family":"Gearing","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John F.","family":"Crary","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Evan J.","family":"Kiely","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Meaghan","family":"Morris","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bartholomew","family":"White","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan D.","family":"Glass","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kurt","family":"Farrell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1386-8701","authenticated-orcid":false,"given":"David A.","family":"Gutman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,12,18]]},"reference":[{"key":"1691_CR1","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1186\/s13195-014-0082-1","volume":"6","author":"J Rahimi","year":"2014","unstructured":"Rahimi J, Kovacs GG (2014) Prevalence of mixed pathologies in the aging brain. Alzheimers Res Ther 6:82. https:\/\/doi.org\/10.1186\/s13195-014-0082-1","journal-title":"Alzheimers Res Ther"},{"key":"1691_CR2","doi-asserted-by":"publisher","DOI":"10.1101\/cshperspect.a028035","author":"BN Dugger","year":"2017","unstructured":"Dugger BN, Dickson DW (2017) Pathology of neurodegenerative diseases. Cold Spring Harb Perspect Biol. https:\/\/doi.org\/10.1101\/cshperspect.a028035","journal-title":"Cold Spring Harb Perspect Biol"},{"key":"1691_CR3","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1186\/s13024-019-0333-5","volume":"14","author":"MA DeTure","year":"2019","unstructured":"DeTure MA, Dickson DW (2019) The neuropathological diagnosis of Alzheimer\u2019s disease. Mol Neurodegener 14:32. https:\/\/doi.org\/10.1186\/s13024-019-0333-5","journal-title":"Mol Neurodegener"},{"key":"1691_CR4","doi-asserted-by":"publisher","first-page":"1589","DOI":"10.1001\/jama.2019.4782","volume":"322","author":"Z Arvanitakis","year":"2019","unstructured":"Arvanitakis Z, Shah RC, Bennett DA (2019) Diagnosis and management of dementia: review. JAMA 322:1589\u20131599. https:\/\/doi.org\/10.1001\/jama.2019.4782","journal-title":"JAMA"},{"key":"1691_CR5","doi-asserted-by":"publisher","DOI":"10.1101\/cshperspect.a033118","author":"MG Erkkinen","year":"2018","unstructured":"Erkkinen MG, Kim M-O, Geschwind MD (2018) Clinical neurology and epidemiology of the major neurodegenerative diseases. Cold Spring Harb Perspect Biol. https:\/\/doi.org\/10.1101\/cshperspect.a033118","journal-title":"Cold Spring Harb Perspect Biol"},{"key":"1691_CR6","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1016\/j.jalz.2018.02.018","volume":"14","author":"CR Jack Jr","year":"2018","unstructured":"Jack CR Jr, Bennett DA, Blennow K, Carrillo MC, Dunn B, Haeberlein SB et al (2018) NIA-AA research framework: toward a biological definition of Alzheimer\u2019s disease. Alzheimers Dement 14:535\u2013562. https:\/\/doi.org\/10.1016\/j.jalz.2018.02.018","journal-title":"Alzheimers Dement"},{"key":"1691_CR7","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1007\/s00702-018-01967-w","volume":"126","author":"S Selvackadunco","year":"2019","unstructured":"Selvackadunco S, Langford K, Shah Z, Hurley S, Bodi I, King A et al (2019) Comparison of clinical and neuropathological diagnoses of neurodegenerative diseases in two centres from the Brains for dementia research (BDR) cohort. J Neural Transm 126:327\u2013337. https:\/\/doi.org\/10.1007\/s00702-018-01967-w","journal-title":"J Neural Transm"},{"key":"1691_CR8","doi-asserted-by":"publisher","DOI":"10.1002\/alz.12321","author":"CM Moloney","year":"2021","unstructured":"Moloney CM, Lowe VJ, Murray ME (2021) Visualization of neurofibrillary tangle maturity in Alzheimer\u2019s disease: a clinicopathologic perspective for biomarker research. Alzheimers Dement. https:\/\/doi.org\/10.1002\/alz.12321","journal-title":"Alzheimers Dement"},{"key":"1691_CR9","doi-asserted-by":"publisher","first-page":"957","DOI":"10.1007\/s00702-014-1304-1","volume":"122","author":"I Alafuzoff","year":"2015","unstructured":"Alafuzoff I, Pikkarainen M, Neumann M, Arzberger T, Al-Sarraj S, Bodi I et al (2015) Neuropathological assessments of the pathology in frontotemporal lobar degeneration with TDP43-positive inclusions: an inter-laboratory study by the BrainNet Europe consortium. J Neural Transm 122:957\u2013972. https:\/\/doi.org\/10.1007\/s00702-014-1304-1","journal-title":"J Neural Transm"},{"key":"1691_CR10","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1007\/s00401-009-0485-4","volume":"117","author":"I Alafuzoff","year":"2009","unstructured":"Alafuzoff I, Thal DR, Arzberger T, Bogdanovic N, Al-Sarraj S, Bodi I et al (2009) Assessment of beta-amyloid deposits in human brain: a study of the BrainNet Europe Consortium. Acta Neuropathol 117:309\u2013320. https:\/\/doi.org\/10.1007\/s00401-009-0485-4","journal-title":"Acta Neuropathol"},{"key":"1691_CR11","doi-asserted-by":"publisher","first-page":"153040","DOI":"10.1016\/j.prp.2020.153040","volume":"216","author":"JD Pallua","year":"2020","unstructured":"Pallua JD, Brunner A, Zelger B, Schirmer M, Haybaeck J (2020) The future of pathology is digital. Pathol Res Pract 216:153040. https:\/\/doi.org\/10.1016\/j.prp.2020.153040","journal-title":"Pathol Res Pract"},{"key":"1691_CR12","doi-asserted-by":"publisher","first-page":"1034","DOI":"10.1007\/s10278-020-00351-z","volume":"33","author":"N Kumar","year":"2020","unstructured":"Kumar N, Gupta R, Gupta S (2020) Whole slide imaging (WSI) in pathology: current perspectives and future directions. J Digit Imaging 33:1034\u20131040. https:\/\/doi.org\/10.1007\/s10278-020-00351-z","journal-title":"J Digit Imaging"},{"key":"1691_CR13","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1093\/jnen\/nlab122","volume":"81","author":"MN Shakir","year":"2022","unstructured":"Shakir MN, Dugger BN (2022) Advances in deep neuropathological phenotyping of Alzheimer disease: past, present, and future. J Neuropathol Exp Neurol 81:2\u201315. https:\/\/doi.org\/10.1093\/jnen\/nlab122","journal-title":"J Neuropathol Exp Neurol"},{"key":"1691_CR14","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1007\/BF00308809","volume":"82","author":"H Braak","year":"1991","unstructured":"Braak H, Braak E (1991) Neuropathological stageing of Alzheimer-related changes. Acta Neuropathol 82:239\u2013259. https:\/\/doi.org\/10.1007\/BF00308809","journal-title":"Acta Neuropathol"},{"key":"1691_CR15","doi-asserted-by":"crossref","unstructured":"Thal DR, R\u00fcb U, Orantes M, Braak H (2002) Phases of A\u03b2-deposition in the human brain and its relevance for the development of AD. Neurology. Available from: http:\/\/www.neurology.org\/content\/58\/12\/1791.short","DOI":"10.1212\/WNL.58.12.1791"},{"key":"1691_CR16","doi-asserted-by":"publisher","first-page":"635","DOI":"10.1007\/s00401-009-0523-2","volume":"117","author":"I Alafuzoff","year":"2009","unstructured":"Alafuzoff I, Ince PG, Arzberger T, Al-Sarraj S, Bell J, Bodi I et al (2009) Staging\/typing of Lewy body related alpha-synuclein pathology: a study of the BrainNet Europe Consortium. Acta Neuropathol 117:635\u2013652. https:\/\/doi.org\/10.1007\/s00401-009-0523-2","journal-title":"Acta Neuropathol"},{"key":"1691_CR17","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1002\/ana.23937","volume":"74","author":"J Brettschneider","year":"2013","unstructured":"Brettschneider J, Del Tredici K, Toledo JB, Robinson JL, Irwin DJ, Grossman M et al (2013) Stages of pTDP-43 pathology in amyotrophic lateral sclerosis. Ann Neurol 74:20\u201338. https:\/\/doi.org\/10.1002\/ana.23937","journal-title":"Ann Neurol"},{"key":"1691_CR18","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1007\/s00401-013-1238-y","volume":"127","author":"J Brettschneider","year":"2014","unstructured":"Brettschneider J, Del Tredici K, Irwin DJ, Grossman M, Robinson JL, Toledo JB et al (2014) Sequential distribution of pTDP-43 pathology in behavioral variant frontotemporal dementia (bvFTD). Acta Neuropathol 127:423\u2013439. https:\/\/doi.org\/10.1007\/s00401-013-1238-y","journal-title":"Acta Neuropathol"},{"key":"1691_CR19","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1002\/msj.20157","volume":"77","author":"DP Perl","year":"2010","unstructured":"Perl DP (2010) Neuropathology of Alzheimer\u2019s disease. Mt Sinai J Med 77:32\u201342. https:\/\/doi.org\/10.1002\/msj.20157","journal-title":"Mt Sinai J Med"},{"key":"1691_CR20","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/s13311-014-0313-y","volume":"12","author":"GK Gouras","year":"2015","unstructured":"Gouras GK, Olsson TT, Hansson O (2015) \u03b2-Amyloid peptides and amyloid plaques in Alzheimer\u2019s disease. Neurotherapeutics 12:3\u201311. https:\/\/doi.org\/10.1007\/s13311-014-0313-y","journal-title":"Neurotherapeutics"},{"key":"1691_CR21","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1097\/00005072-199704000-00001","volume":"56","author":"DW Dickson","year":"1997","unstructured":"Dickson DW (1997) The pathogenesis of senile plaques. J Neuropathol Exp Neurol 56:321\u2013339. https:\/\/doi.org\/10.1097\/00005072-199704000-00001","journal-title":"J Neuropathol Exp Neurol"},{"key":"1691_CR22","doi-asserted-by":"publisher","first-page":"441","DOI":"10.3233\/jad-2008-14413","volume":"14","author":"H Ding","year":"2008","unstructured":"Ding H, Johnson GVW (2008) The last tangle of tau. J Alzheimers Dis 14:441\u2013447. https:\/\/doi.org\/10.3233\/jad-2008-14413","journal-title":"J Alzheimers Dis"},{"key":"1691_CR23","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1016\/j.jalz.2007.08.005","volume":"4","author":"GG Fillenbaum","year":"2008","unstructured":"Fillenbaum GG, van Belle G, Morris JC, Mohs RC, Mirra SS, Davis PC et al (2008) Consortium to establish a registry for Alzheimer\u2019s disease (CERAD): the first twenty years. Alzheimers Dement 4:96\u2013109. https:\/\/doi.org\/10.1016\/j.jalz.2007.08.005","journal-title":"Alzheimers Dement"},{"key":"1691_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.jalz.2011.10.007","volume":"8","author":"BT Hyman","year":"2012","unstructured":"Hyman BT, Phelps CH, Beach TG, Bigio EH, Cairns NJ, Carrillo MC et al (2012) National Institute on Aging\u2013Alzheimer\u2019s Association guidelines for the neuropathologic assessment of Alzheimer\u2019s disease. Alzheimers Dement 8:1\u201313. https:\/\/doi.org\/10.1016\/j.jalz.2011.10.007","journal-title":"Alzheimers Dement"},{"key":"1691_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s00401-011-0910-3","volume":"123","author":"TJ Montine","year":"2012","unstructured":"Montine TJ, Phelps CH, Beach TG, Bigio EH, Cairns NJ, Dickson DW et al (2012) National Institute on Aging\u2013Alzheimer\u2019s Association guidelines for the neuropathologic assessment of Alzheimer\u2019s disease: a practical approach. Acta Neuropathol 123:1\u201311. https:\/\/doi.org\/10.1007\/s00401-011-0910-3","journal-title":"Acta Neuropathol"},{"key":"1691_CR26","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1007\/pl00007425","volume":"99","author":"AJ Harding","year":"2000","unstructured":"Harding AJ, Kril JJ, Halliday GM (2000) Practical measures to simplify the Braak tangle staging method for routine pathological screening. Acta Neuropathol 99:199\u2013208. https:\/\/doi.org\/10.1007\/pl00007425","journal-title":"Acta Neuropathol"},{"key":"1691_CR27","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1007\/s00401-006-0127-z","volume":"112","author":"H Braak","year":"2006","unstructured":"Braak H, Alafuzoff I, Arzberger T, Kretzschmar H, Del Tredici K (2006) Staging of Alzheimer disease-associated neurofibrillary pathology using paraffin sections and immunocytochemistry. Acta Neuropathol 112:389\u2013404. https:\/\/doi.org\/10.1007\/s00401-006-0127-z","journal-title":"Acta Neuropathol"},{"key":"1691_CR28","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1016\/j.jalz.2015.07.492","volume":"12","author":"TJ Montine","year":"2016","unstructured":"Montine TJ, Monsell SE, Beach TG, Bigio EH, Bu Y, Cairns NJ et al (2016) Multisite assessment of NIA-AA guidelines for the neuropathologic evaluation of Alzheimer\u2019s disease. Alzheimers Dement 12:164\u2013169. https:\/\/doi.org\/10.1016\/j.jalz.2015.07.492","journal-title":"Alzheimers Dement"},{"key":"1691_CR29","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.conb.2019.11.008","volume":"61","author":"K Del Tredici","year":"2020","unstructured":"Del Tredici K, Braak H (2020) To stage, or not to stage. Curr Opin Neurobiol 61:10\u201322. https:\/\/doi.org\/10.1016\/j.conb.2019.11.008","journal-title":"Curr Opin Neurobiol"},{"key":"1691_CR30","doi-asserted-by":"publisher","first-page":"486","DOI":"10.1016\/j.jalz.2011.04.011","volume":"7","author":"P Scheltens","year":"2011","unstructured":"Scheltens P, Rockwood K (2011) How golden is the gold standard of neuropathology in dementia? Alzheimers Dement 7:486\u2013489. https:\/\/doi.org\/10.1016\/j.jalz.2011.04.011","journal-title":"Alzheimers Dement"},{"key":"1691_CR31","first-page":"6","volume":"4","author":"JC Vizcarra","year":"2023","unstructured":"Vizcarra JC, Teich A, Dugger B, Gutman D (2023) Survey of neuroanatomic sampling and staining procedures in Alzheimer disease research center brain banks. Free Neuropathol 4:6\u20136","journal-title":"Free Neuropathol"},{"key":"1691_CR32","doi-asserted-by":"publisher","DOI":"10.1089\/bio.2022.0022","author":"KL Lucot","year":"2022","unstructured":"Lucot KL, Suarez W, Mifflin K, DeCarli C, La Grande J, Dugger BN (2022) Assessment of current practices across Alzheimer\u2019s disease research centers biorepositories. Biopreserv Biobank. https:\/\/doi.org\/10.1089\/bio.2022.0022","journal-title":"Biopreserv Biobank"},{"key":"1691_CR33","doi-asserted-by":"publisher","first-page":"e13","DOI":"10.1016\/j.ejim.2017.06.017","volume":"48","author":"C Krittanawong","year":"2018","unstructured":"Krittanawong C (2018) The rise of artificial intelligence and the uncertain future for physicians. Eur J Intern Med 48:e13\u2013e14. https:\/\/doi.org\/10.1016\/j.ejim.2017.06.017","journal-title":"Eur J Intern Med"},{"key":"1691_CR34","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1007\/s12551-018-0449-9","volume":"11","author":"JA Nichols","year":"2019","unstructured":"Nichols JA, Herbert Chan HW, Baker MAB (2019) Machine learning: applications of artificial intelligence to imaging and diagnosis. Biophys Rev 11:111\u2013118. https:\/\/doi.org\/10.1007\/s12551-018-0449-9","journal-title":"Biophys Rev"},{"key":"1691_CR35","doi-asserted-by":"publisher","unstructured":"Wong DR, Tang Z, Mew NC, Das S, Athey J, McAleese KE et al (2021) Deep learning from multiple experts improves identification of amyloid neuropathologies. bioRxiv, p 2021.03.12.435050. Available from: https:\/\/www.biorxiv.org\/content\/https:\/\/doi.org\/10.1101\/2021.03.12.435050v1","DOI":"10.1101\/2021.03.12.435050v1"},{"key":"1691_CR36","doi-asserted-by":"publisher","first-page":"2173","DOI":"10.1038\/s41467-019-10212-1","volume":"10","author":"Z Tang","year":"2019","unstructured":"Tang Z, Chuang KV, DeCarli C, Jin L-W, Beckett L, Keiser MJ et al (2019) Interpretable classification of Alzheimer\u2019s disease pathologies with a convolutional neural network pipeline. Nat Commun 10:2173. https:\/\/doi.org\/10.1038\/s41467-019-10212-1","journal-title":"Nat Commun"},{"key":"1691_CR37","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1186\/s40478-020-00927-4","volume":"8","author":"JC Vizcarra","year":"2020","unstructured":"Vizcarra JC, Gearing M, Keiser MJ, Glass JD, Dugger BN, Gutman DA (2020) Validation of machine learning models to detect amyloid pathologies across institutions. Acta Neuropathol Commun 8:59. https:\/\/doi.org\/10.1186\/s40478-020-00927-4","journal-title":"Acta Neuropathol Commun"},{"key":"1691_CR38","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1186\/s40478-022-01457-x","volume":"10","author":"GA Marx","year":"2022","unstructured":"Marx GA, Koenigsberg DG, McKenzie AT, Kauffman J, Hanson RW, Whitney K et al (2022) Artificial intelligence-derived neurofibrillary tangle burden is associated with antemortem cognitive impairment. Acta Neuropathol Commun 10:157. https:\/\/doi.org\/10.1186\/s40478-022-01457-x","journal-title":"Acta Neuropathol Commun"},{"key":"1691_CR39","doi-asserted-by":"publisher","DOI":"10.1038\/s41374-019-0202-4","author":"M Signaevsky","year":"2019","unstructured":"Signaevsky M, Prastawa M, Farrell K, Tabish N, Baldwin E, Han N et al (2019) Artificial intelligence in neuropathology: deep learning-based assessment of tauopathy. Lab Invest. https:\/\/doi.org\/10.1038\/s41374-019-0202-4","journal-title":"Lab Invest"},{"key":"1691_CR40","doi-asserted-by":"publisher","DOI":"10.1093\/jnen\/nlac132","author":"LC Oliveira","year":"2023","unstructured":"Oliveira LC, Lai Z, Harvey D, Nzenkue K, Jin L-W, Decarli C et al (2023) Preanalytic variable effects on segmentation and quantification machine learning algorithms for amyloid-\u03b2 analyses on digitized human brain slides. J Neuropathol Exp Neurol. https:\/\/doi.org\/10.1093\/jnen\/nlac132","journal-title":"J Neuropathol Exp Neurol"},{"key":"1691_CR41","doi-asserted-by":"publisher","first-page":"264","DOI":"10.3389\/fmed.2019.00264","volume":"6","author":"N Dimitriou","year":"2019","unstructured":"Dimitriou N, Arandjelovi\u0107 O, Caie PD (2019) Deep learning for whole slide image analysis: an overview. Front Med 6:264. https:\/\/doi.org\/10.3389\/fmed.2019.00264","journal-title":"Front Med"},{"key":"1691_CR42","doi-asserted-by":"publisher","first-page":"3461","DOI":"10.1093\/bioinformatics\/btz083","volume":"35","author":"M Amgad","year":"2019","unstructured":"Amgad M, Elfandy H, Hussein H, Atteya LA, Elsebaie MAT, Abo Elnasr LS et al (2019) Structured crowdsourcing enables convolutional segmentation of histology images. Bioinformatics 35:3461\u20133467. https:\/\/doi.org\/10.1093\/bioinformatics\/btz083","journal-title":"Bioinformatics"},{"key":"1691_CR43","doi-asserted-by":"publisher","first-page":"43286","DOI":"10.1038\/srep43286","volume":"7","author":"H Irshad","year":"2017","unstructured":"Irshad H, Oh E-Y, Schmolze D, Quintana LM, Collins L, Tamimi RM et al (2017) Crowdsourcing scoring of immunohistochemistry images: evaluating performance of the crowd and an automated computational method. Sci Rep 7:43286. https:\/\/doi.org\/10.1038\/srep43286","journal-title":"Sci Rep"},{"issue":"Suppl 1","key":"1691_CR44","doi-asserted-by":"publisher","first-page":"S6","DOI":"10.1186\/1746-1596-9-S1-S6","volume":"9","author":"V Della Mea","year":"2014","unstructured":"Della Mea V, Maddalena E, Mizzaro S, Machin P, Beltrami CA (2014) Preliminary results from a crowdsourcing experiment in immunohistochemistry. Diagn Pathol 9(Suppl 1):S6. https:\/\/doi.org\/10.1186\/1746-1596-9-S1-S6","journal-title":"Diagn Pathol"},{"key":"1691_CR45","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1038\/bjc.2016.404","volume":"116","author":"J Lawson","year":"2017","unstructured":"Lawson J, Robinson-Vyas RJ, McQuillan JP, Paterson A, Christie S, Kidza-Griffiths M et al (2017) Crowdsourcing for translational research: analysis of biomarker expression using cancer microarrays. Br J Cancer 116:237\u2013245. https:\/\/doi.org\/10.1038\/bjc.2016.404","journal-title":"Br J Cancer"},{"key":"1691_CR46","doi-asserted-by":"publisher","first-page":"632","DOI":"10.1016\/j.procs.2018.05.062","volume":"132","author":"BS Abhigna","year":"2018","unstructured":"Abhigna BS, Soni N, Dixit S (2018) Crowdsourcing\u2014a step towards advanced machine learning. Procedia Comput Sci 132:632\u2013642","journal-title":"Procedia Comput Sci"},{"key":"1691_CR47","doi-asserted-by":"publisher","unstructured":"Gurari D, Theriault D, Sameki M, Isenberg B, Pham TA, Purwada A et al (2015) How to collect segmentations for biomedical images? A benchmark evaluating the performance of experts, crowdsourced non-experts, and algorithms. In: 2015 IEEE Winter conference on applications of computer vision, p 1169\u201376. https:\/\/doi.org\/10.1109\/WACV.2015.160","DOI":"10.1109\/WACV.2015.160"},{"key":"1691_CR48","doi-asserted-by":"publisher","first-page":"668","DOI":"10.1038\/s42003-023-05031-6","volume":"6","author":"DR Wong","year":"2023","unstructured":"Wong DR, Magaki SD, Vinters HV, Yong WH, Monuki ES, Williams CK et al (2023) Learning fast and fine-grained detection of amyloid neuropathologies from coarse-grained expert labels. Commun Biol 6:668. https:\/\/doi.org\/10.1038\/s42003-023-05031-6","journal-title":"Commun Biol"},{"key":"1691_CR49","doi-asserted-by":"publisher","DOI":"10.1093\/jnen\/nlab005","author":"S Koga","year":"2021","unstructured":"Koga S, Ghayal NB, Dickson DW (2021) Deep learning-based image classification in differentiating tufted astrocytes, astrocytic plaques, and neuritic plaques. J Neuropathol Exp Neurol. https:\/\/doi.org\/10.1093\/jnen\/nlab005","journal-title":"J Neuropathol Exp Neurol"},{"key":"1691_CR50","doi-asserted-by":"publisher","first-page":"e75","DOI":"10.1158\/0008-5472.CAN-17-0629","volume":"77","author":"DA Gutman","year":"2017","unstructured":"Gutman DA, Khalilia M, Lee S, Nalisnik M, Mullen Z, Beezley J et al (2017) The Digital slide archive: a software platform for management, integration, and analysis of histology for cancer research. Cancer Res 77:e75\u2013e78. https:\/\/doi.org\/10.1158\/0008-5472.CAN-17-0629","journal-title":"Cancer Res"},{"key":"1691_CR51","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/001316446002000104","volume":"20","author":"J Cohen","year":"1960","unstructured":"Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20:37\u201346. https:\/\/doi.org\/10.1177\/001316446002000104","journal-title":"Educ Psychol Meas"},{"key":"1691_CR52","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611970319","author":"B Efron","year":"1982","unstructured":"Efron B (1982) The Jackknife, the bootstrap and other resampling plans. Soc Ind Appl Math. https:\/\/doi.org\/10.1137\/1.9781611970319","journal-title":"Soc Ind Appl Math"},{"key":"1691_CR53","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1007\/s004010100423","volume":"103","author":"JC Augustinack","year":"2002","unstructured":"Augustinack JC, Schneider A, Mandelkow E-M, Hyman BT (2002) Specific tau phosphorylation sites correlate with severity of neuronal cytopathology in Alzheimer\u2019s disease. Acta Neuropathol 103:26\u201335. https:\/\/doi.org\/10.1007\/s004010100423","journal-title":"Acta Neuropathol"},{"key":"1691_CR54","doi-asserted-by":"publisher","first-page":"123","DOI":"10.3390\/jimaging4100123","volume":"4","author":"AS Kornilov","year":"2018","unstructured":"Kornilov AS, Safonov IV (2018) An overview of watershed algorithm implementations in open source libraries. J Imaging 4:123","journal-title":"J Imaging"},{"key":"1691_CR55","doi-asserted-by":"publisher","first-page":"101185","DOI":"10.1016\/j.ecoinf.2020.101185","volume":"61","author":"PN Duc","year":"2021","unstructured":"Duc PN, Torterotot M, Samaran F, White PR, G\u00e9rard O, Adam O, Cazau D (2021) Assessing inter-annotator agreement from collaborative annotation campaign in marine bioacoustics. Ecol Inf 61:101185","journal-title":"Ecol Inf"},{"key":"1691_CR56","doi-asserted-by":"publisher","unstructured":"Braylan A, Alonso O, Lease M (2022) Measuring Annotator agreement generally across complex structured, multi-object, and free-text annotation tasks. In: Proceedings of the ACM web conference 2022. Association for Computing Machinery, New York, pp 1720\u201330. Available from: https:\/\/doi.org\/10.1145\/3485447.3512242","DOI":"10.1145\/3485447.3512242"},{"key":"1691_CR57","doi-asserted-by":"crossref","unstructured":"Redmon J, Divvala S, Girshick R, Farhadi A (2015) You only look once: unified, real-time object detection. arXiv [cs.CV]. Available from: http:\/\/arxiv.org\/abs\/1506.02640","DOI":"10.1109\/CVPR.2016.91"},{"key":"1691_CR58","doi-asserted-by":"publisher","unstructured":"Du J (2018) Understanding of object detection based on CNN family and YOLO. In: Journal of Physics Conference Series 1004:012029. Available from: https:\/\/iopscience.iop.org\/article\/https:\/\/doi.org\/10.1088\/1742-6596\/1004\/1\/012029\/meta","DOI":"10.1088\/1742-6596\/1004\/1\/012029\/meta"},{"key":"1691_CR59","unstructured":"Jocher G, Stoken A, Borovec J, NanoCode, Chaurasia A, TaoXie et al (2021) ultralytics\/yolov5: v5.0 - YOLOv5-P6 1280 models, AWS, Supervise.ly and YouTube integrations. Available from: https:\/\/zenodo.org\/record\/4679653"},{"key":"1691_CR60","doi-asserted-by":"publisher","first-page":"2825","DOI":"10.5555\/1953048.2078195","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O et al (2011) Scikit-learn: machine learning in python. J Mach Learn Res 12:2825\u20132830. https:\/\/doi.org\/10.5555\/1953048.2078195","journal-title":"J Mach Learn Res"},{"key":"1691_CR61","doi-asserted-by":"crossref","unstructured":"Seabold S, Perktold J (2010) Statsmodels: econometric and statistical modeling with python. In: Proceedings of the 9th python in science conference. SciPy. Available from: http:\/\/conference.scipy.org\/proceedings\/scipy2010\/pdfs\/seabold.pdf","DOI":"10.25080\/Majora-92bf1922-011"},{"key":"1691_CR62","doi-asserted-by":"publisher","first-page":"571","DOI":"10.1111\/neup.12108","volume":"34","author":"T Uchihara","year":"2014","unstructured":"Uchihara T (2014) Pretangles and neurofibrillary changes: similarities and differences between AD and CBD based on molecular and morphological evolution. Neuropathology 34:571\u2013577. https:\/\/doi.org\/10.1111\/neup.12108","journal-title":"Neuropathology"},{"key":"1691_CR63","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1038\/s42256-019-0018-3","volume":"1","author":"B Lutnick","year":"2019","unstructured":"Lutnick B, Ginley B, Govind D, McGarry SD, LaViolette PS, Yacoub R et al (2019) An integrated iterative annotation technique for easing neural network training in medical image analysis. Nat Mach Intell 1:112\u2013119. https:\/\/doi.org\/10.1038\/s42256-019-0018-3","journal-title":"Nat Mach Intell"},{"key":"1691_CR64","first-page":"2498","volume":"9","author":"T Huxohl","year":"2021","unstructured":"Huxohl T, Kummert F (2021) Model-assisted labeling and self-training for label noise reduction in the detection of stains on images of laundry. Sci China Ser A Math 9:2498","journal-title":"Sci China Ser A Math"},{"key":"1691_CR65","doi-asserted-by":"publisher","first-page":"100127","DOI":"10.1016\/j.labinv.2023.100127","volume":"103","author":"M Kim","year":"2023","unstructured":"Kim M, Sekiya H, Yao G, Martin NB, Castanedes-Casey M, Dickson DW et al (2023) Diagnosis of Alzheimer disease and tauopathies on whole-slide histopathology images using a weakly supervised deep learning algorithm. Lab Invest 103:100127. https:\/\/doi.org\/10.1016\/j.labinv.2023.100127","journal-title":"Lab Invest"},{"key":"1691_CR66","doi-asserted-by":"crossref","unstructured":"Lindeberg T (2012) Scale invariant feature transform, 7:10491. Available from: https:\/\/www.diva-portal.org\/smash\/record.jsf?pid=diva2%3A480321&dswid=6154","DOI":"10.4249\/scholarpedia.10491"},{"key":"1691_CR67","doi-asserted-by":"publisher","first-page":"A87","DOI":"10.1051\/0004-6361\/202243135","volume":"666","author":"PAC Cunha","year":"2022","unstructured":"Cunha PAC, Humphrey A (2022) Photometric redshift-aided classification using ensemble learning. Astron Astrophys Suppl Ser 666:A87","journal-title":"Astron Astrophys Suppl Ser"},{"key":"1691_CR68","doi-asserted-by":"publisher","first-page":"20","DOI":"10.3847\/1538-4365\/ab8868\/meta","volume":"248","author":"R Hausen","year":"2020","unstructured":"Hausen R, Robertson BE (2020) Morpheus: a deep learning framework for the pixel-level analysis of astronomical image data. ApJS 248:20. https:\/\/doi.org\/10.3847\/1538-4365\/ab8868\/meta","journal-title":"ApJS"},{"key":"1691_CR69","doi-asserted-by":"publisher","DOI":"10.3390\/cancers14133215","author":"B Lobato-Delgado","year":"2022","unstructured":"Lobato-Delgado B, Priego-Torres B, Sanchez-Morillo D (2022) Combining molecular, imaging, and clinical data analysis for predicting cancer prognosis. Cancers. https:\/\/doi.org\/10.3390\/cancers14133215","journal-title":"Cancers"}],"container-title":["Acta Neuropathologica Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40478-023-01691-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40478-023-01691-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40478-023-01691-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,18]],"date-time":"2023-12-18T11:11:48Z","timestamp":1702897908000},"score":1,"resource":{"primary":{"URL":"https:\/\/actaneurocomms.biomedcentral.com\/articles\/10.1186\/s40478-023-01691-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,18]]},"references-count":69,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["1691"],"URL":"https:\/\/doi.org\/10.1186\/s40478-023-01691-x","relation":{},"ISSN":["2051-5960"],"issn-type":[{"value":"2051-5960","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,18]]},"assertion":[{"value":"11 September 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 November 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 December 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All imaging data was obtained from autopsied individuals whose next-of-kin consented to autopsy at the time of death per relevant\/local laws (see methods for additional details).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Dr. Gutman has done consulting work with Histowiz Inc LLC and is a founder of SwitchboardMD.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"202"}}