{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T03:20:20Z","timestamp":1790824820483,"version":"4.1.0"},"reference-count":53,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T00:00:00Z","timestamp":1651104000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T00:00:00Z","timestamp":1651104000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["AG062517"],"award-info":[{"award-number":["AG062517"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["P30 AG010129"],"award-info":[{"award-number":["P30 AG010129"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["P30 AG013854"],"award-info":[{"award-number":["P30 AG013854"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["K08AG065463"],"award-info":[{"award-number":["K08AG065463"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["P30 AG066468"],"award-info":[{"award-number":["P30 AG066468"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["P50 AG005133"],"award-info":[{"award-number":["P50 AG005133"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["P30 AG012300"],"award-info":[{"award-number":["P30 AG012300"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014182","name":"McCune Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100014182","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Winspear Family Center for Research on the Neuropathology of Alzheimer Disease"},{"DOI":"10.13039\/100014576","name":"Office of the President, University of California","doi-asserted-by":"publisher","award":["MRI-19-599956"],"award-info":[{"award-number":["MRI-19-599956"]}],"id":[{"id":"10.13039\/100014576","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014989","name":"Chan Zuckerberg Initiative","doi-asserted-by":"publisher","award":["2018-191905"],"award-info":[{"award-number":["2018-191905"]}],"id":[{"id":"10.13039\/100014989","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100005002","name":"California Department of Public Health","doi-asserted-by":"publisher","award":["19-10611"],"award-info":[{"award-number":["19-10611"]}],"id":[{"id":"10.13039\/100005002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["acta neuropathol commun"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Pathologists can label pathologies differently, making it challenging to yield consistent assessments in the absence of one ground truth. To address this problem, we present a deep learning (DL) approach that draws on a cohort of experts, weighs each contribution, and is robust to noisy labels. We collected 100,495 annotations on 20,099 candidate amyloid beta neuropathologies (cerebral amyloid angiopathy (CAA), and cored and diffuse plaques) from three institutions, independently annotated by five experts. DL methods trained on a consensus-of-two strategy yielded 12.6\u201326% improvements by area under the precision recall curve (AUPRC) when compared to those that learned individualized annotations. This strategy surpassed individual-expert models, even when unfairly assessed on benchmarks favoring them. Moreover, ensembling over individual models was robust to hidden random annotators. In blind prospective tests of 52,555 subsequent expert-annotated images, the models labeled pathologies like their human counterparts (consensus model AUPRC\u2009=\u20090.74 cored; 0.69 CAA). This study demonstrates a means to combine multiple ground truths into a common-ground DL model that yields consistent diagnoses informed by multiple and potentially variable expert opinions.<\/jats:p>","DOI":"10.1186\/s40478-022-01365-0","type":"journal-article","created":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T11:04:25Z","timestamp":1651143865000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":32,"title":["Deep learning from multiple experts improves identification of amyloid neuropathologies"],"prefix":"10.1186","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3642-7674","authenticated-orcid":false,"given":"Daniel R.","family":"Wong","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0425-0173","authenticated-orcid":false,"given":"Ziqi","family":"Tang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9848-0396","authenticated-orcid":false,"given":"Nicholas C.","family":"Mew","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sakshi","family":"Das","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Justin","family":"Athey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0212-9823","authenticated-orcid":false,"given":"Kirsty E.","family":"McAleese","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julia K.","family":"Kofler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Margaret E.","family":"Flanagan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ewa","family":"Borys","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3870-2804","authenticated-orcid":false,"suffix":"III","given":"Charles L.","family":"White","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7433-2740","authenticated-orcid":false,"given":"Atul J.","family":"Butte","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2141-8855","authenticated-orcid":false,"given":"Brittany N.","family":"Dugger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1240-2192","authenticated-orcid":false,"given":"Michael J.","family":"Keiser","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,4,28]]},"reference":[{"key":"1365_CR1","doi-asserted-by":"publisher","first-page":"796","DOI":"10.1002\/(sici)1097-0142(19970215)79:4<796::aid-cncr17>3.0.co;2-v","volume":"79","author":"JM Bruner","year":"1997","unstructured":"Bruner JM, Inouye L, Fuller GN, Langford LA (1997) Diagnostic discrepancies and their clinical impact in a neuropathology referral practice. Cancer 79:796\u2013803. https:\/\/doi.org\/10.1002\/(sici)1097-0142(19970215)79:4%3c796::aid-cncr17%3e3.0.co;2-v","journal-title":"Cancer"},{"key":"1365_CR2","doi-asserted-by":"publisher","first-page":"474","DOI":"10.1016\/s0196-0644(96)70108-7","volume":"28","author":"JM Gill","year":"1996","unstructured":"Gill JM, Reese CL 4th, Diamond JJ (1996) Disagreement among health care professionals about the urgent care needs of emergency department patients. Ann Emerg Med 28:474\u2013479. https:\/\/doi.org\/10.1016\/s0196-0644(96)70108-7","journal-title":"Ann Emerg Med"},{"key":"1365_CR3","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1080\/0268869021000030267","volume":"16","author":"M Murphy","year":"2002","unstructured":"Murphy M, Loosemore A, Ferrer I, Wesseling P, Wilkins PR, Bell BA (2002) Neuropathological diagnostic accuracy. Br J Neurosurg 16:461\u2013464. https:\/\/doi.org\/10.1080\/0268869021000030267","journal-title":"Br J Neurosurg"},{"key":"1365_CR4","doi-asserted-by":"publisher","first-page":"1301","DOI":"10.1038\/s41591-019-0508-1","volume":"25","author":"G Campanella","year":"2019","unstructured":"Campanella G, Hanna MG, Geneslaw L, Miraflor A, Werneck Krauss Silva V, Busam KJ, Brogi E, Reuter VE, Klimstra DS, Fuchs TJ (2019) Clinical-grade computational pathology using weakly supervised deep learning on whole slide images. Nat Med 25:1301\u20131309. https:\/\/doi.org\/10.1038\/s41591-019-0508-1","journal-title":"Nat Med"},{"key":"1365_CR5","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1016\/j.jalz.2007.08.005","volume":"4","author":"GG Fillenbaum","year":"2008","unstructured":"Fillenbaum GG, van Belle G, Morris JC, Mohs RC, Mirra SS, Davis PC, Tariot PN, Silverman JM, Clark CM, Welsh-Bohmer KA, Heyman A (2008) Consortium to Establish a Registry for Alzheimer\u2019s Disease (CERAD): the first twenty years. Alzheimers Dement 4:96\u2013109. https:\/\/doi.org\/10.1016\/j.jalz.2007.08.005","journal-title":"Alzheimers Dement"},{"key":"1365_CR6","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1109\/RBME.2009.2034865","volume":"2","author":"MN Gurcan","year":"2009","unstructured":"Gurcan MN, Boucheron LE, Can A, Madabhushi A, Rajpoot NM, Yener B (2009) Histopathological image analysis: a review. IEEE Rev Biomed Eng 2:147\u2013171. https:\/\/doi.org\/10.1109\/RBME.2009.2034865","journal-title":"IEEE Rev Biomed Eng"},{"key":"1365_CR7","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1097\/00005072-199405000-00012","volume":"53","author":"SS Mirra","year":"1994","unstructured":"Mirra SS, Gearing M, McKeel DW Jr, Crain BJ, Hughes JP, van Belle G, Heyman A (1994) Interlaboratory comparison of neuropathology assessments in Alzheimer\u2019s disease: a study of the Consortium to Establish a Registry for Alzheimer\u2019s Disease (CERAD). J Neuropathol Exp Neurol 53:303\u2013315. https:\/\/doi.org\/10.1097\/00005072-199405000-00012","journal-title":"J Neuropathol Exp Neurol"},{"key":"1365_CR8","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1016\/j.trsl.2017.10.010","volume":"194","author":"S Robertson","year":"2018","unstructured":"Robertson S, Azizpour H, Smith K, Hartman J (2018) Digital image analysis in breast pathology-from image processing techniques to artificial intelligence. Transl Res 194:19\u201335. https:\/\/doi.org\/10.1016\/j.trsl.2017.10.010","journal-title":"Transl Res"},{"key":"1365_CR9","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1038\/s41746-019-0106-0","volume":"2","author":"S Sarwar","year":"2019","unstructured":"Sarwar S, Dent A, Faust K, Richer M, Djuric U, Van Ommeren R, Diamandis P (2019) Physician perspectives on integration of artificial intelligence into diagnostic pathology. NPJ Digit Med 2:28. https:\/\/doi.org\/10.1038\/s41746-019-0106-0","journal-title":"NPJ Digit Med"},{"key":"1365_CR10","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1146\/annurev-bioeng-071516-044442","volume":"19","author":"D Shen","year":"2017","unstructured":"Shen D, Wu G, Suk H-I (2017) Deep learning in medical image analysis. Annu Rev Biomed Eng 19:221\u2013248. https:\/\/doi.org\/10.1146\/annurev-bioeng-071516-044442","journal-title":"Annu Rev Biomed Eng"},{"issue":"Suppl 2","key":"1365_CR11","doi-asserted-by":"publisher","first-page":"ii21","DOI":"10.1136\/bmjqs-2012-001615","volume":"22","author":"ML Graber","year":"2013","unstructured":"Graber ML (2013) The incidence of diagnostic error in medicine. BMJ Qual Saf 22(Suppl 2):ii21\u2013ii27. https:\/\/doi.org\/10.1136\/bmjqs-2012-001615","journal-title":"BMJ Qual Saf"},{"key":"1365_CR12","doi-asserted-by":"publisher","first-page":"2491","DOI":"10.1056\/NEJMp1508044","volume":"373","author":"D Khullar","year":"2015","unstructured":"Khullar D, Jha AK, Jena AB (2015) Reducing diagnostic errors\u2013why now? N Engl J Med 373:2491\u20132493. https:\/\/doi.org\/10.1056\/NEJMp1508044","journal-title":"N Engl J Med"},{"key":"1365_CR13","doi-asserted-by":"publisher","first-page":"e194337","DOI":"10.1001\/jamanetworkopen.2019.4337","volume":"2","author":"DM Metter","year":"2019","unstructured":"Metter DM, Colgan TJ, Leung ST, Timmons CF, Park JY (2019) Trends in the US and Canadian pathologist workforces from 2007 to 2017. JAMA Netw Open 2:e194337. https:\/\/doi.org\/10.1001\/jamanetworkopen.2019.4337","journal-title":"JAMA Netw Open"},{"key":"1365_CR14","volume-title":"Meeting pathology demand. Histopathology workforce census","author":"Royal College of Pathologists","year":"2018","unstructured":"Royal College of Pathologists (2018) Meeting pathology demand. Histopathology workforce census. Royal College of Pathologists, London"},{"key":"1365_CR15","doi-asserted-by":"publisher","DOI":"10.1101\/cshperspect.a028035","author":"BN Dugger","year":"2017","unstructured":"Dugger BN, Dickson DW (2017) Pathology of neurodegenerative diseases. Cold Spring Harb Perspect Biol. https:\/\/doi.org\/10.1101\/cshperspect.a028035","journal-title":"Cold Spring Harb Perspect Biol"},{"key":"1365_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s00401-011-0910-3","volume":"123","author":"TJ Montine","year":"2012","unstructured":"Montine TJ, Phelps CH, Beach TG, Bigio EH, Cairns NJ, Dickson DW, Duyckaerts C, Frosch MP, Masliah E, Mirra SS, Nelson PT, Schneider JA, Thal DR, Trojanowski JQ, Vinters HV, Hyman BT, Institute N, on Aging, Alzheimer\u2019s Association, (2012) National Institute on Aging-Alzheimer\u2019s Association guidelines for the neuropathologic assessment of Alzheimer\u2019s disease: a practical approach. Acta Neuropathol 123:1\u201311. https:\/\/doi.org\/10.1007\/s00401-011-0910-3","journal-title":"Acta Neuropathol"},{"key":"1365_CR17","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1097\/00005072-199704000-00001","volume":"56","author":"DW Dickson","year":"1997","unstructured":"Dickson DW (1997) The pathogenesis of senile plaques. J Neuropathol Exp Neurol 56:321\u2013339. https:\/\/doi.org\/10.1097\/00005072-199704000-00001","journal-title":"J Neuropathol Exp Neurol"},{"key":"1365_CR18","first-page":"19","volume":"3","author":"S Love","year":"2014","unstructured":"Love S, Chalmers K, Ince P, Esiri M, Attems J, Jellinger K, Yamada M, McCarron M, Minett T, Matthews F, Greenberg S, Mann D, Kehoe PG (2014) Development, appraisal, validation and implementation of a consensus protocol for the assessment of cerebral amyloid angiopathy in post-mortem brain tissue. Am J Neurodegener Dis 3:19\u201332","journal-title":"Am J Neurodegener Dis"},{"key":"1365_CR19","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1016\/s0306-4522(01)00169-5","volume":"105","author":"TC Dickson","year":"2001","unstructured":"Dickson TC, Vickers JC (2001) The morphological phenotype of beta-amyloid plaques and associated neuritic changes in Alzheimer\u2019s disease. Neuroscience 105:99\u2013107. https:\/\/doi.org\/10.1016\/s0306-4522(01)00169-5","journal-title":"Neuroscience"},{"key":"1365_CR20","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1002\/ana.410300503","volume":"30","author":"JP Vonsattel","year":"1991","unstructured":"Vonsattel JP, Myers RH, Hedley-Whyte ET, Ropper AH, Bird ED, Richardson EP Jr (1991) Cerebral amyloid angiopathy without and with cerebral hemorrhages: a comparative histological study. Ann Neurol 30:637\u2013649. https:\/\/doi.org\/10.1002\/ana.410300503","journal-title":"Ann Neurol"},{"key":"1365_CR21","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1016\/s0891-0618(00)00077-6","volume":"20","author":"DP Perl","year":"2000","unstructured":"Perl DP, Good PF, Bussi\u00e8re T, Morrison JH, Erwin JM, Hof PR (2000) Practical approaches to stereology in the setting of aging- and disease-related brain banks. J Chem Neuroanat 20:7\u201319. https:\/\/doi.org\/10.1016\/s0891-0618(00)00077-6","journal-title":"J Chem Neuroanat"},{"key":"1365_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41467-019-10212-1","volume":"10","author":"Z Tang","year":"2019","unstructured":"Tang Z, Chuang KV, DeCarli C, Jin L-W, Beckett L, Keiser MJ, Dugger BN (2019) Interpretable classification of Alzheimer\u2019s disease pathologies with a convolutional neural network pipeline. Nat Commun 10:1\u201314. https:\/\/doi.org\/10.1038\/s41467-019-10212-1","journal-title":"Nat Commun"},{"key":"1365_CR23","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1186\/s40478-020-00927-4","volume":"8","author":"JC Vizcarra","year":"2020","unstructured":"Vizcarra JC, Gearing M, Keiser MJ, Glass JD, Dugger BN, Gutman DA (2020) Validation of machine learning models to detect amyloid pathologies across institutions. Acta Neuropathol Commun 8:59. https:\/\/doi.org\/10.1186\/s40478-020-00927-4","journal-title":"Acta Neuropathol Commun"},{"key":"1365_CR24","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1001\/jamainternmed.2018.7117","volume":"179","author":"F Wang","year":"2019","unstructured":"Wang F, Casalino LP, Khullar D (2019) Deep learning in medicine-promise, progress, and challenges. JAMA Intern Med 179:293\u2013294. https:\/\/doi.org\/10.1001\/jamainternmed.2018.7117","journal-title":"JAMA Intern Med"},{"key":"1365_CR25","doi-asserted-by":"crossref","unstructured":"Guan MY, Gulshan V, Dai AM, Hinton GE (2017) Who said what: modeling individual labelers improves classification. arXiv [cs.LG]","DOI":"10.1609\/aaai.v32i1.11756"},{"key":"1365_CR26","first-page":"20","volume":"28","author":"AP Dawid","year":"1979","unstructured":"Dawid AP, Skene AM (1979) Maximum likelihood estimation of observer error-rates using the EM algorithm. J R Stat Soc Ser C Appl Stat 28:20\u201328","journal-title":"J R Stat Soc Ser C Appl Stat"},{"key":"1365_CR27","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1186\/s12936-019-2662-9","volume":"18","author":"M Linares","year":"2019","unstructured":"Linares M, Postigo M, Cuadrado D, Ortiz-Ruiz A, Gil-Casanova S, Vladimirov A, Garc\u00eda-Villena J, Nu\u00f1ez-Escobedo JM, Mart\u00ednez-L\u00f3pez J, Rubio JM, Ledesma-Carbayo MJ, Santos A, Bassat Q, Luengo-Oroz M (2019) Collaborative intelligence and gamification for on-line malaria species differentiation. Malar J 18:21. https:\/\/doi.org\/10.1186\/s12936-019-2662-9","journal-title":"Malar J"},{"key":"1365_CR28","doi-asserted-by":"crossref","unstructured":"Raykar VC, Yu S, Zhao LH, Jerebko A, Florin C, Valadez GH, Bogoni L, Moy L (2009) Supervised learning from multiple experts: whom to trust when everyone lies a bit. In: Proceedings of the 26th annual international conference on machine learning. Association for Computing Machinery, New York, pp 889\u2013896","DOI":"10.1145\/1553374.1553488"},{"key":"1365_CR29","first-page":"1297","volume":"11","author":"VC Raykar","year":"2010","unstructured":"Raykar VC, Yu S, Zhao LH, Valadez GH, Florin C, Bogoni L, Moy L (2010) Learning from crowds. J Mach Learn Res 11:1297\u20131322","journal-title":"J Mach Learn Res"},{"key":"1365_CR30","first-page":"1085","volume-title":"Advances in neural information processing systems","author":"P Smyth","year":"1995","unstructured":"Smyth P, Fayyad UM, Burl MC, Perona P, Baldi P (1995) Inferring ground truth from subjective labelling of venus images. In: Tesauro G, Touretzky DS, Leen TK (eds) Advances in neural information processing systems, vol 7. MIT Press, Cambridge, pp 1085\u20131092"},{"key":"1365_CR31","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1109\/38.946629","volume":"21","author":"E Reinhard","year":"2001","unstructured":"Reinhard E, Adhikhmin M, Gooch B, Shirley P (2001) Color transfer between images. IEEE Comput Graph Appl 21:34\u201341. https:\/\/doi.org\/10.1109\/38.946629","journal-title":"IEEE Comput Graph Appl"},{"key":"1365_CR32","unstructured":"Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N, Antiga L, Desmaison A, K\u00f6pf A, Yang E, DeVito Z, Raison M, Tejani A, Chilamkurthy S, Steiner B, Fang L, Bai J, Chintala S (2019) PyTorch: an imperative style, high-performance deep learning library. arXiv [cs.LG]"},{"key":"1365_CR33","doi-asserted-by":"publisher","first-page":"eaat8603","DOI":"10.1126\/science.aat8603","volume":"362","author":"KV Chuang","year":"2018","unstructured":"Chuang KV, Keiser MJ (2018) Comment on \u201cPredicting reaction performance in C-N cross-coupling using machine learning.\u201d Science 362:eaat8603","journal-title":"Science"},{"key":"1365_CR34","doi-asserted-by":"publisher","first-page":"1418","DOI":"10.1161\/01.STR.28.7.1418","volume":"28","author":"SM Greenberg","year":"1997","unstructured":"Greenberg SM, Vonsattel J-P (1997) Diagnosis of cerebral amyloid angiopathy. Stroke 28:1418\u20131422. https:\/\/doi.org\/10.1161\/01.STR.28.7.1418","journal-title":"Stroke"},{"key":"1365_CR35","doi-asserted-by":"publisher","first-page":"282","DOI":"10.1093\/jnen\/61.3.282","volume":"61","author":"DR Thal","year":"2002","unstructured":"Thal DR, Ghebremedhin E, R\u00fcb U, Yamaguchi H, Del Tredici K, Braak H (2002) Two types of sporadic cerebral amyloid angiopathy. J Neuropathol Exp Neurol 61:282\u2013293. https:\/\/doi.org\/10.1093\/jnen\/61.3.282","journal-title":"J Neuropathol Exp Neurol"},{"key":"1365_CR36","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","volume":"22","author":"ML McHugh","year":"2012","unstructured":"McHugh ML (2012) Interrater reliability: the kappa statistic. Biochem Med 22:276\u2013282","journal-title":"Biochem Med"},{"key":"1365_CR37","first-page":"1097","volume-title":"Advances in neural information processing systems","author":"A Krizhevsky","year":"2012","unstructured":"Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Pereira F, Burges CJC, Bottou L, Weinberger KQ (eds) Advances in neural information processing systems, vol 25. Curran Associates Inc, Red Hook, pp 1097\u20131105"},{"key":"1365_CR38","first-page":"255","volume-title":"The handbook of brain theory and neural networks","author":"Y LeCun","year":"1998","unstructured":"LeCun Y, Bengio Y (1998) Convolutional networks for images, speech, and time series. The handbook of brain theory and neural networks. MIT Press, Cambridge, pp 255\u2013258"},{"key":"1365_CR39","doi-asserted-by":"publisher","first-page":"2278","DOI":"10.1109\/5.726791","volume":"86","author":"Y Lecun","year":"1998","unstructured":"Lecun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86:2278\u20132324. https:\/\/doi.org\/10.1109\/5.726791","journal-title":"Proc IEEE"},{"key":"1365_CR40","doi-asserted-by":"crossref","unstructured":"Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2016) Grad-CAM: visual explanations from deep networks via gradient-based localization. arXiv [cs.CV]","DOI":"10.1109\/ICCV.2017.74"},{"key":"1365_CR41","unstructured":"Simonyan K, Vedaldi A, Zisserman A (2013) Deep inside convolutional networks: visualising image classification models and saliency maps. arXiv [cs.CV]"},{"key":"1365_CR42","volume-title":"The wisdom of crowds","author":"J Surowiecki","year":"2005","unstructured":"Surowiecki J (2005) The wisdom of crowds. Anchor Books, New York"},{"key":"1365_CR43","doi-asserted-by":"crossref","unstructured":"Lines J, Taylor S, Bagnall A (2016) HIVE-COTE: the hierarchical vote collective of transformation-based ensembles for time series classification. In: IEEE 16th international conference on data mining (ICDM), pp 1041\u20131046","DOI":"10.1109\/ICDM.2016.0133"},{"key":"1365_CR44","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1109\/tip.2003.819861","volume":"13","author":"Z Wang","year":"2004","unstructured":"Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13:600\u2013612. https:\/\/doi.org\/10.1109\/tip.2003.819861","journal-title":"IEEE Trans Image Process"},{"key":"1365_CR45","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542:115\u2013118. https:\/\/doi.org\/10.1038\/nature21056","journal-title":"Nature"},{"key":"1365_CR46","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1186\/s40478-021-01235-1","volume":"9","author":"V Perosa","year":"2021","unstructured":"Perosa V, Scherlek AA, Kozberg MG, Smith L, Westerling-Bui T, Auger CA, Vasylechko S, Greenberg SM, van Veluw SJ (2021) Deep learning assisted quantitative assessment of histopathological markers of Alzheimer\u2019s disease and cerebral amyloid angiopathy. Acta Neuropathol Commun 9:141. https:\/\/doi.org\/10.1186\/s40478-021-01235-1","journal-title":"Acta Neuropathol Commun"},{"key":"1365_CR47","doi-asserted-by":"publisher","first-page":"1019","DOI":"10.1038\/s41374-019-0202-4","volume":"99","author":"M Signaevsky","year":"2019","unstructured":"Signaevsky M, Prastawa M, Farrell K, Tabish N, Baldwin E, Han N, Iida MA, Koll J, Bryce C, Purohit D, Haroutunian V, McKee AC, Stein TD, White CL 3rd, Walker J, Richardson TE, Hanson R, Donovan MJ, Cordon-Cardo C, Zeineh J, Fernandez G, Crary JF (2019) Artificial intelligence in neuropathology: deep learning-based assessment of tauopathy. Lab Invest 99:1019\u20131029. https:\/\/doi.org\/10.1038\/s41374-019-0202-4","journal-title":"Lab Invest"},{"key":"1365_CR48","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1007\/s10994-013-5412-1","volume":"95","author":"Y Yan","year":"2014","unstructured":"Yan Y, Rosales R, Fung G, Subramanian R, Dy J (2014) Learning from multiple annotators with varying expertise. Mach Learn 95:291\u2013327. https:\/\/doi.org\/10.1007\/s10994-013-5412-1","journal-title":"Mach Learn"},{"key":"1365_CR49","unstructured":"Settles B (2010) Active learning literature survey"},{"key":"1365_CR50","unstructured":"Adebayo J, Gilmer J, Muelly M, Goodfellow I, Hardt M, Kim B (2018) Sanity checks for saliency maps. arXiv [cs.CV]"},{"key":"1365_CR51","unstructured":"Gupta A, Arora S (2019) A simple saliency method that passes the sanity checks. arXiv [cs.LG]"},{"key":"1365_CR52","unstructured":"Sundararajan M, Taly A, Yan Q (2017) Axiomatic attribution for deep networks. arXiv [cs.LG]"},{"key":"1365_CR53","doi-asserted-by":"crossref","unstructured":"Zhao R, Ouyang W, Li H, Wang X (2015) Saliency detection by multi-context deep learning. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 1265\u20131274","DOI":"10.1109\/CVPR.2015.7298731"}],"container-title":["Acta Neuropathologica Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40478-022-01365-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40478-022-01365-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40478-022-01365-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,3]],"date-time":"2023-02-03T17:20:33Z","timestamp":1675444833000},"score":1,"resource":{"primary":{"URL":"https:\/\/actaneurocomms.biomedcentral.com\/articles\/10.1186\/s40478-022-01365-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,28]]},"references-count":53,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["1365"],"URL":"https:\/\/doi.org\/10.1186\/s40478-022-01365-0","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.03.12.435050","asserted-by":"object"}]},"ISSN":["2051-5960"],"issn-type":[{"value":"2051-5960","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,28]]},"assertion":[{"value":"10 April 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 April 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 April 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Materials utilized for these studies consisted of human post-mortem brain samples that were digitized into digital WSIs. Only living subjects are defined as Human Subjects under federal law (45 CFR 46, Protection of Human Subjects). All participants or a legal representative of the participant signed informed consent during the participant\u2019s life as part of the University of California Davis Alzheimer\u2019s Disease Research Center program. All human subject involvement was overseen and approved by the Institutional Review Board (IRB) at the University of California, Davis. All data followed current regulations, laws, and IRB guidelines as has been done previously [\n                      \n                      ].","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"66"}}