{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T09:16:53Z","timestamp":1776935813955,"version":"3.51.4"},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,5,1]],"date-time":"2020-05-01T00:00:00Z","timestamp":1588291200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,5,1]],"date-time":"2020-05-01T00:00:00Z","timestamp":1588291200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Histopathological diagnosis of lymphomas represents a challenge requiring either expertise or centralised review, and greatly depends on the technical process of tissue sections. Hence, we developed an innovative deep-learning framework, empowered with a certainty estimation level, designed for haematoxylin and eosin-stained slides analysis, with special focus on follicular lymphoma (FL) diagnosis. Whole-slide images of lymph nodes affected by FL or follicular hyperplasia were used for training, validating, and finally testing Bayesian neural networks (BNN). These BNN provide a diagnostic prediction coupled with an effective certainty estimation, and generate accurate diagnosis with an area under the curve reaching 0.99. Through its uncertainty estimation, our network is also able to detect unfamiliar data such as other small B cell lymphomas or technically heterogeneous cases from external centres. We demonstrate that machine-learning techniques are sensitive to the pre-processing of histopathology slides and require appropriate training to build universal tools to aid diagnosis.<\/jats:p>","DOI":"10.1038\/s41746-020-0272-0","type":"journal-article","created":{"date-parts":[[2020,5,1]],"date-time":"2020-05-01T10:02:39Z","timestamp":1588327359000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":93,"title":["Accurate diagnosis of lymphoma on whole-slide histopathology images using deep learning"],"prefix":"10.1038","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3201-6109","authenticated-orcid":false,"given":"Charlotte","family":"Syrykh","sequence":"first","affiliation":[]},{"given":"Arnaud","family":"Abreu","sequence":"additional","affiliation":[]},{"given":"Nadia","family":"Amara","sequence":"additional","affiliation":[]},{"given":"Aurore","family":"Siegfried","sequence":"additional","affiliation":[]},{"given":"V\u00e9ronique","family":"Maisongrosse","sequence":"additional","affiliation":[]},{"given":"Fran\u00e7ois X.","family":"Frenois","sequence":"additional","affiliation":[]},{"given":"Laurent","family":"Martin","sequence":"additional","affiliation":[]},{"given":"C\u00e9dric","family":"Rossi","sequence":"additional","affiliation":[]},{"given":"Camille","family":"Laurent","sequence":"additional","affiliation":[]},{"given":"Pierre","family":"Brousset","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,5,1]]},"reference":[{"key":"272_CR1","doi-asserted-by":"publisher","first-page":"2008","DOI":"10.1200\/JCO.2016.71.2083","volume":"35","author":"C Laurent","year":"2017","unstructured":"Laurent, C. et al. Impact of expert pathologic review of lymphoma diagnosis: study of patients from the French Lymphopath Network. J. Clin. Oncol. 35, 2008\u20132017 (2017).","journal-title":"J. Clin. Oncol."},{"key":"272_CR2","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1111\/bjh.12880","volume":"166","author":"JM Bowen","year":"2014","unstructured":"Bowen, J. M. et al. Lymphoma diagnosis at an academic centre: rate of revision and impact on patient care. Br. J. Haematol. 166, 202\u2013208 (2014).","journal-title":"Br. J. Haematol."},{"key":"272_CR3","doi-asserted-by":"publisher","first-page":"463","DOI":"10.1046\/j.1365-2141.2003.04629.x","volume":"123","author":"JF Lester","year":"2003","unstructured":"Lester, J. F. et al. The clinical impact of expert pathological review on lymphoma management: a regional experience. Br. J. Haematol. 123, 463\u2013468 (2003).","journal-title":"Br. J. Haematol."},{"key":"272_CR4","doi-asserted-by":"publisher","first-page":"1431","DOI":"10.1200\/JCO.2010.31.2223","volume":"29","author":"IE Proctor","year":"2011","unstructured":"Proctor, I. E., McNamara, C., Rodriguez-Justo, M., Isaacson, P. G. & Ramsay, A. Importance of expert central review in the diagnosis of lymphoid malignancies in a regional cancer network. J. Clin. Oncol. 29, 1431\u20131435 (2011).","journal-title":"J. Clin. Oncol."},{"key":"272_CR5","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1093\/annonc\/mdr029","volume":"23","author":"MJ Matasar","year":"2012","unstructured":"Matasar, M. J. et al. Expert second-opinion pathology review of lymphoma in the era of the World Health Organization classification. Ann. Oncol. 23, 159\u2013166 (2012).","journal-title":"Ann. Oncol."},{"key":"272_CR6","doi-asserted-by":"publisher","first-page":"466","DOI":"10.1136\/jcp.2010.080846","volume":"64","author":"BS Wilkins","year":"2011","unstructured":"Wilkins, B. S. Pitfalls in lymphoma pathology: avoiding errors in diagnosis of lymphoid tissues. J. Clin. Pathol. 64, 466\u2013476 (2011).","journal-title":"J. Clin. Pathol."},{"key":"272_CR7","doi-asserted-by":"publisher","DOI":"10.1038\/srep46450","volume":"7","author":"A Cruz-Roa","year":"2017","unstructured":"Cruz-Roa, A. et al. Accurate and reproducible invasive breast cancer detection in whole-slide images: a Deep Learning approach for quantifying tumor extent. Sci. Rep. 7, 46450 (2017).","journal-title":"Sci. Rep."},{"key":"272_CR8","doi-asserted-by":"publisher","first-page":"29","DOI":"10.4103\/2153-3539.186902","volume":"7","author":"A Janowczyk","year":"2016","unstructured":"Janowczyk, A. & Madabhushi, A. Deep learning for digital pathology image analysis: a comprehensive tutorial with selected use cases. J. Pathol. Inf. 7, 29 (2016).","journal-title":"J. Pathol. Inf."},{"key":"272_CR9","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/j.csbj.2018.01.001","volume":"16","author":"D Komura","year":"2018","unstructured":"Komura, D. & Ishikawa, S. Machine learning methods for histopathological image analysis. Comput. Struct. Biotechnol. J. 16, 34\u201342 (2018).","journal-title":"Comput. Struct. Biotechnol. J."},{"key":"272_CR10","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/j.trecan.2019.02.002","volume":"5","author":"AB Levine","year":"2019","unstructured":"Levine, A. B. et al. Rise of the machines: advances in deep learning for cancer diagnosis. Trends Cancer 5, 157\u2013169 (2019).","journal-title":"Trends Cancer"},{"key":"272_CR11","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1016\/j.ebiom.2017.12.026","volume":"27","author":"P Khosravi","year":"2018","unstructured":"Khosravi, P., Kazemi, E., Imielinski, M., Elemento, O. & Hajirasouliha, I. Deep convolutional neural networks enable discrimination of heterogeneous digital pathology images. EBioMedicine 27, 317\u2013328 (2018).","journal-title":"EBioMedicine"},{"key":"272_CR12","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1038\/s42256-019-0052-1","volume":"1","author":"Z Zhang","year":"2019","unstructured":"Zhang, Z. et al. Pathologist-level interpretable whole-slide cancer diagnosis with deep learning. Nat. Mach. Intell. 1, 236 (2019).","journal-title":"Nat. Mach. Intell."},{"key":"272_CR13","doi-asserted-by":"publisher","first-page":"2199","DOI":"10.1001\/jama.2017.14585","volume":"318","author":"B Ehteshami Bejnordi","year":"2017","unstructured":"Ehteshami Bejnordi, B. et al. Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer. JAMA 318, 2199\u20132210 (2017).","journal-title":"JAMA"},{"key":"272_CR14","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms12474","volume":"7","author":"K-H Yu","year":"2016","unstructured":"Yu, K.-H. et al. Predicting non-small cell lung cancer prognosis by fully automated microscopic pathology image features. Nat. Commun. 7, 12474 (2016).","journal-title":"Nat. Commun."},{"key":"272_CR15","doi-asserted-by":"publisher","first-page":"1559","DOI":"10.1038\/s41591-018-0177-5","volume":"24","author":"N Coudray","year":"2018","unstructured":"Coudray, N. et al. Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning. Nat. Med. 24, 1559\u20131567 (2018).","journal-title":"Nat. Med."},{"key":"272_CR16","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. & Wojna, Z. Rethinking the inception architecture for computer vision. Preprint at: arXiv:1512.00567 [cs] (2015).","DOI":"10.1109\/CVPR.2016.308"},{"key":"272_CR17","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-017-17876-z","volume":"7","author":"C Leibig","year":"2017","unstructured":"Leibig, C., Allken, V., Ayhan, M. S., Berens, P. & Wahl, S. Leveraging uncertainty information from deep neural networks for disease detection. Sci. Rep. 7, 17816 (2017).","journal-title":"Sci. Rep."},{"key":"272_CR18","unstructured":"Gal, Y. & Ghahramani, Z. Dropout as a Bayesian approximation: representing model uncertainty in deep learning. In Proc. International Conference on Machine Learning 1050\u20131059 (2016)."},{"key":"272_CR19","unstructured":"Blundell, C., Cornebise, J., Kavukcuoglu, K. & Wierstra, D. Weight uncertainty in neural networks. Preprint at: arXiv:1505.05424 (2015)."},{"key":"272_CR20","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1111\/his.13844","volume":"75","author":"AD Jones","year":"2019","unstructured":"Jones, A. D. et al. Impact of pre-analytical variables on deep learning accuracy in histopathology. Histopathology 75, 39\u201353 (2019).","journal-title":"Histopathology"},{"key":"272_CR21","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-019-50587-1","volume":"9","author":"\u0141 R\u0105czkowski","year":"2019","unstructured":"R\u0105czkowski, \u0141., Mo\u017cejko, M., Zambonelli, J. & Szczurek, E. ARA: accurate, reliable and active histopathological image classification framework with Bayesian deep learning. Sci. Rep. 9, 14347 (2019).","journal-title":"Sci. Rep."},{"key":"272_CR22","doi-asserted-by":"publisher","first-page":"2375","DOI":"10.1182\/blood-2016-01-643569","volume":"127","author":"SH Swerdlow","year":"2016","unstructured":"Swerdlow, S. H. et al. The 2016 revision of the World Health Organization classification of lymphoid neoplasms. Blood 127, 2375\u20132390 (2016).","journal-title":"Blood"},{"key":"272_CR23","unstructured":"Krizhevsky, A., Sutskever, I. & Hinton, G. E. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 1097\u20131105 (2012)."},{"key":"272_CR24","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L. & Weinberger, K. Q. Densely connected convolutional networks. In Proc. IEEE Conference on Computer Vision and Pattern Recognition 4700\u20134708 (2017).","DOI":"10.1109\/CVPR.2017.243"},{"key":"272_CR25","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proc. IEEE Conference on Computer Vision and Pattern Recognition 770\u2013778 (2016).","DOI":"10.1109\/CVPR.2016.90"},{"key":"272_CR26","unstructured":"Guo, C., Pleiss, G., Sun, Y. & Weinberger, K. Q. On calibration of modern neural networks. In Proc. 34th International Conference on Machine Learning. Vol. 70, 1321\u20131330 (2017)."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0272-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0272-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0272-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T02:11:49Z","timestamp":1670379109000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0272-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,1]]},"references-count":26,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["272"],"URL":"https:\/\/doi.org\/10.1038\/s41746-020-0272-0","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,1]]},"assertion":[{"value":"15 January 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 March 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 May 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"63"}}