{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,7]],"date-time":"2026-11-07T12:42:38Z","timestamp":1794055358328,"version":"4.8.0"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T00:00:00Z","timestamp":1668038400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T00:00:00Z","timestamp":1668038400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Non-alcoholic fatty liver disease (NAFLD) affects about 24% of the world's population. Progression of early stages of NAFLD can lead to the more advanced form non-alcoholic steatohepatitis (NASH), and ultimately to cirrhosis or liver cancer. The current gold standard for diagnosis and assessment of NAFLD\/NASH is liver biopsy followed by microscopic analysis by a pathologist. The Kleiner score is frequently used for a semi-quantitative assessment of disease progression. In this scoring system the features of active injury (steatosis, inflammation, and ballooning) and a separated fibrosis score are quantified. The procedure is time consuming for pathologists, scores have limited resolution and are subject to variation. We developed an automated deep learning method that provides full reproducibility and higher resolution. The system was established with 296 human liver biopsies and tested on 171 human liver biopsies with pathologist ground truth scores. The method is inspired by the way pathologist's analyze liver biopsies. First, the biopsies are analyzed microscopically for the relevant histopathological features. Subsequently, histopathological features are aggregated to a per-biopsy score. Scores are in the identical numeric range as the pathologist\u2019s ballooning, inflammation, steatosis, and fibrosis scores, but on a continuous scale. Resulting scores followed a pathologist's ground truth (quadratic weighted Cohen\u2019s \u03ba on the test set: for steatosis 0.66, for inflammation 0.24, for ballooning 0.43, for fibrosis 0.62, and for the NAFLD activity score (NAS) 0.52. Mean absolute errors on a test set: for steatosis 0.29, for inflammation 0.53, for ballooning 0.61, for fibrosis 0.78, and for the NAS 0.77).<\/jats:p>","DOI":"10.1038\/s41598-022-23905-3","type":"journal-article","created":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T13:04:49Z","timestamp":1668085489000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":55,"title":["Deep learning-based quantification of NAFLD\/NASH progression in human liver biopsies"],"prefix":"10.1038","volume":"12","author":[{"given":"Fabian","family":"Heinemann","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Gross","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Svetlana","family":"Zeveleva","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hu Sheng","family":"Qian","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jon","family":"Hill","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anne","family":"H\u00f6fer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Danny","family":"Jonigk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna Mae","family":"Diehl","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manal","family":"Abdelmalek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin C.","family":"Lenter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steven S.","family":"Pullen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paolo","family":"Guarnieri","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Birgit","family":"Stierstorfer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,11,10]]},"reference":[{"key":"23905_CR1","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1038\/nrgastro.2017.109","volume":"15","author":"Z Younossi","year":"2018","unstructured":"Younossi, Z. et al. Global burden of NAFLD and NASH: Trends, predictions, risk factors and prevention. Nat. Rev. Gastroenterol. 15, 11\u201320 (2018).","journal-title":"Nat. Rev. Gastroenterol."},{"key":"23905_CR2","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1038\/nrgastro.2016.147","volume":"14","author":"H Tilg","year":"2017","unstructured":"Tilg, H., Moschen, A. R. & Roden, M. NAFLD and diabetes mellitus. Nat. Rev. Gastroenterol. 14, 32\u201342 (2017).","journal-title":"Nat. Rev. Gastroenterol."},{"key":"23905_CR3","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1002\/hep.29466","volume":"67","author":"C Estes","year":"2018","unstructured":"Estes, C., Razavi, H., Loomba, R., Younossi, Z. & Sanyal, A. J. Modeling the epidemic of nonalcoholic fatty liver disease demonstrates an exponential increase in burden of disease. Hepatology 67, 123\u2013133 (2018).","journal-title":"Hepatology"},{"key":"23905_CR4","doi-asserted-by":"publisher","first-page":"838","DOI":"10.1016\/S0140-6736(08)60383-9","volume":"371","author":"D Schuppan","year":"2008","unstructured":"Schuppan, D. & Afdhal, N. H. Liver cirrhosis. Lancet 371, 838\u2013851 (2008).","journal-title":"Lancet"},{"key":"23905_CR5","doi-asserted-by":"publisher","first-page":"1749","DOI":"10.1016\/S0140-6736(14)60121-5","volume":"383","author":"EA Tsochatzis","year":"2014","unstructured":"Tsochatzis, E. A., Bosch, J. & Burroughs, A. K. Liver cirrhosis. Lancet 383, 1749\u20131761 (2014).","journal-title":"Lancet"},{"key":"23905_CR6","doi-asserted-by":"publisher","first-page":"2915","DOI":"10.1007\/s10620-017-4684-x","volume":"62","author":"G Cholankeril","year":"2017","unstructured":"Cholankeril, G. et al. Liver transplantation for nonalcoholic steatohepatitis in the US: Temporal trends and outcomes. Dig. Dis. Sci. 62, 2915\u20132922 (2017).","journal-title":"Dig. Dis. Sci."},{"key":"23905_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s43440-019-00020-1","volume":"72","author":"N Pydyn","year":"2020","unstructured":"Pydyn, N., Mi\u0119kus, K., Jura, J. & Kotlinowski, J. New therapeutic strategies in nonalcoholic fatty liver disease: A focus on promising drugs for nonalcoholic steatohepatitis. Pharmacol. Rep. 72, 1\u201312 (2020).","journal-title":"Pharmacol. Rep."},{"key":"23905_CR8","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1016\/j.clinthera.2021.01.012","volume":"43","author":"S Kogachi","year":"2021","unstructured":"Kogachi, S. & Noureddin, M. Noninvasive evaluation for nonalcoholic fatty liver disease and nonalcoholic steatohepatitis. Clin. Ther. 43, 455\u2013472 (2021).","journal-title":"Clin. Ther."},{"key":"23905_CR9","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1007\/s11901-019-00500-1","volume":"18","author":"RK Pai","year":"2019","unstructured":"Pai, R. K. NAFLD histology: A critical review and comparison of scoring systems. Curr. Hepatol. Rep. 18, 473\u2013481 (2019).","journal-title":"Curr. Hepatol. Rep."},{"key":"23905_CR10","doi-asserted-by":"publisher","first-page":"1313","DOI":"10.1002\/hep.20701","volume":"41","author":"DE Kleiner","year":"2005","unstructured":"Kleiner, D. E. et al. Design and validation of a histological scoring system for nonalcoholic fatty liver disease. Hepatology 41, 1313\u20131321 (2005).","journal-title":"Hepatology"},{"key":"23905_CR11","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2019.4337","volume":"2","author":"DM Metter","year":"2019","unstructured":"Metter, D. M., Colgan, T. J., Leung, S. T., Timmons, C. F. & Park, J. Y. Trends in the US and Canadian pathologist workforces from 2007 to 2017. JAMA Netw. Open 2, e194337 (2019).","journal-title":"JAMA Netw. Open"},{"key":"23905_CR12","first-page":"1097","volume":"25","author":"A Krizhevsky","year":"2012","unstructured":"Krizhevsky, A., Sutskever, I. & Hinton, G. E. ImageNet classification with deep convolutional neural networks. Adv. Neural. Inf. Process. Syst. 25, 1097\u20131105 (2012).","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"23905_CR13","doi-asserted-by":"publisher","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In 2016 IEEE Conf Comput Vis Pattern Recognit Cvpr 770\u2013778 (2016) https:\/\/doi.org\/10.1109\/cvpr.2016.90.","DOI":"10.1109\/cvpr.2016.90"},{"key":"23905_CR14","doi-asserted-by":"publisher","first-page":"703","DOI":"10.1038\/s41571-019-0252-y","volume":"16","author":"K Bera","year":"2019","unstructured":"Bera, K., Schalper, K. A., Rimm, D. L., Velcheti, V. & Madabhushi, A. Artificial intelligence in digital pathology\u2014New tools for diagnosis and precision oncology. Nat. Rev. Clin. Oncol. 16, 703\u2013715 (2019).","journal-title":"Nat. Rev. Clin. Oncol."},{"key":"23905_CR15","doi-asserted-by":"publisher","first-page":"18454","DOI":"10.1038\/s41598-019-54904-6","volume":"9","author":"F Heinemann","year":"2019","unstructured":"Heinemann, F., Birk, G. & Stierstorfer, B. Deep learning enables pathologist-like scoring of NASH models. Sci. Rep.-UK 9, 18454 (2019).","journal-title":"Sci. Rep.-UK"},{"key":"23905_CR16","doi-asserted-by":"publisher","first-page":"2000","DOI":"10.1002\/hep.31207","volume":"72","author":"C Saillard","year":"2020","unstructured":"Saillard, C. et al. Predicting survival after hepatocellular carcinoma resection using deep learning on histological slides. Hepatology 72, 2000\u20132013 (2020).","journal-title":"Hepatology"},{"key":"23905_CR17","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1016\/j.jhep.2022.01.018","volume":"77","author":"Q Zeng","year":"2022","unstructured":"Zeng, Q. et al. Artificial intelligence predicts immune and inflammatory gene signatures directly from hepatocellular carcinoma histology. J. Hepatol. 77, 116\u2013127 (2022).","journal-title":"J. Hepatol."},{"key":"23905_CR18","doi-asserted-by":"publisher","first-page":"1301","DOI":"10.1038\/s41591-019-0508-1","volume":"25","author":"G Campanella","year":"2019","unstructured":"Campanella, G. et al. Clinical-grade computational pathology using weakly supervised deep learning on whole slide images. Nat. Med. 25, 1301\u20131309 (2019).","journal-title":"Nat. Med."},{"key":"23905_CR19","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1016\/j.ebiom.2017.12.026","volume":"27","author":"P Khosravi","year":"2018","unstructured":"Khosravi, P., Kazemi, E., Imielinski, M., Elemento, O. & Hajirasouliha, I. Deep convolutional neural networks enable discrimination of heterogeneous digital pathology images. EBioMedicine 27, 317\u2013328 (2018).","journal-title":"EBioMedicine"},{"key":"23905_CR20","doi-asserted-by":"publisher","DOI":"10.1016\/j.jhepr.2022.100443","volume":"4","author":"D Nam","year":"2022","unstructured":"Nam, D., Chapiro, J., Paradis, V., Seraphin, T. P. & Kather, J. N. Artificial intelligence in liver diseases: Improving diagnostics, prognostics and response prediction. Jhep Rep. 4, 100443 (2022).","journal-title":"Jhep Rep."},{"key":"23905_CR21","unstructured":"Perez, L. & Wang, J. The effectiveness of data augmentation in image classification using deep learning. Arxiv (2017)."},{"key":"23905_CR22","unstructured":"Stark, F., Hazirbas, C., Triebel, R. & Cremers, D. CAPTCHA recognition with active deep learning. In Workshop New Challenges in Neural Computation 2015 (2015)."},{"key":"23905_CR23","doi-asserted-by":"crossref","unstructured":"Shaha, M. & Pawar, M. Transfer learning for image classification. In 2018 Second Int Conf Electron Commun Aerosp Technology ICECA 00, 656\u2013660 (2018).","DOI":"10.1109\/ICECA.2018.8474802"},{"key":"23905_CR24","doi-asserted-by":"publisher","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A. & Torralba, A. Learning deep features for discriminative localization. In 2016 IEEE Conf Comput Vis Pattern Recognit Cvpr 2921\u20132929 (2016) https:\/\/doi.org\/10.1109\/cvpr.2016.319.","DOI":"10.1109\/cvpr.2016.319"},{"key":"23905_CR25","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1002\/hep.31750","volume":"74","author":"A Taylor-Weiner","year":"2021","unstructured":"Taylor-Weiner, A. et al. A machine learning approach enables quantitative measurement of liver histology and disease monitoring in NASH. Hepatology 74, 133\u2013147 (2021).","journal-title":"Hepatology"},{"key":"23905_CR26","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2021.106153","volume":"207","author":"H Qu","year":"2021","unstructured":"Qu, H. et al. Training of computational algorithms to predict NAFLD activity score and fibrosis stage from liver histopathology slides. Comput. Method Prog. Biol. 207, 106153 (2021).","journal-title":"Comput. Method Prog. Biol."},{"key":"23905_CR27","doi-asserted-by":"publisher","first-page":"2467","DOI":"10.1111\/j.1572-0241.1999.01377.x","volume":"94","author":"EM Brunt","year":"1999","unstructured":"Brunt, E. M., Janney, C. G., Bisceglie, A. M. D., Neuschwander-Tetri, B. A. & Bacon, B. R. Nonalcoholic steatohepatitis: A proposal for grading and staging the histological lesions. Am. J. Gastroenterol. 94, 2467\u20132474 (1999).","journal-title":"Am. J. Gastroenterol."},{"key":"23905_CR28","doi-asserted-by":"publisher","first-page":"497","DOI":"10.1381\/0960892053723268","volume":"15","author":"DJ Janiec","year":"2005","unstructured":"Janiec, D. J., Jacobson, E. R., Freeth, A., Spaulding, L. & Blaszyk, H. Histologic variation of grade and stage of non-alcoholic fatty liver disease in liver biopsies. Obes. Surg. 15, 497\u2013501 (2005).","journal-title":"Obes. Surg."},{"key":"23905_CR29","doi-asserted-by":"publisher","first-page":"1874","DOI":"10.1002\/hep.24268","volume":"53","author":"ZM Younossi","year":"2011","unstructured":"Younossi, Z. M. et al. Pathologic criteria for nonalcoholic steatohepatitis: Interprotocol agreement and ability to predict liver-related mortality. Hepatology 53, 1874\u20131882 (2011).","journal-title":"Hepatology"},{"key":"23905_CR30","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P. & Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. Arxiv (2015).","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"23905_CR31","unstructured":"Chollet, F. Keras. Keras https:\/\/keras.io (2015)."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-23905-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-23905-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-23905-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T13:04:56Z","timestamp":1668085496000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-23905-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,10]]},"references-count":31,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["23905"],"URL":"https:\/\/doi.org\/10.1038\/s41598-022-23905-3","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,10]]},"assertion":[{"value":"2 August 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 November 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 November 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"19236"}}