{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T07:38:14Z","timestamp":1770709094672,"version":"3.49.0"},"reference-count":56,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2021,5,17]],"date-time":"2021-05-17T00:00:00Z","timestamp":1621209600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Basic Science Research Program through the National 259 Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT &amp; Future Planning 260 (MIST)","award":["2017R1E1A1A01078335, 2018R1C1B6005381"],"award-info":[{"award-number":["2017R1E1A1A01078335, 2018R1C1B6005381"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Diffuse gliomas are the most common primary brain tumors and they vary considerably in their morphology, location, genetic alterations, and response to therapy. In 2016, the World Health Organization (WHO) provided new guidelines for making an integrated diagnosis that incorporates both morphologic and molecular features to diffuse gliomas. In this study, we demonstrate how deep learning approaches can be used for an automatic classification of glioma subtypes and grading using whole-slide images that were obtained from routine clinical practice. A deep transfer learning method using the ResNet50V2 model was trained to classify subtypes and grades of diffuse gliomas according to the WHO\u2019s new 2016 classification. The balanced accuracy of the diffuse glioma subtype classification model with majority voting was 0.8727. These results highlight an emerging role of deep learning in the future practice of pathologic diagnosis.<\/jats:p>","DOI":"10.3390\/s21103500","type":"journal-article","created":{"date-parts":[[2021,5,18]],"date-time":"2021-05-18T00:06:54Z","timestamp":1621296414000},"page":"3500","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":30,"title":["Classification of Diffuse Glioma Subtype from Clinical-Grade Pathological Images Using Deep Transfer Learning"],"prefix":"10.3390","volume":"21","author":[{"given":"Sanghyuk","family":"Im","sequence":"first","affiliation":[{"name":"Department of Neurosurgery, College of Medicine, The Catholic University of Korea, Seoul 06591, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonghwan","family":"Hyeon","sequence":"additional","affiliation":[{"name":"School of Computing, Korea Advanced Institute of Science and Technology, Daejeon 34141, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eunyoung","family":"Rha","sequence":"additional","affiliation":[{"name":"Department of Plastic and Reconstructive Surgery, College of Medicine, The Catholic University of Korea, Seoul 06591, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Janghyeon","family":"Lee","sequence":"additional","affiliation":[{"name":"School of Computing, Korea Advanced Institute of Science and Technology, Daejeon 34141, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ho-Jin","family":"Choi","sequence":"additional","affiliation":[{"name":"School of Computing, Korea Advanced Institute of Science and Technology, Daejeon 34141, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2202-7303","authenticated-orcid":false,"given":"Yuchae","family":"Jung","sequence":"additional","affiliation":[{"name":"School of Computing, Korea Advanced Institute of Science and Technology, Daejeon 34141, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3140-3681","authenticated-orcid":false,"given":"Tae-Jung","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Hospital Pathology, Yeouido St. Mary\u2019s Hospital, College of Medicine, The Catholic University of Korea, Seoul 06591, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,17]]},"reference":[{"key":"ref_1","first-page":"1","article-title":"Glioma","volume":"1","author":"Weller","year":"2015","journal-title":"Nat. Rev. Dis. Prim."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1016\/S0002-9440(10)61750-6","article-title":"Glioma classification: A molecular reappraisal","volume":"159","author":"Louis","year":"2001","journal-title":"Am. J. Pathol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1007\/s00401-016-1545-1","article-title":"The 2016 World Health Organization classification of tumors of the central nervous system: A summary","volume":"131","author":"Louis","year":"2016","journal-title":"Acta Neuropathol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1007\/s00401-015-1424-1","article-title":"Oligodendroglioma: Pathology, molecular mechanisms and markers","volume":"129","author":"Wesseling","year":"2015","journal-title":"Acta Neuropathol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1807","DOI":"10.1126\/science.1164382","article-title":"An integrated genomic analysis of human glioblastoma multiforme","volume":"321","author":"Parsons","year":"2008","journal-title":"Science"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"8673","DOI":"10.1158\/0008-5472.CAN-08-2097","article-title":"Tandem duplication producing a novel oncogenic BRAF fusion gene defines the majority of pilocytic astrocytomas","volume":"68","author":"Jones","year":"2008","journal-title":"Cancer Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"997","DOI":"10.1056\/NEJMoa043331","article-title":"MGMT gene silencing and benefit from temozolomide in glioblastoma","volume":"352","author":"Hegi","year":"2005","journal-title":"N. Engl. J. Med."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"47","DOI":"10.5414\/NPP30047","article-title":"FISH-based detection of 1p 19q codeletion in oligodendroglial tumors: Procedures and protocols for neuropathological practice-a publication under the auspices of the Research Committee of the European Confederation of Neuropathological Societies (Euro-CNS)","volume":"30","author":"Woehrer","year":"2011","journal-title":"Clin. Neuropathol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1473","DOI":"10.1093\/jnci\/90.19.1473","article-title":"Specific genetic predictors of chemotherapeutic response and survival in patients with anaplastic oligodendrogliomas","volume":"90","author":"Cairncross","year":"1998","journal-title":"JNCI J. Natl. Cancer Inst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1886","DOI":"10.1212\/WNL.0b013e3181e1cf3a","article-title":"All the 1p19q codeleted gliomas are mutated on IDH1 or IDH2","volume":"74","author":"Labussiere","year":"2010","journal-title":"Neurology"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1002\/path.2995","article-title":"Concurrent CIC mutations, IDH mutations, and 1p\/19q loss distinguish oligodendrogliomas from other cancers","volume":"226","author":"Yip","year":"2012","journal-title":"J. Pathol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1118","DOI":"10.1093\/jnen\/62.11.1118","article-title":"Clinical utility of fluorescence in situ hybridization (FISH) in morphologically ambiguous gliomas with hybrid oligodendroglial\/astrocytic features","volume":"62","author":"Fuller","year":"2003","journal-title":"J. Neuropathol. Exp. Neurol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1097\/01.jnen.0000263869.84188.72","article-title":"Panel review of anaplastic oligodendroglioma from European Organization For Research and Treatment of Cancer Trial 26951: Assessment of consensus in diagnosis, influence of 1p\/19q loss, and correlations with outcome","volume":"66","author":"Kros","year":"2007","journal-title":"J. Neuropathol. Exp. Neurol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"29","DOI":"10.4103\/2153-3539.186902","article-title":"Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases","volume":"7","author":"Janowczyk","year":"2016","journal-title":"J. Pathol. Inform."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, S., Yang, D.M., Rong, R., Zhan, X., Fujimoto, J., Liu, H., Minna, J., Wistuba, I.I., Xie, Y., and Xiao, G. (2019). Artificial intelligence in lung cancer pathology image analysis. Cancers, 11.","DOI":"10.3390\/cancers11111673"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"E2970","DOI":"10.1073\/pnas.1717139115","article-title":"Predicting cancer outcomes from histology and genomics using convolutional networks","volume":"115","author":"Mobadersany","year":"2018","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"498","DOI":"10.2307\/2273574","article-title":"Computers and intractability. A guide to the theory of NP-completeness","volume":"48","author":"Lewis","year":"1983","journal-title":"J. Symb. Log."},{"key":"ref_18","unstructured":"Martello, S. (1990). Knapsack Problems: Algorithms and Computer Implementations. Wiley-Interscience Series in Discrete Mathematics and Optimization, Wiley."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016). Identity mappings in deep residual networks. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands, 8\u201316 October 2016, Springer.","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A. (2017, January 4\u20139). Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_23","unstructured":"Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2\u20134). Tensorflow: A system for large-scale machine learning. Proceedings of the 12th {USENIX} symposium on operating systems design and implementation ({OSDI} 16), Savannah, GA, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1137\/16M1080173","article-title":"Optimization methods for large-scale machine learning","volume":"60","author":"Bottou","year":"2018","journal-title":"Siam Rev."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1214\/aoms\/1177729586","article-title":"A stochastic approximation method","volume":"22","author":"Robbins","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_26","unstructured":"Sutskever, I., Martens, J., Dahl, G., and Hinton, G. (2013, January 16\u201321). On the importance of initialization and momentum in deep learning. Proceedings of the International Conference on Machine Learning, (PMLR 2013), Atlanta, GA, USA."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1016\/0893-6080(88)90003-2","article-title":"Increased rates of convergence through learning rate adaptation","volume":"1","author":"Jacobs","year":"1988","journal-title":"Neural Netw."},{"key":"ref_28","unstructured":"Perez, L., and Wang, J. (2017). The effectiveness of data augmentation in image classification using deep learning. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"Imagenet large scale visual recognition challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Tan, M., Chen, B., Pang, R., Vasudevan, V., Sandler, M., Howard, A., and Le, Q.V. (2019, January 15\u201320). Mnasnet: Platform-aware neural architecture search for mobile. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00293"},{"key":"ref_31","unstructured":"Tan, M., and Le, Q. (2019, January 10\u201315). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, (PMLR 2019), Long Beach, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1200\/JCO.2012.43.2674","article-title":"Phase III trial of chemoradiotherapy for anaplastic oligodendroglioma: Long-term results of RTOG 9402","volume":"31","author":"Cairncross","year":"2013","journal-title":"J. Clin. Oncol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1111\/bpa.12171","article-title":"International Society of Neuropathology\u2014Haarlem: International Society of Neuropathology\u2014Haarlem consensus guidelines for nervous system tumor classification and grading","volume":"24","author":"Louis","year":"2014","journal-title":"Brain Pathol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1301","DOI":"10.1038\/s41591-019-0508-1","article-title":"Clinical-grade computational pathology using weakly supervised deep learning on whole slide images","volume":"25","author":"Campanella","year":"2019","journal-title":"Nat. Med."},{"key":"ref_35","first-page":"1899","article-title":"Automated grading of gliomas using deep learning in digital pathology images: A modular approach with ensemble of convolutional neural networks","volume":"Volume 2015","author":"Ertosun","year":"2015","journal-title":"Proceedings of the AMIA Annual Symposium Proceedings, San Francisco, CA, USA, 14\u201318 November 2015"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"vdaa110","DOI":"10.1093\/noajnl\/vdaa110","article-title":"Optimization of deep learning methods for visualization of tumor heterogeneity and brain tumor grading through digital pathology","volume":"2","author":"Truong","year":"2020","journal-title":"Neuro-Oncol. Adv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"27","DOI":"10.3389\/fnins.2020.00027","article-title":"Segmentation and classification in digital pathology for glioma research: Challenges and deep learning approaches","volume":"14","author":"Kurc","year":"2020","journal-title":"Front. Neurosci."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"19726","DOI":"10.1038\/s41598-020-74419-9","article-title":"Context aware deep learning for brain tumor segmentation, subtype classification, and survival prediction using radiology images","volume":"10","author":"Pei","year":"2020","journal-title":"Sci. Rep."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Riva, M., Sciortino, T., Secoli, R., D\u2019Amico, E., Moccia, S., Fernandes, B., Nibali, M.C., Gay, L., Rossi, M., and Momi, E.D. (2021). Glioma biopsies Classification Using Raman Spectroscopy and Machine Learning Models on Fresh Tissue Samples. Cancers, 13.","DOI":"10.3390\/cancers13051073"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1099","DOI":"10.1136\/amiajnl-2012-001540","article-title":"Pathology imaging informatics for quantitative analysis of whole-slide images","volume":"20","author":"Kothari","year":"2013","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_41","unstructured":"Yosinski, J., Clune, J., Bengio, Y., and Lipson, H. (2014). How transferable are features in deep neural networks?. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A survey on transfer learning","volume":"22","author":"Pan","year":"2009","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2152","DOI":"10.1002\/1097-0142(19881115)62:10<2152::AID-CNCR2820621015>3.0.CO;2-T","article-title":"Grading of astrocytomas: A simple and reproducible method","volume":"62","author":"Scheithauer","year":"1988","journal-title":"Cancer"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1007\/s00401-007-0243-4","article-title":"The 2007 WHO classification of tumours of the central nervous system","volume":"114","author":"Louis","year":"2007","journal-title":"Acta Neuropathol."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Kriegsmann, M., Haag, C., Weis, C.A., Steinbuss, G., Warth, A., Zgorzelski, C., Muley, T., Winter, H., Eichhorn, M.E., and Eichhorn, F. (2020). Deep Learning for the Classification of Small-Cell and Non-Small-Cell Lung Cancer. Cancers, 12.","DOI":"10.3390\/cancers12061604"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1559","DOI":"10.1038\/s41591-018-0177-5","article-title":"Classification and mutation prediction from non\u2013small cell lung cancer histopathology images using deep learning","volume":"24","author":"Coudray","year":"2018","journal-title":"Nat. Med."},{"key":"ref_47","first-page":"153","article-title":"Automated diagnosis of lymphoma with digital pathology images using deep learning","volume":"49","author":"Belousova","year":"2019","journal-title":"Ann. Clin. Lab. Sci."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1636","DOI":"10.1097\/PAS.0000000000001151","article-title":"Impact of deep learning assistance on the histopathologic review of lymph nodes for metastatic breast cancer","volume":"42","author":"Steiner","year":"2018","journal-title":"Am. J. Surg. Pathol."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1007\/s13244-018-0639-9","article-title":"Convolutional neural networks: An overview and application in radiology","volume":"9","author":"Yamashita","year":"2018","journal-title":"Insights Imaging"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Ma, X., Dai, Z., He, Z., Ma, J., Wang, Y., and Wang, Y. (2017). Learning traffic as images: A deep convolutional neural network for large-scale transportation network speed prediction. Sensors, 17.","DOI":"10.3390\/s17040818"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Alzubaidi, L., Al-Shamma, O., Fadhel, M.A., Farhan, L., Zhang, J., and Duan, Y. (2020). Optimizing the performance of breast cancer classification by employing the same domain transfer learning from hybrid deep convolutional neural network model. Electronics, 9.","DOI":"10.3390\/electronics9030445"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/j.neunet.2018.07.011","article-title":"A systematic study of the class imbalance problem in convolutional neural networks","volume":"106","author":"Buda","year":"2018","journal-title":"Neural Netw."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Alsubaie, N., Trahearn, N., Raza, S.E.A., Snead, D., and Rajpoot, N.M. (2017). Stain deconvolution using statistical analysis of multi-resolution stain colour representation. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0169875"},{"key":"ref_54","first-page":"1","article-title":"An annotation-free whole-slide training approach to pathological classification of lung cancer types using deep learning","volume":"12","author":"Chen","year":"2021","journal-title":"Nat. Commun."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s13721-020-0218-0","article-title":"Sample size determination for biomedical big data with limited labels","volume":"9","author":"Richter","year":"2020","journal-title":"Netw. Model. Anal. Health Inform. Bioinform."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Figueroa, R.L., Zeng-Treitler, Q., Kandula, S., and Ngo, L.H. (2012). Predicting sample size required for classification performance. BMC Med. Inform. Decis. Mak., 12.","DOI":"10.1186\/1472-6947-12-8"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/10\/3500\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:02:58Z","timestamp":1760162578000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/10\/3500"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,17]]},"references-count":56,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["s21103500"],"URL":"https:\/\/doi.org\/10.3390\/s21103500","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,17]]}}}