{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,3]],"date-time":"2026-11-03T01:48:50Z","timestamp":1793670530050,"version":"4.5.1"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,12,14]],"date-time":"2020-12-14T00:00:00Z","timestamp":1607904000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,12,14]],"date-time":"2020-12-14T00:00:00Z","timestamp":1607904000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003637","name":"Korea Foundation for International Health Care","doi-asserted-by":"publisher","award":["HI18C0022"],"award-info":[{"award-number":["HI18C0022"]}],"id":[{"id":"10.13039\/501100003637","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Fast and accurate confirmation of metastasis on the frozen tissue section of intraoperative sentinel lymph node biopsy is an essential tool for critical surgical decisions. However, accurate diagnosis by pathologists is difficult within the time limitations. Training a robust and accurate deep learning model is also difficult owing to the limited number of frozen datasets with high quality labels. To overcome these issues, we validated the effectiveness of transfer learning from CAMELYON16 to improve performance of the convolutional neural network (CNN)-based classification model on our frozen dataset (N\u2009=\u2009297) from Asan Medical Center (AMC). Among the 297 whole slide images (WSIs), 157 and 40 WSIs were used to train deep learning models with different dataset ratios at 2, 4, 8, 20, 40, and 100%. The remaining, i.e., 100 WSIs, were used to validate model performance in terms of patch- and slide-level classification. An additional 228 WSIs from Seoul National University Bundang Hospital (SNUBH) were used as an external validation. Three initial weights, i.e., scratch-based (random initialization), ImageNet-based, and CAMELYON16-based models were used to validate their effectiveness in external validation. In the patch-level classification results on the AMC dataset, CAMELYON16-based models trained with a small dataset (up to 40%, i.e., 62 WSIs) showed a significantly higher area under the curve (AUC) of 0.929 than those of the scratch- and ImageNet-based models at 0.897 and 0.919, respectively, while CAMELYON16-based and ImageNet-based models trained with 100% of the training dataset showed comparable AUCs at 0.944 and 0.943, respectively. For the external validation, CAMELYON16-based models showed higher AUCs than those of the scratch- and ImageNet-based models. Model performance for slide feasibility of the transfer learning to enhance model performance was validated in the case of frozen section datasets with limited numbers.<\/jats:p>","DOI":"10.1038\/s41598-020-78129-0","type":"journal-article","created":{"date-parts":[[2020,12,14]],"date-time":"2020-12-14T11:04:43Z","timestamp":1607943883000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":55,"title":["Effectiveness of transfer learning for enhancing tumor classification with a convolutional neural network on frozen sections"],"prefix":"10.1038","volume":"10","author":[{"given":"Young-Gon","family":"Kim","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sungchul","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cristina Eunbee","family":"Cho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"In Hye","family":"Song","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hee Jin","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Soomin","family":"Ahn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"So Yeon","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gyungyub","family":"Gong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Namkug","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,12,14]]},"reference":[{"key":"78129_CR1","doi-asserted-by":"publisher","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","volume":"39","author":"S Ren","year":"2016","unstructured":"Ren, S., He, K., Girshick, R. & Sun, J. Faster r-cnn: Towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39, 1137\u20131149 (2016).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"78129_CR2","doi-asserted-by":"publisher","first-page":"640","DOI":"10.1109\/TPAMI.2016.2572683","volume":"39","author":"E Shelhamer","year":"2017","unstructured":"Shelhamer, E., Long, J. & Darrell, T. Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39, 640\u2013651 (2017).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"78129_CR3","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., Vanhoucke, V. & Alemi, A. Inception-v4, inception-resnet and the impact of residual connections on learning.  arXiv preprint, arXiv:1602.07261 (2016).","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"78129_CR4","doi-asserted-by":"publisher","first-page":"1301","DOI":"10.1038\/s41591-019-0508-1","volume":"25","author":"G Campanella","year":"2019","unstructured":"Campanella, G. et al. Clinical-grade computational pathology using weakly supervised deep learning on whole slide images. Nat. Med. 25, 1301\u20131309 (2019).","journal-title":"Nat. Med."},{"key":"78129_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-018-37186-2","volume":"9","author":"Y-G Kim","year":"2019","unstructured":"Kim, Y.-G. et al. A fully automated system using a convolutional neural network to predict renal allograft rejection: Extra-validation with giga-pixel immunostained slides. Sci. Rep. 9, 1\u201310 (2019).","journal-title":"Sci. Rep."},{"key":"78129_CR6","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1109\/LGRS.2015.2499239","volume":"13","author":"D Marmanis","year":"2015","unstructured":"Marmanis, D., Datcu, M., Esch, T. & Stilla, U. Deep learning earth observation classification using ImageNet pretrained networks. IEEE Geosci. Remote Sens. Lett. 13, 105\u2013109 (2015).","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"78129_CR7","doi-asserted-by":"crossref","unstructured":"Carneiro, G., Nascimento, J. & Bradley, A. P. Unregistered multiview mammogram analysis with pre-trained deep learning models. In International Conference on Medical Image Computing and Computer-Assisted Intervention. 652\u2013660 (2015).","DOI":"10.1007\/978-3-319-24574-4_78"},{"key":"78129_CR8","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1148\/radiol.2018181422","volume":"290","author":"JA Dunnmon","year":"2019","unstructured":"Dunnmon, J. A. et al. Assessment of convolutional neural networks for automated classification of chest radiographs. Radiology 290, 537\u2013544 (2019).","journal-title":"Radiology"},{"key":"78129_CR9","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva, A. et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115\u2013118 (2017).","journal-title":"Nature"},{"key":"78129_CR10","doi-asserted-by":"publisher","first-page":"2402","DOI":"10.1001\/jama.2016.17216","volume":"316","author":"V Gulshan","year":"2016","unstructured":"Gulshan, V. et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402\u20132410 (2016).","journal-title":"JAMA"},{"key":"78129_CR11","doi-asserted-by":"crossref","unstructured":"Cire\u015fan, D. C., Giusti, A., Gambardella, L. M. & Schmidhuber, J. Mitosis detection in breast cancer histology images with deep neural networks. In International conference on medical image computing and computer-assisted intervention. 411\u2013418 (2013).","DOI":"10.1007\/978-3-642-40763-5_51"},{"key":"78129_CR12","doi-asserted-by":"publisher","first-page":"034003","DOI":"10.1117\/1.JMI.1.3.034003","volume":"1","author":"H Wang","year":"2014","unstructured":"Wang, H. et al. Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features. J. Med. Imaging 1, 034003 (2014).","journal-title":"J. Med. Imaging"},{"key":"78129_CR13","doi-asserted-by":"publisher","first-page":"2126","DOI":"10.1109\/TMI.2018.2820199","volume":"37","author":"D Tellez","year":"2018","unstructured":"Tellez, D. et al. Whole-slide mitosis detection in H&E breast histology using PHH3 as a reference to train distilled stain-invariant convolutional networks. IEEE Trans. Med. Imaging 37, 2126\u20132136 (2018).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"78129_CR14","doi-asserted-by":"publisher","first-page":"859","DOI":"10.5858\/arpa.2018-0147-OA","volume":"143","author":"Y Liu","year":"2019","unstructured":"Liu, Y. et al. Artificial intelligence-based breast cancer nodal metastasis detection: Insights into the black box for pathologists. Arch. Pathol. Lab. Med. 143, 859\u2013868 (2019).","journal-title":"Arch. Pathol. Lab. Med."},{"key":"78129_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-018-37186-2","volume":"9","author":"S Akbar","year":"2019","unstructured":"Akbar, S. et al. Automated and manual quantification of tumour cellularity in digital slides for tumour burden assessment. Sci Rep. 9, 1\u20139 (2019).","journal-title":"Sci Rep."},{"key":"78129_CR16","unstructured":"Pinckaers, H. & Litjens, G. Neural Ordinary Differential Equations for Semantic Segmentation of Individual Colon Glands. arXiv preprint, arXiv:1910.10470  (2019)."},{"key":"78129_CR17","unstructured":"Ho, D. J. et al. Deep Multi-Magnification Networks for Multi-Class Breast Cancer Image Segmentation. arXiv preprint, arXiv:1910.13042  (2019)."},{"key":"78129_CR18","doi-asserted-by":"crossref","unstructured":"Tokunaga, H., Teramoto, Y., Yoshizawa, A. & Bise, R. Adaptive weighting multi-field-of-view CNN for semantic segmentation in pathology, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 12597\u201312606 (2019).","DOI":"10.1109\/CVPR.2019.01288"},{"key":"78129_CR19","volume-title":"Harrison's Principles of Internal Medicine","author":"JL Jameson","year":"2018","unstructured":"Jameson, J. L. et al. Harrison\u2019s Principles of Internal Medicine (McGraw-Hill Education, New York, 2018)."},{"key":"78129_CR20","doi-asserted-by":"publisher","first-page":"617","DOI":"10.1016\/j.ejca.2005.12.003","volume":"42","author":"F Celebioglu","year":"2006","unstructured":"Celebioglu, F., Sylvan, M., Perbeck, L., Bergkvist, L. & Frisell, J. Intraoperative sentinel lymph node examination by frozen section, immunohistochemistry and imprint cytology during breast surgery\u2014A prospective study. Eur. J. Cancer 42, 617\u2013620 (2006).","journal-title":"Eur. J. Cancer"},{"key":"78129_CR21","unstructured":"Bengio, Y. Deep learning of representations for unsupervised and transfer learning. In Proceedings of ICML Workshop on Unsupervised and Transfer Learning Vol. 27, 17\u201336 (2012)."},{"key":"78129_CR22","doi-asserted-by":"publisher","first-page":"80","DOI":"10.3389\/fgene.2019.00080","volume":"10","author":"J Xie","year":"2019","unstructured":"Xie, J., Liu, R., Luttrell, J. IV. & Zhang, C. Deep learning based analysis of histopathological images of breast cancer. Front. Genet. 10, 80 (2019).","journal-title":"Front. Genet."},{"key":"78129_CR23","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/j.csbj.2018.01.001","volume":"16","author":"D Komura","year":"2018","unstructured":"Komura, D. & Ishikawa, S. Machine learning methods for histopathological image analysis. Comput. Struct. Biotechnol. J. 16, 34\u201342 (2018).","journal-title":"Comput. Struct. Biotechnol. J."},{"key":"78129_CR24","doi-asserted-by":"crossref","unstructured":"Kim, Y.-G. et al. Challenge for diagnostic assessment of deep learning algorithm for metastases classification in sentinel lymph nodes on frozen tissue section digital slides in women with breast cancer. Cancer Res. Treat. 52, 1103\u20131111 (2020).","DOI":"10.4143\/crt.2020.337"},{"key":"78129_CR25","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1093\/ajcp\/aqz009","volume":"151","author":"Y Chen","year":"2019","unstructured":"Chen, Y., Anderson, K. R., Xu, J., Goldsmith, J. D. & Heher, Y. K. Frozen-section checklist implementation improves quality and patient safety. Am. J. Clin. Pathol. 151, 607\u2013612 (2019).","journal-title":"Am. J. Clin. Pathol."},{"key":"78129_CR26","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","volume":"9","author":"N Otsu","year":"1979","unstructured":"Otsu, N. A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9, 62\u201366 (1979).","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"78129_CR27","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. & Wojna, Z. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2818\u20132826 (2016).","DOI":"10.1109\/CVPR.2016.308"},{"key":"78129_CR28","unstructured":"Simonyan, K. & Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv preprint, arXiv:1409.1556 (2014)."},{"key":"78129_CR29","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770\u2013778 (2016).","DOI":"10.1109\/CVPR.2016.90"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-78129-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-78129-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-78129-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T00:39:16Z","timestamp":1670373556000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-78129-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,14]]},"references-count":29,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["78129"],"URL":"https:\/\/doi.org\/10.1038\/s41598-020-78129-0","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,14]]},"assertion":[{"value":"3 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 November 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 December 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"21899"}}