{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T02:54:03Z","timestamp":1772938443371,"version":"3.50.1"},"reference-count":41,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2020,5,12]],"date-time":"2020-05-12T00:00:00Z","timestamp":1589241600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>Accurate classification of medical images is of great importance for correct disease diagnosis. The automation of medical image classification is of great necessity because it can provide a second opinion or even a better classification in case of a shortage of experienced medical staff. Convolutional neural networks (CNN) were introduced to improve the image classification domain by eliminating the need to manually select which features to use to classify images. Training CNN from scratch requires very large annotated datasets that are scarce in the medical field. Transfer learning of CNN weights from another large non-medical dataset can help overcome the problem of medical image scarcity. Transfer learning consists of fine-tuning CNN layers to suit the new dataset. The main questions when using transfer learning are how deeply to fine-tune the network and what difference in generalization that will make. In this paper, all of the experiments were done on two histopathology datasets using three state-of-the-art architectures to systematically study the effect of block-wise fine-tuning of CNN. Results show that fine-tuning the entire network is not always the best option; especially for shallow networks, alternatively fine-tuning the top blocks can save both time and computational power and produce more robust classifiers.<\/jats:p>","DOI":"10.3390\/app10103359","type":"journal-article","created":{"date-parts":[[2020,5,12]],"date-time":"2020-05-12T10:53:55Z","timestamp":1589280835000},"page":"3359","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":69,"title":["How Deeply to Fine-Tune a Convolutional Neural Network: A Case Study Using a Histopathology Dataset"],"prefix":"10.3390","volume":"10","author":[{"given":"Ibrahem","family":"Kandel","sequence":"first","affiliation":[{"name":"Nova Information Management School (NOVA IMS), Universidade Nova de Lisboa, Campus de Campolide, 1070-312 Lisboa, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8793-1451","authenticated-orcid":false,"given":"Mauro","family":"Castelli","sequence":"additional","affiliation":[{"name":"Nova Information Management School (NOVA IMS), Universidade Nova de Lisboa, Campus de Campolide, 1070-312 Lisboa, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2020,5,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1109\/RBME.2009.2034865","article-title":"Histopathological Image Analysis: A Review","volume":"2","author":"Gurcan","year":"2009","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e194337","DOI":"10.1001\/jamanetworkopen.2019.4337","article-title":"Trends in the US and Canadian Pathologist Workforces from 2007 to 2017","volume":"2","author":"Metter","year":"2019","journal-title":"JAMA Netw. Open"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation Applied to Handwritten Zip Code Recognition","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Comput."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Mohammadian, S., Karsaz, A., and Roshan, Y.M. (December, January 30). Comparative Study of Fine-Tuning of Pre-Trained Convolutional Neural Networks for Diabetic Retinopathy Screening. Proceedings of the 2017 24th National and 2nd International Iranian Conference on Biomedical Engineering (ICBME), Tehran, Iran.","DOI":"10.1109\/ICBME.2017.8430269"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Prenta\u0161i\u0107, P., and Lon\u010dari\u0107, S. (2015, January 7\u20139). Detection of exudates in fundus photographs using convolutional neural networks. Proceedings of the 2015 9th International Symposium on Image and Signal Processing and Analysis (ISPA), Zagreb, Croatia.","DOI":"10.1109\/ISPA.2015.7306056"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"72726","DOI":"10.1109\/ACCESS.2019.2920448","article-title":"Transfer learning with intelligent training data selection for prediction of Alzheimer\u2019s Disease","volume":"7","author":"Khan","year":"2019","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Farooq, A., Anwar, S.M., Awais, M., and Rehman, S. (2017, January 18\u201320). A deep CNN based multi-class classification of Alzheimer\u2019s disease using MRI. Proceedings of the 2017 IEEE International Conference on Imaging Systems and Techniques (IST), Beijing, China.","DOI":"10.1109\/IST.2017.8261460"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hosny, K.M., Kassem, M., and Foaud, M.M. (2019). Classification of skin lesions using transfer learning and augmentation with Alex-net. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0217293"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.jbi.2018.08.006","article-title":"Skin lesion classification with ensembles of deep convolutional neural networks","volume":"86","author":"Harangi","year":"2018","journal-title":"J. Biomed. Inform."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1007\/BF00344251","article-title":"Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position","volume":"36","author":"Fukushima","year":"1980","journal-title":"Boil. Cybern."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1098\/rspb.1977.0085","article-title":"Ferrier lecture. Functional architecture of macaque monkey visual cortex","volume":"198","author":"Hubel","year":"1977","journal-title":"Proc. R. Soc. Lond. Ser. B"},{"key":"ref_12","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Neural Inf. Process. Syst., 25."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"ImageNet Large Scale Visual Recognition Challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.1109\/TMI.2016.2535302","article-title":"Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?","volume":"35","author":"Tajbakhsh","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_15","unstructured":"Chollet, F. (2017). Deep Learning with Python, Manning Publications Co.. [1st ed.]."},{"key":"ref_16","unstructured":"Yosinski, J., Clune, J., Bengio, Y., and Lipson, H. (2014, January 8\u201313). How transferable are features in deep neural networks?. Proceedings of the Advances in Neural Information Processing Systems 27, Montreal, QC, Canada."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/j.icte.2018.10.007","article-title":"Breast cancer histology images classification: Training from scratch or transfer learning?","volume":"4","author":"Sharma","year":"2018","journal-title":"ICT Express"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1455","DOI":"10.1109\/TBME.2015.2496264","article-title":"A Dataset for Breast Cancer Histopathological Image Classification","volume":"63","author":"Spanhol","year":"2015","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_19","unstructured":"Kassani, S.H., Kassani, P.H., Wesolowski, M.J., Schneider, K.A., and Deters, R. (2019). Classification of Histopathological Biopsy Images Using Ensemble of Deep Learning Networks. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Veeling, B.S., Linmans, J., Winkens, J., Cohen, T., and Welling, M. (2018). Rotation Equivariant CNNs for Digital Pathology. Medical Image Computing and Computer Assisted Intervention\u2014MICCAI 2018, Springer.","DOI":"10.1007\/978-3-030-00934-2_24"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2199","DOI":"10.1001\/jama.2017.14585","article-title":"Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women with Breast Cancer","volume":"318","author":"Bejnordi","year":"2017","journal-title":"JAMA"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1016\/j.media.2019.05.010","article-title":"BACH: Grand challenge on breast cancer histology images","volume":"56","author":"Aresta","year":"2019","journal-title":"Med. Image Anal."},{"key":"ref_23","unstructured":"(2019, December 01). BioImaging Dataset. Available online: http:\/\/www.bioimaging2015.ineb.up.pt\/dataset.html."},{"key":"ref_24","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_25","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely Connected Convolutional Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Vesal, S., Ravikumar, N., Davari, A., Ellmann, S., and Maier, A. (2018). Classification of Breast Cancer Histology Images Using Transfer Learning; Image Analysis and Recognition, Springer Nature.","DOI":"10.1007\/978-3-319-93000-8_92"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1007\/s13755-018-0057-x","article-title":"Transfer learning based histopathologic image classification for breast cancer detection","volume":"6","author":"Deniz","year":"2018","journal-title":"Health Inf. Sci. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Ahmad, H.M., Ghuffar, S., and Khurshid, K. (2019, January 8\u201312). Classification of Breast Cancer Histology Images Using Transfer Learning. Proceedings of the IEEE International Bhurban Conference on Applied Sciences and Technology (IBCAST), Islamabad, Pakistan.","DOI":"10.1109\/IBCAST.2019.8667221"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Li, F.-F. (2009, January 20\u201325). ImageNet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A Survey on Transfer Learning","volume":"22","author":"Pan","year":"2010","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_35","first-page":"1","article-title":"ROC curve estimation: An overview","volume":"12","author":"AnaSubtil","year":"2014","journal-title":"Revstat Stat. J."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","article-title":"An introduction to ROC analysis","volume":"27","author":"Fawcett","year":"2006","journal-title":"Pattern Recognit. Lett."},{"key":"ref_37","first-page":"1929","article-title":"Dropout: A Simple Way to Prevent Neural Networks from Overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_38","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, The MIT Press."},{"key":"ref_39","first-page":"437","article-title":"Practical recommendations for gradient-based training of deep architectures","volume":"Volume 7700","author":"Bengio","year":"2012","journal-title":"Neural Networks: Tricks of the Trade"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/BF00058655","article-title":"Bagging Predictors","volume":"24","author":"Breiman","year":"1996","journal-title":"Mach. Learn."},{"key":"ref_41","unstructured":"Kingma, D., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/10\/10\/3359\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:28:07Z","timestamp":1760174887000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/10\/10\/3359"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,12]]},"references-count":41,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2020,5]]}},"alternative-id":["app10103359"],"URL":"https:\/\/doi.org\/10.3390\/app10103359","relation":{},"ISSN":["2076-3417"],"issn-type":[{"value":"2076-3417","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,12]]}}}