{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T17:01:43Z","timestamp":1778086903065,"version":"3.51.4"},"reference-count":44,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,1,14]],"date-time":"2022-01-14T00:00:00Z","timestamp":1642118400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>Transfer learning is a machine learning technique that uses previously acquired knowledge from a source domain to enhance learning in a target domain by reusing learned weights. This technique is ubiquitous because of its great advantages in achieving high performance while saving training time, memory, and effort in network design. In this paper, we investigate how to select the best pre-trained model that meets the target domain requirements for image classification tasks. In our study, we refined the output layers and general network parameters to apply the knowledge of eleven image processing models, pre-trained on ImageNet, to five different target domain datasets. We measured the accuracy, accuracy density, training time, and model size to evaluate the pre-trained models both in training sessions in one episode and with ten episodes.<\/jats:p>","DOI":"10.3390\/make4010002","type":"journal-article","created":{"date-parts":[[2022,1,16]],"date-time":"2022-01-16T20:45:21Z","timestamp":1642365921000},"page":"22-41","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":57,"title":["A Transfer Learning Evaluation of Deep Neural Networks for Image Classification"],"prefix":"10.3390","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9683-5920","authenticated-orcid":false,"given":"Nermeen","family":"Abou Baker","sequence":"first","affiliation":[{"name":"Computer Science Institute, Ruhr West University of Applied Sciences, 46236 Bottrop, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1319-5877","authenticated-orcid":false,"given":"Nico","family":"Zengeler","sequence":"additional","affiliation":[{"name":"Computer Science Institute, Ruhr West University of Applied Sciences, 46236 Bottrop, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1230-9446","authenticated-orcid":false,"given":"Uwe","family":"Handmann","sequence":"additional","affiliation":[{"name":"Computer Science Institute, Ruhr West University of Applied Sciences, 46236 Bottrop, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.zemedi.2018.11.002","article-title":"An overview of deep learning in medical imaging focusing on MRI","volume":"29","author":"Lundervold","year":"2019","journal-title":"Z. Fur Med. Phys."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Pires de Lima, R., and Marfurt, K. (2020). Convolutional Neural Network for Remote-Sensing Scene Classification: Transfer Learning Analysis. Remote Sens., 12.","DOI":"10.3390\/rs12010086"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1007\/s11220-018-0191-1","article-title":"Transfer Learning for Classification of Optical Satellite Image","volume":"19","author":"Zou","year":"2018","journal-title":"Sens. Imaging"},{"key":"ref_4","unstructured":"Abou Baker, N., Szabo-M\u00fcller, P., and Handmann, U. (2020, January 10\u201311). Feature-fusion transfer learning method as a basis to support automated smartphone recycling in a circular smart city. Proceedings of the EAI S-CUBE 2020\u201411th EAI International Conference on Sensor Systems and Software, Aalborg, Denmark."},{"key":"ref_5","unstructured":"Houlsby, N., Giurgiu, A., Jastrzebski, S., Morrone, B., de Laroussilhe, Q., Gesmundo, A., Attariyan, M., and Gelly, S. (2019). Parameter-Efficient Transfer Learning for NLP. arXiv."},{"key":"ref_6","first-page":"1","article-title":"The Real-Time Mobile Application for Classifying of Endangered Parrot Species Using the CNN Models Based on Transfer Learning","volume":"2020","author":"Choe","year":"2020","journal-title":"Mob. Inf. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., and Muller, P.A. (2018, January 10\u201313). Transfer learning for time series classification. Proceedings of the 2018 IEEE International Conference on Big Data (Big Data), Seattle, WA, USA.","DOI":"10.1109\/BigData.2018.8621990"},{"key":"ref_8","unstructured":"Canziani, A., Paszke, A., and Culurciello, E. (2017). An Analysis of Deep Neural Network Models for Practical Applications. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"64270","DOI":"10.1109\/ACCESS.2018.2877890","article-title":"Benchmark Analysis of Representative Deep Neural Network Architectures","volume":"6","author":"Bianco","year":"2018","journal-title":"IEEE Access"},{"key":"ref_10","unstructured":"Socher, R., Ganjoo, M., Sridhar, H., Bastani, O., Manning, C.D., and Ng, A.Y. (2013). Zero-Shot Learning Through Cross-Modal Transfer. arXiv."},{"key":"ref_11","unstructured":"Xian, Y., Schiele, B., and Akata, Z. (2020). Zero-Shot Learning\u2014The Good, the Bad and the Ugly. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1109\/TPAMI.2013.140","article-title":"Attribute-Based Classification for Zero-Shot Visual Object Categorization","volume":"36","author":"Lampert","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zhang, Z., and Saligrama, V. (2015). Zero-Shot Learning via Semantic Similarity Embedding. arXiv.","DOI":"10.1109\/ICCV.2015.474"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1425","DOI":"10.1109\/TPAMI.2015.2487986","article-title":"Label-Embedding for Image Classification","volume":"38","author":"Akata","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","unstructured":"Bart, E., and Ullman, S. (2005, January 20\u201326). Cross-generalization: Learning novel classes from a single example by feature replacement. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_16","unstructured":"Saul, L., Weiss, Y., and Bottou, L. (2005). Object Classification from a Single Example Utilizing Class Relevance Metrics. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Tommasi, T., and Caputo, B. (2009, January 7\u201310). The More You Know, the Less You Learn: From Knowledge Transfer to One-shot Learning of Object Categories. Proceedings of the BMVC, London, UK. Available online: http:\/\/www.bmva.org\/bmvc\/2009\/Papers\/Paper353\/Paper353.html.","DOI":"10.5244\/C.23.80"},{"key":"ref_18","first-page":"63","article-title":"Generalizing from a Few Examples: A Survey on Few-Shot Learning","volume":"53","author":"Wang","year":"2020","journal-title":"ACM Comput. Surv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Azadi, S., Fisher, M., Kim, V., Wang, Z., Shechtman, E., and Darrell, T. (2017). Multi-Content GAN for Few-Shot Font Style Transfer. arXiv.","DOI":"10.1109\/CVPR.2018.00789"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Liu, B., Wang, X., Dixit, M., Kwitt, R., and Vasconcelos, N. (2019). Feature Space Transfer for Data Augmentation. arXiv.","DOI":"10.1109\/CVPR.2018.00947"},{"key":"ref_21","unstructured":"Luo, Z., Zou, Y., Hoffman, J., and Fei-Fei, L. (2017). Label Efficient Learning of Transferable Representations across Domains and Tasks. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Tan, W.C., Chen, I.M., Pantazis, D., and Pan, S.J. (2018, January 20\u201324). Transfer Learning with PipNet: For Automated Visual Analysis of Piping Design. Proceedings of the 2018 IEEE 14th International Conference on Automation Science and Engineering (CASE), Munich, Germany.","DOI":"10.1109\/COASE.2018.8560550"},{"key":"ref_23","unstructured":"Mont\u00fafar, G., Pascanu, R., Cho, K., and Bengio, Y. (2014). On the Number of Linear Regions of Deep Neural Networks. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1462","DOI":"10.1162\/neco_a_01195","article-title":"Effect of Depth and Width on Local Minima in Deep Learning","volume":"31","author":"Kawaguchi","year":"2019","journal-title":"Neural Comput."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5455","DOI":"10.1007\/s10462-020-09825-6","article-title":"A survey of the recent architectures of deep convolutional neural networks","volume":"53","author":"Khan","year":"2020","journal-title":"Artif. Intell. Rev."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1142\/S0218488598000094","article-title":"The Vanishing Gradient Problem during Learning Recurrent Neural Nets and Problem Solutions","volume":"6","author":"Hochreiter","year":"1998","journal-title":"Int. J. Uncertain. Fuzziness Knowl.-Based Syst."},{"key":"ref_27","unstructured":"Srivastava, R.K., Greff, K., and Schmidhuber, J. (2015). Highway Networks. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201322). Squeeze-and-Excitation Networks. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_29","first-page":"1097","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_30","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep Residual Learning for Image Recognition. arXiv.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_33","unstructured":"Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Xie, S., Girshick, R., Dollar, P., Tu, Z., and He, K. (2017, January 21\u201326). Aggregated Residual Transformations for Deep Neural Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.634"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely Connected Convolutional Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_36","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zagoruyko, S., and Komodakis, N. (2017). Wide Residual Networks. arXiv.","DOI":"10.5244\/C.30.87"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhou, X., Lin, M., and Sun, J. (2017). ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices. arXiv.","DOI":"10.1109\/CVPR.2018.00716"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Tan, M., Chen, B., Pang, R., Vasudevan, V., Sandler, M., Howard, A., and Le, Q.V. (2019). MnasNet: Platform-Aware Neural Architecture Search for Mobile. arXiv.","DOI":"10.1109\/CVPR.2019.00293"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zaheer, R., and Shaziya, H. (2019, January 10\u201311). A Study of the Optimization Algorithms in Deep Learning. Proceedings of the 2019 Third International Conference on Inventive Systems and Control (ICISC), Coimbatore, India.","DOI":"10.1109\/ICISC44355.2019.9036442"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Kaziha, O., and Bonny, T. (2019, January 19\u201321). A Comparison of Quantized Convolutional and LSTM Recurrent Neural Network Models Using MNIST. Proceedings of the 2019 International Conference on Electrical and Computing Technologies and Applications (ICECTA), Ras Al Khaimah, United Arab Emirates.","DOI":"10.1109\/ICECTA48151.2019.8959793"},{"key":"ref_42","first-page":"8024","article-title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","volume":"32","author":"Paszke","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_43","unstructured":"Baker, N.A., Szabo-M\u00fdller, P., and Handmann, U. (2021). Transfer learning-based method for automated e-waste recycling in smart cities. EAI Endorsed Trans. Smart Cities, 5."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Chen, L., Li, S., Bai, Q., Yang, J., Jiang, S., and Miao, Y. (2021). Review of Image Classification Algorithms Based on Convolutional Neural Networks. Remote Sens., 13.","DOI":"10.3390\/rs13224712"}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/4\/1\/2\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:02:26Z","timestamp":1760364146000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/4\/1\/2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,14]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["make4010002"],"URL":"https:\/\/doi.org\/10.3390\/make4010002","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,14]]}}}