{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T11:04:38Z","timestamp":1768907078617,"version":"3.49.0"},"reference-count":31,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2022,10,20]],"date-time":"2022-10-20T00:00:00Z","timestamp":1666224000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>It is well known that biomedical imaging analysis plays a crucial role in the healthcare sector and produces a huge quantity of data. These data can be exploited to study diseases and their evolution in a deeper way or to predict their onsets. In particular, image classification represents one of the main problems in the biomedical imaging context. Due to the data complexity, biomedical image classification can be carried out by trainable mathematical models, such as artificial neural networks. When employing a neural network, one of the main challenges is to determine the optimal duration of the training phase to achieve the best performance. This paper introduces a new adaptive early stopping technique to set the optimal training time based on dynamic selection strategies to fix the learning rate and the mini-batch size of the stochastic gradient method exploited as the optimizer. The numerical experiments, carried out on different artificial neural networks for image classification, show that the developed adaptive early stopping procedure leads to the same literature performance while finalizing the training in fewer epochs. The numerical examples have been performed on the CIFAR100 dataset and on two distinct MedMNIST2D datasets which are the large-scale lightweight benchmark for biomedical image classification.<\/jats:p>","DOI":"10.3390\/a15100386","type":"journal-article","created":{"date-parts":[[2022,10,20]],"date-time":"2022-10-20T20:35:55Z","timestamp":1666298155000},"page":"386","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Biomedical Image Classification via Dynamically Early Stopped Artificial Neural Network"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9082-8087","authenticated-orcid":false,"given":"Giorgia","family":"Franchini","sequence":"first","affiliation":[{"name":"Department of Physics, Informatics and Mathematics, University of Modena and Reggio Emilia, 41125 Modena, Italy"}]},{"given":"Micaela","family":"Verucchi","sequence":"additional","affiliation":[{"name":"Department of Physics, Informatics and Mathematics, University of Modena and Reggio Emilia, 41125 Modena, Italy"},{"name":"HiPeRT Srl, 41125 Modena, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6378-3063","authenticated-orcid":false,"given":"Ambra","family":"Catozzi","sequence":"additional","affiliation":[{"name":"Department of Physics, Informatics and Mathematics, University of Modena and Reggio Emilia, 41125 Modena, Italy"},{"name":"Department of Mathematical, Physical and Computer Sciences, University of Parma, 43124 Parma, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0713-5421","authenticated-orcid":false,"given":"Federica","family":"Porta","sequence":"additional","affiliation":[{"name":"Department of Physics, Informatics and Mathematics, University of Modena and Reggio Emilia, 41125 Modena, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7327-3347","authenticated-orcid":false,"given":"Marco","family":"Prato","sequence":"additional","affiliation":[{"name":"Department of Physics, Informatics and Mathematics, University of Modena and Reggio Emilia, 41125 Modena, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1137\/16M1080173","article-title":"Optimization Methods for Large-Scale Machine Learning","volume":"60","author":"Bottou","year":"2018","journal-title":"SIAM Rev."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"653","DOI":"10.1007\/s10589-020-00220-z","article-title":"Momentum and Stochastic Momentum for Stochastic Gradient, Newton, Proximal Point and Subspace Descent Methods","volume":"77","author":"Loizou","year":"2020","journal-title":"Comput. Optim. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3934\/mine.2023012","article-title":"Neural architecture search via standard machine learning methodologies","volume":"5","author":"Franchini","year":"2022","journal-title":"Math. Eng."},{"key":"ref_4","unstructured":"Nakkiran, P. (2020, January 18\u201320). Learning Rate Annealing Can Provably Help Generalization, Even for Convex Problems. Proceedings of the OPT2020: 12th Annual Workshop on Optimization for Machine Learning, Bangkok, Thailand."},{"key":"ref_5","unstructured":"Li, Y., Wei, C., and Ma, T. (2019, January 8\u201314). Towards Explaining the Regularization Effect of Initial Large Learning Rate in Training Neural Networks. Proceedings of the 33rd International Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_6","unstructured":"Bochkovskiy, A., Wang, C., and Liao, H.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ramachandran, S., George, J., Skaria, S., and Varun, V. (2018, January 12\u201315). Using YOLO based deep learning network for real time detection and localization of lung nodules from low dose CT scans. Proceedings of the Medical Imaging 2018: Computer-Aided Diagnosis, Houston, TX, USA.","DOI":"10.1117\/12.2293699"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.neunet.2018.01.016","article-title":"Effective neural network training with adaptive learning rate based on training loss","volume":"101","author":"Takase","year":"2018","journal-title":"Neural Netw."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Mishra, S., Yamasaki, T., and Imaizumi, H. (2019, January 27\u201331). Improving image classifiers for small datasets by learning rate adaptations. Proceedings of the 16th International Conference on Machine Vision Applications (MVA), Tokyo, Japan.","DOI":"10.23919\/MVA.2019.8757890"},{"key":"ref_10","unstructured":"Masters, D., and Luschi, C. (2018). Revisiting Small Batch Training for Deep Neural Networks. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"A1380","DOI":"10.1137\/110830629","article-title":"Hybrid Deterministic-Stochastic Methods for Data Fitting","volume":"34","author":"Friedlander","year":"2012","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_12","unstructured":"Alfarra, M., Hanzely, S., Albasyoni, A., Ghanem, B., and Richtarik, P. (2020, January 18\u201320). Adaptive Learning of the Optimal Mini-Batch Size of SGD. Proceedings of the OPT2020: 12th Annual Workshop on Optimization for Machine Learning, Bangkok, Thailand."},{"key":"ref_13","unstructured":"Abraham, A., Cherukuri, A., Melin, P., and Gandhi, N. (2020, January 12\u201315). Artificial Neural Networks: The Missing Link Between Curiosity and Accuracy. Proceedings of the Intelligent Systems Design and Applications, Vellore, India."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1016\/j.icte.2020.04.010","article-title":"The effect of batch size on the generalizability of the convolutional neural networks on a histopathology dataset","volume":"6","author":"Kandel","year":"2020","journal-title":"ICT Express"},{"key":"ref_15","unstructured":"Smith, S., Kindermans, P.J., and Le, Q. (May, January 30). Don\u2019t Decay the Learning Rate, Increase the Batch Size. Proceedings of the 6th International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Nicosia, G., Ojha, V., La Malfa, E., Jansen, G., Sciacca, V., Pardalos, P., Giuffrida, G., and Umeton, R. (2020, January 19\u201323). Steplength and Mini-batch Size Selection in Stochastic Gradient Methods. Proceedings of the Machine Learning, Optimization, and Data Science, Siena, Italy.","DOI":"10.1007\/978-3-030-64580-9"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"107108","DOI":"10.1016\/j.asoc.2021.107108","article-title":"Distributed computation offloading method based on deep reinforcement learning in ICV","volume":"103","author":"Chen","year":"2021","journal-title":"Appl. Soft Comput."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wu, Y., Yue, Y., Tan, X., Wang, W., and Lu, T. (2018, January 7\u201310). End-to-end chromosome Karyotyping with data augmentation using GAN. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451041"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1109\/TMM.2021.3055959","article-title":"Global-local label correlation for partial multi-label learning","volume":"24","author":"Sun","year":"2021","journal-title":"IEEE Trans. Multimed."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Montavon, G., Orr, G.B., and M\u00fcller, K.R. (2012). Early Stopping\u2014But When?. Neural Networks: Tricks of the Trade, Springer. [2nd ed.].","DOI":"10.1007\/978-3-642-35289-8"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1145\/3381831","article-title":"Green AI","volume":"63","author":"Schwartz","year":"2020","journal-title":"Commun. ACM"},{"key":"ref_22","unstructured":"Krizhevsky, A., and Hinton, G. (2009). Learning Multiple Layers of Features from Tiny Images, University of Toronto. Technical Report TR-2009."},{"key":"ref_23","unstructured":"Yang, J., Shi, R., Wei, D., Liu, Z., Zhao, L., Ke, B., Pfister, H., and Ni, B. (2021). MedMNIST v2: A Large-Scale Lightweight Benchmark for 2D and 3D Biomedical Image Classification. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1016\/j.cell.2018.02.010","article-title":"Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning","volume":"172","author":"Kermany","year":"2018","journal-title":"Cell"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Yang, J., Shi, R., and Ni, B. (2021, January 13\u201316). MedMNIST Classification Decathlon: A Lightweight AutoML Benchmark for Medical Image Analysis. Proceedings of the IEEE 18th International Symposium on Biomedical Imaging (ISBI), Nice, France.","DOI":"10.1109\/ISBI48211.2021.9434062"},{"key":"ref_26","unstructured":"Bilic, P., Christ, P.F., Vorontsov, E., Chlebus, G., Chen, H., Dou, Q., and Menze, B.H. (2019). The Liver Tumor Segmentation Benchmark (LiTS). arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1885","DOI":"10.1109\/TMI.2019.2894854","article-title":"Efficient Multiple Organ Localization in CT Image Using 3D Region Proposal Network","volume":"38","author":"Xu","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_29","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_30","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_31","unstructured":"Kingma, D., and Ba, J. (2017). Adam: A Method for Stochastic Optimization. arXiv."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/10\/386\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:57:48Z","timestamp":1760144268000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/10\/386"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,20]]},"references-count":31,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["a15100386"],"URL":"https:\/\/doi.org\/10.3390\/a15100386","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,20]]}}}