{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T19:12:45Z","timestamp":1767985965370,"version":"3.49.0"},"reference-count":51,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2021,1,24]],"date-time":"2021-01-24T00:00:00Z","timestamp":1611446400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2017YFB1303100"],"award-info":[{"award-number":["2017YFB1303100"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61871440"],"award-info":[{"award-number":["61871440"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In many medical image classification tasks, there is insufficient image data for deep convolutional neural networks (CNNs) to overcome the over-fitting problem. The light-weighted CNNs are easy to train but they usually have relatively poor classification performance. To improve the classification ability of light-weighted CNN models, we have proposed a novel batch similarity-based triplet loss to guide the CNNs to learn the weights. The proposed loss utilizes the similarity among multiple samples in the input batches to evaluate the distribution of training data. Reducing the proposed loss can increase the similarity among images of the same category and reduce the similarity among images of different categories. Besides this, it can be easily assembled into regular CNNs. To appreciate the performance of the proposed loss, some experiments have been done on chest X-ray images and skin rash images to compare it with several losses based on such popular light-weighted CNN models as EfficientNet, MobileNet, ShuffleNet and PeleeNet. The results demonstrate the applicability and effectiveness of our method in terms of classification accuracy, sensitivity and specificity.<\/jats:p>","DOI":"10.3390\/s21030764","type":"journal-article","created":{"date-parts":[[2021,1,25]],"date-time":"2021-01-25T12:28:31Z","timestamp":1611577711000},"page":"764","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Batch Similarity Based Triplet Loss Assembled into Light-Weighted Convolutional Neural Networks for Medical Image Classification"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3021-5662","authenticated-orcid":false,"given":"Zhiwen","family":"Huang","sequence":"first","affiliation":[{"name":"Key Laboratory of Molecular Biophysics of Ministry of Education, Department of Biomedical Engineering, School of Life Science and Technology, Huazhong University of Science and Technology, No 1037, Luoyu Road, Wuhan 430074, China"}]},{"given":"Quan","family":"Zhou","sequence":"additional","affiliation":[{"name":"Key Laboratory of Molecular Biophysics of Ministry of Education, Department of Biomedical Engineering, School of Life Science and Technology, Huazhong University of Science and Technology, No 1037, Luoyu Road, Wuhan 430074, China"}]},{"given":"Xingxing","family":"Zhu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Molecular Biophysics of Ministry of Education, Department of Biomedical Engineering, School of Life Science and Technology, Huazhong University of Science and Technology, No 1037, Luoyu Road, Wuhan 430074, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4332-071X","authenticated-orcid":false,"given":"Xuming","family":"Zhang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Molecular Biophysics of Ministry of Education, Department of Biomedical Engineering, School of Life Science and Technology, Huazhong University of Science and Technology, No 1037, Luoyu Road, Wuhan 430074, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1038\/s41591-018-0316-z","article-title":"A guide to deep learning in healthcare","volume":"25","author":"Esteva","year":"2019","journal-title":"Nat. Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"ACM Commun."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"30735","DOI":"10.1007\/s11042-020-09518-w","article-title":"Breast cancer masses classification using deep convolutional neural networks and transfer learning","volume":"79","author":"Hassan","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Maqsood, M., Nazir, F., Khan, U., Aadil, F., Jamal, H., Mehmood, I., and Song, O. (2019). Transfer learning assisted classification and detection of Alzheimer\u2019s disease stages using 3D MRI scans. Sensors, 19.","DOI":"10.3390\/s19112645"},{"key":"ref_5","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very deep convolutional networks for large-scale image recognition. Proceedings of the 3rd International Conference Learn. Represent (ICLR), San Diego, CA, USA."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4876","DOI":"10.7150\/jca.28769","article-title":"Deep convolutional neural network VGG-16 model for differential diagnosing of papillary thyroid carcinomas in cytological images: A pilot study","volume":"10","author":"Guan","year":"2019","journal-title":"J. Cancer"},{"key":"ref_7","first-page":"579","article-title":"A classification-detection approach of COVID-19 based on chest X-ray and CT by using Keras pre-trained deep learning models","volume":"125","author":"Deng","year":"2020","journal-title":"Comput. Model. Eng. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (July, January 26). Rethinking the Inception architecture for computer vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1038\/nature21056","article-title":"Dermatologist-level classification of skin cancer with deep neural networks","volume":"542","author":"Esteva","year":"2017","journal-title":"Nature"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1016\/j.tranon.2018.10.012","article-title":"A Deep learning-based radiomics model for differentiating benign and malignant renal tumors","volume":"12","author":"Zhou","year":"2019","journal-title":"Transl. Oncol."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/j.patcog.2018.02.006","article-title":"A deeply supervised residual network for HEp-2 cell classification via cross-modal transfer learning","volume":"79","author":"Lei","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"6057","DOI":"10.1364\/BOE.10.006057","article-title":"Deep learning for quality assessment of retinal OCT images","volume":"10","author":"Wang","year":"2019","journal-title":"Biomed. Opt. Express"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_15","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhou, X., Lin, M., and Sun, J. (2018, January 18\u201323). ShuffleNet: An extremely efficient convolutional neural network for mobile devices. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00716"},{"key":"ref_17","unstructured":"Tan, M., and Le, Q.V. (2019, January 9\u201315). EfficientNet: Rethinking model scaling for convolutional neural networks. Proceedings of the 36th International Conference on Machine Learning (ICML), Long Beach, CA, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1109\/TASE.2019.2936645","article-title":"Densely connected neural network with unbalanced discriminant and category sensitive constraints for polyp recognition","volume":"17","author":"Yuan","year":"2019","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Brehar, R., Mitrea, D.-A., Vancea, F., Marita, T., Nedevschi, S., Lupsor-Platon, M., Rotaru, M., and Badea, R.I. (2020). Comparison of deep-learning and conventional machine-learning methods for the automatic recognition of the hepatocellular carcinoma areas from ultrasound images. Sensors, 20.","DOI":"10.3390\/s20113085"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.-C. (2018, January 18\u201323). MobileNetV2: Inverted residuals and linear bottlenecks. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Abdani, S.R., Zulkifley, M.A., and Hani Zulkifley, N. (2020, January 17\u201318). A lightweight deep learning model for covid-19 detection. Proceedings of the 2020 IEEE Symposium on Industrial Electronics & Applications (ISIEA), Penang, Malaysia.","DOI":"10.1109\/ISIEA49364.2020.9188133"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"106691","DOI":"10.1016\/j.asoc.2020.106691","article-title":"Automated medical diagnosis of COVID-19 through EfficientNet convolutional neural network","volume":"96","author":"Marques","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/s10479-005-5724-z","article-title":"A tutorial on the cross-entropy method","volume":"134","author":"Kroese","year":"2005","journal-title":"Ann. Oper. Res."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, S., Wang, D., Kong, D., Wang, J., Li, W., and Zhou, S. (2020). Few-shot rolling bearing fault diagnosis with metric-based meta learning. Sensors, 20.","DOI":"10.3390\/s20226437"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Kaya, M., and Bilge, H.\u015e. (2019). Bilge Deep metric learning: A survey. Symmetry, 11.","DOI":"10.3390\/sym11091066"},{"key":"ref_26","unstructured":"Chopra, S., Hadsell, R., and LeCun, Y. (2005, January 20\u201325). Learning a similarity metric discriminatively, with application to face verification. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, USA."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Hoffer, E., and Ailon, N. (2015, January 12\u201314). Deep metric learning using triplet network. Proceedings of the International Workshop on Similarity-Based Pattern Recognition, Copenhagen, Denmark.","DOI":"10.1007\/978-3-319-24261-3_7"},{"key":"ref_28","first-page":"1857","article-title":"Improved deep metric learning with multi-class N-pair loss objective","volume":"29","author":"Sohn","year":"2016","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Song, H.O., Xiang, Y., Jegelka, S., and Savarese, S. (July, January 26). Deep metric learning via lifted structured feature embedding. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.434"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Hu, J., Lu, J., and Tan, Y.-P. (2014, January 23\u201328). Discriminative deep metric learning for face verification in the wild. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.242"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Khaneja, A., Srivastava, S., Rai, A., Cheema, A., and Srivastava, P. (2020, January 22\u201324). Analysing risk of coronary heart disease through discriminative neural networks. Proceedings of the 9th International Conference on Pattern Recognition Applications and Methods (ICPRAM), Valletta, Malta.","DOI":"10.5220\/0009190106150620"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Shorfuzzaman, M., and Hossain, M.S. (2020). MetaCOVID: A siamese neural network framework with contrastive loss for n-shot diagnosis of COVID-19 patients. Pattern Recognit., 107700.","DOI":"10.1016\/j.patcog.2020.107700"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Gupta, K., Thapar, D., Bhavsar, A., and Sao, A.K. (2019, January 16\u201317). Deep metric learning for identification of mitotic patterns of HEp-2 cell images. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00141"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Sun, X., and Qian, H. (2016). Chinese herbal medicine image recognition and retrieval by convolutional neural network. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0156327"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Lei, W., Zhang, R., Yang, Y., Wang, R., and Zheng, W.-S. (2020, January 3\u20137). Class-center involved triplet loss for skin disease classification on imbalanced data. Proceedings of the 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI), Iowa City, IA, USA.","DOI":"10.1109\/ISBI45749.2020.9098718"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L.C., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., and Pang, R. (November, January 27). Searching for MobileNetV3. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00140"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ma, N., Zhang, X., Zheng, H.T., and Sun, J. (2018, January 8\u201314). Shufflenet V2: Practical guidelines for efficient CNN architecture design. Proceedings of the 15th European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01264-9_8"},{"key":"ref_38","first-page":"1963","article-title":"Pelee: A real-time object detection system on mobile devices","volume":"31","author":"Wang","year":"2018","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_39","first-page":"1109","article-title":"Large scale online learning of image similarity through ranking","volume":"11","author":"Chechik","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1006\/jmaa.1996.0157","article-title":"Generalizations of Hadamard products of functions with negative coefficients","volume":"199","author":"Choi","year":"1996","journal-title":"J. Math. Anal. Appl."},{"key":"ref_41","unstructured":"Kermany, D., Zhang, K., and Goldbaum, M. (2018). Large dataset of labeled optical coherence tomography (OCT) and chest X-ray images for classification. Mendeley Data."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1016\/j.cell.2018.02.010","article-title":"Identifying medical diagnoses and treatable diseases by image-based deep learning","volume":"172","author":"Kermany","year":"2018","journal-title":"Cell"},{"key":"ref_43","unstructured":"(2020, December 21). Kaggle. Available online: https:\/\/www.kaggle.com\/."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","article-title":"Least squares quantization in PCM","volume":"28","author":"Lloyd","year":"1982","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"i501","DOI":"10.1093\/bioinformatics\/btz318","article-title":"MOLI: Multi-omics late integration with deep neural networks for drug response prediction","volume":"35","author":"Zolotareva","year":"2019","journal-title":"Bioinformatics"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"5863","DOI":"10.1007\/s11042-018-6408-4","article-title":"Deep feature embedding learning for person re-identification based on lifted structured loss","volume":"78","author":"He","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_47","unstructured":"(2019, May 31). Lyme Disease Rashes. Available online: https:\/\/www.kaggle.com\/sshikamaru\/lyme-disease-rashes."},{"key":"ref_48","unstructured":"Mishra, R., Daescu, O., Leavey, P., Rakheja, D., and Sengupta, A. (June, January 30). Histopathological diagnosis for viable and non-viable tumor prediction for osteosarcoma using convolutional neural network. Proceedings of the International Symposium on Bioinformatics Research and Applications (ISBRA), Honolulu, HI, USA."},{"key":"ref_49","unstructured":"Arunachalam, H.B., Mishra, R., Armaselu, B., Daescu, O., Martinez, M., Leavey, P., Rakheja, D., Cederberg, K., Sengupta, A., and Ni\u2019Suilleabhain, M. (2017, January 3\u20137). Computer aided image segmentation and classification for viable and non-viable tumor identification in osteosarcoma. Proceedings of the Pacific Symposium on Biocomputing (PSB), Kohala Coast, HI, USA."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1089\/cmb.2017.0153","article-title":"Convolutional neural network for histopathological analysis of osteosarcoma","volume":"25","author":"Mishra","year":"2018","journal-title":"J. Comput. Biol."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1007\/s10278-013-9622-7","article-title":"The cancer imaging archive (TCIA): Maintaining and operating a public information repository","volume":"26","author":"Clark","year":"2013","journal-title":"J. Digit. Imaging"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/3\/764\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:14:37Z","timestamp":1760159677000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/3\/764"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,24]]},"references-count":51,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["s21030764"],"URL":"https:\/\/doi.org\/10.3390\/s21030764","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,24]]}}}