{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T00:48:43Z","timestamp":1769906923668,"version":"3.49.0"},"reference-count":28,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,27]],"date-time":"2022-01-27T00:00:00Z","timestamp":1643241600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Medical data includes clinical trials and clinical data such as patient-generated health data, laboratory results, medical imaging, and different signals coming from continuous health monitoring. Some commonly used data analysis techniques are text mining, big data analytics, and data mining. These techniques can be used for classification, clustering, and machine learning tasks. Machine learning could be described as an automatic learning process derived from concepts and knowledge without deliberate system coding. However, finding a suitable machine learning architecture for a specific task is still an open problem. In this work, we propose a machine learning model for the multi-class classification of medical data. This model is comprised of two components\u2014a restricted Boltzmann machine and a classifier system. It uses a discriminant pruning method to select the most salient neurons in the hidden layer of the neural network, which implicitly leads to a selection of features for the input patterns that feed the classifier system. This study aims to investigate whether information-entropy measures may provide evidence for guiding discriminative pruning in a neural network for medical data processing, particularly cancer research, by using three cancer databases: Breast Cancer, Cervical Cancer, and Primary Tumour. Our proposal aimed to investigate the post-training neuronal pruning methodology using dissimilarity measures inspired by the information-entropy theory; the results obtained after pruning the neural network were favourable. Specifically, for the Breast Cancer dataset, the reported results indicate a 10.68% error rate, while our error rates range from 10% to 15%; for the Cervical Cancer dataset, the reported best error rate is 31%, while our proposal error rates are in the range of 4% to 6%; lastly, for the Primary Tumour dataset, the reported error rate is 20.35%, and our best error rate is 31%.<\/jats:p>","DOI":"10.3390\/e24020196","type":"journal-article","created":{"date-parts":[[2022,1,27]],"date-time":"2022-01-27T21:59:55Z","timestamp":1643320795000},"page":"196","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Multi-Class Classification of Medical Data Based on Neural Network Pruning and Information-Entropy Measures"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1101-5956","authenticated-orcid":false,"given":"M\u00e1ximo Eduardo","family":"S\u00e1nchez-Guti\u00e9rrez","sequence":"first","affiliation":[{"name":"Colegio de Ciencia y Tecnolog\u00eda, Universidad Aut\u00f3noma de la Ciudad de M\u00e9xico, Ciudad de Mexico 06720, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7223-9035","authenticated-orcid":false,"given":"Pedro Pablo","family":"Gonz\u00e1lez-P\u00e9rez","sequence":"additional","affiliation":[{"name":"Departamento de Matem\u00e1ticas Aplicadas y Sistemas, Universidad Aut\u00f3noma Metropolitana-Cuajimalpa, Ciudad de Mexico 05348, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/s10654-020-00677-6","article-title":"Data extraction for epidemiological research (DExtER): A novel tool for automated clinical epidemiology studies","volume":"36","author":"Gokhale","year":"2021","journal-title":"Eur. J. Epidemiol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.jclinepi.2020.11.014","article-title":"Text-mining in electronic healthcare records can be used as efficient tool for screening and data collection in cardiovascular trials: A multicenter validation study","volume":"132","author":"Fiolet","year":"2021","journal-title":"J. Clin. Epidemiol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"102086","DOI":"10.1016\/j.artmed.2021.102086","article-title":"Med7: A transferable clinical natural language processing model for electronic health records","volume":"118","author":"Kormilitzin","year":"2021","journal-title":"Artif. Intell. Med."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Vitabile, S., Marks, M., Stojanovic, D., Pllana, S., Molina, J.M., Krzyszton, M., Sikora, A., Jarynowski, A., Hosseinpour, F., and Jakobik, A. (2019). Medical Data Processing and Analysis for Remote Health and Activities Monitoring. High-Performance Modelling and Simulation for Big Data Applications, Springer.","DOI":"10.1007\/978-3-030-16272-6_7"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.specom.2020.03.006","article-title":"Discriminative neural network pruning in a multiclass environment: A case study in spoken emotion recognition","volume":"120","year":"2020","journal-title":"Speech Commun."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1038\/s41583-020-0277-3","article-title":"Backpropagation and the brain","volume":"21","author":"Lillicrap","year":"2020","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1071","DOI":"10.1007\/s11831-019-09344-w","article-title":"A Survey of Deep Learning and Its Applications: A New Paradigm to Machine Learning","volume":"27","author":"Dargan","year":"2020","journal-title":"Arch. Comput. Methods Eng."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"107899","DOI":"10.1016\/j.patcog.2021.107899","article-title":"Pruning by explaining: A novel criterion for deep neural network pruning","volume":"115","author":"Yeom","year":"2021","journal-title":"Pattern Recognit."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"6161","DOI":"10.1002\/int.22546","article-title":"Scalable feature selection using ReliefF aided by locality-sensitive hashin","volume":"36","author":"Bahamonde","year":"2021","journal-title":"Int. J. Intell. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"016005","DOI":"10.1088\/1752-7163\/abc09b","article-title":"Adsorption kinetics feature extraction from breathprint obtained by graphene based sensors for diabetes diagnosis","volume":"15","author":"Kalidoss","year":"2020","journal-title":"J. Breath Res."},{"key":"ref_11","first-page":"126716","article-title":"Storing, learning and retrieving biased patterns","volume":"415","author":"Agliari","year":"2022","journal-title":"Appl. Math. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Pandey, B., Pandey, D.K., Mishra, B.P., and Rhmann, W. (2021). A comprehensive survey of deep learning in the field of medical imaging and medical natural language processing: Challenges and research directions. J. King Saud Univ.-Comput. Inf. Sci.","DOI":"10.1016\/j.jksuci.2021.01.007"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"107466","DOI":"10.1016\/j.asoc.2021.107466","article-title":"Reinforcing learning in Deep Belief Networks through nature-inspired optimization","volume":"108","author":"Roder","year":"2021","journal-title":"Appl. Soft Comput."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Javeed, M., Gochoo, M., Jalal, A., and Kim, K. (2021). HF-SPHR: Hybrid Features for Sustainable Physical Healthcare Pattern Recognition Using Deep Belief Networks. Sustainability, 13.","DOI":"10.3390\/su13041699"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Coto-Jim\u00e9nez, M. (2021). Discriminative Multi-Stream Postfilters Based on Deep Learning for Enhancing Statistical Parametric Speech Synthesis. Biomimetics, 6.","DOI":"10.3390\/biomimetics6010012"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Hinton, G.E. (2012). A practical guide to training restricted Boltzmann machines. Neural Networks: Tricks of the Trade, Springer.","DOI":"10.1007\/978-3-642-35289-8_32"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1007\/s12272-019-01162-9","article-title":"Applications of deep learning for the analysis of medical data","volume":"42","author":"Jang","year":"2019","journal-title":"Arch. Pharmacal Res."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.gpb.2017.07.003","article-title":"Deep learning and its applications in biomedicine","volume":"16","author":"Cao","year":"2018","journal-title":"Genom. Proteom. Bioinform."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Papadopoulos, T.G., Plati, D., Tripoliti, E.E., Goletsis, Y., Naka, K.K., Rammos, A., Bechlioulis, A., Watson, C., McDonald, K., and Ledwidge, M. (2021, January 1\u20135). Heart Failure diagnosis based on deep learning techniques. Proceedings of the 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Guadalajara, Mexico.","DOI":"10.1109\/EMBC46164.2021.9630409"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Boyadzhiev, T., Dimitrova, S., and Tsvetanov, S. (2021). Comparison of Auto-Encoder Training Algorithms. International Conference on Human Interaction and Emerging Technologies, Springer.","DOI":"10.1007\/978-3-030-85540-6_88"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Naoum, H., Benslimane, S.M., and Boukadoum, M. (2021, January 26\u201328). Classical and Brain-inspired Neural Networks for Substance Identification and Breast Cancer Detection: The Chaos Challenge. Proceedings of the 2021 1st International Conference on Cyber Management and Engineering (CyMaEn), Hammamet, Tunisia.","DOI":"10.1109\/CyMaEn50288.2021.9497280"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Fernandes, K., Cardoso, J.S., and Fernandes, J. (2017). Transfer learning with partial observability applied to cervical cancer screening. Iberian Conference on Pattern Recognition and Image Analysis, Springer.","DOI":"10.1007\/978-3-319-58838-4_27"},{"key":"ref_23","first-page":"15","article-title":"Tumor Classification Using Just Neural Networks","volume":"5","year":"2021","journal-title":"Int. J. Acad. Inf. Syst. Res. (IJAISR)"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"526","DOI":"10.1016\/j.procs.2021.01.199","article-title":"A Systematic Literature Review on Applying CRISP-DM Process Model","volume":"181","author":"Kruse","year":"2021","journal-title":"Procedia Comput. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Sun, W., Cai, Z., Liu, F., Fang, S., and Wang, G. (2017, January 12\u201315). A survey of data mining technology on electronic medical records. Proceedings of the 2017 IEEE 19th International Conference on e-Health Networking, Applications and Services (Healthcom), Dalian, China.","DOI":"10.1109\/HealthCom.2017.8210774"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"206","DOI":"10.17993\/3ctecno.2019.specialissue2.206-221","article-title":"Data Preprocessing: A preliminary step for web data mining","volume":"8","author":"Jamshed","year":"2019","journal-title":"3c Tecnol. Glosas Innovaci\u00f3n Apl. Pyme"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Yu, S., Yao, Z., Gholami, A., Dong, Z., Kim, S., Mahoney, M.W., and Keutzer, K. (2021). Hessian-aware pruning and optimal neural implant. arXiv.","DOI":"10.1109\/WACV51458.2022.00372"},{"key":"ref_28","unstructured":"Bruder, J., and Halpern, O. (2021, November 24). Optimal Brain Damage. Theorizing our Nervous Present. Culturemachine, Available online: https:\/\/culturemachine.net\/vol-20-machine-intelligences\/optimal-brain-damage-theorizing-the-nervous-present-johannes-bruder-orit-halpern\/."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/196\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:09:28Z","timestamp":1760134168000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/196"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,27]]},"references-count":28,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["e24020196"],"URL":"https:\/\/doi.org\/10.3390\/e24020196","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,27]]}}}