{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T09:58:08Z","timestamp":1778320688104,"version":"3.51.4"},"reference-count":45,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,2,4]],"date-time":"2022-02-04T00:00:00Z","timestamp":1643932800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The rapid growth and adaptation of medical information to identify significant health trends and help with timely preventive care have been recent hallmarks of the modern healthcare data system. Heart disease is the deadliest condition in the developed world. Cardiovascular disease and its complications, including dementia, can be averted with early detection. Further research in this area is needed to prevent strokes and heart attacks. An optimal machine learning model can help achieve this goal with a wealth of healthcare data on heart disease. Heart disease can be predicted and diagnosed using machine-learning-based systems. Active learning (AL) methods improve classification quality by incorporating user\u2013expert feedback with sparsely labelled data. In this paper, five (MMC, Random, Adaptive, QUIRE, and AUDI) selection strategies for multi-label active learning were applied and used for reducing labelling costs by iteratively selecting the most relevant data to query their labels. The selection methods with a label ranking classifier have hyperparameters optimized by a grid search to implement predictive modelling in each scenario for the heart disease dataset. Experimental evaluation includes accuracy and F-score with\/without hyperparameter optimization. Results show that the generalization of the learning model beyond the existing data for the optimized label ranking model uses the selection method versus others due to accuracy. However, the selection method was highlighted in regards to the F-score using optimized settings.<\/jats:p>","DOI":"10.3390\/s22031184","type":"journal-article","created":{"date-parts":[[2022,2,6]],"date-time":"2022-02-06T20:40:18Z","timestamp":1644180018000},"page":"1184","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":139,"title":["Multi-Label Active Learning-Based Machine Learning Model for Heart Disease Prediction"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9489-3449","authenticated-orcid":false,"given":"Ibrahim M.","family":"El-Hasnony","sequence":"first","affiliation":[{"name":"Faculty of Computers and Information Sciences, Mansoura University, Mansoura 35516, Egypt"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5409-1305","authenticated-orcid":false,"given":"Omar M.","family":"Elzeki","sequence":"additional","affiliation":[{"name":"Faculty of Computers and Information Sciences, Mansoura University, Mansoura 35516, Egypt"},{"name":"Faculty of Computer Science, New Mansoura University, Gamasa 35712, Egypt"}]},{"given":"Ali","family":"Alshehri","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Tabuk, Tabuk 71491, Saudi Arabia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8714-567X","authenticated-orcid":false,"given":"Hanaa","family":"Salem","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Delta University for Science and Technology, Gamasa 35712, Egypt"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Becker, D.K. (2017, January 11\u201314). Predicting outcomes for big data projects: Big Data Project Dynamics (BDPD): Research in progress. Proceedings of the 2017 IEEE International Conference on Big Data (Big Data), Boston, MA, USA.","DOI":"10.1109\/BigData.2017.8258186"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"103627","DOI":"10.1016\/j.jbi.2020.103627","article-title":"A review on deep learning approaches in healthcare systems: Taxonomies, challenges, and open issues","volume":"113","author":"Shamshirband","year":"2021","journal-title":"J. Biomed. Inform."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"102078","DOI":"10.1016\/j.ijinfomgt.2020.102078","article-title":"Big data management in healthcare: Adoption challenges and implications","volume":"53","author":"Chen","year":"2020","journal-title":"Int. J. Inf. Manag."},{"key":"ref_4","unstructured":"Tang, Y.-P., Li, G.-X., and Huang, S.-J. (2019). ALiPy: Active learning in python. arXiv."},{"key":"ref_5","unstructured":"Settles, B. (2021, December 10). Active Learning Literature Survey. Available online: https:\/\/minds.wisconsin.edu\/handle\/1793\/60660."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"714","DOI":"10.1016\/j.future.2019.09.056","article-title":"Heart disease identification from patients\u2019 social posts, machine learning solution on Spark","volume":"111","author":"Ahmed","year":"2020","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.future.2018.09.031","article-title":"Recurrent convolutional neural network based multimodal disease risk prediction","volume":"92","author":"Hao","year":"2018","journal-title":"Futur. Gener. Comput. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1016\/j.inffus.2020.06.008","article-title":"A smart healthcare monitoring system for heart disease prediction based on ensemble deep learning and feature fusion","volume":"63","author":"Ali","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.eswa.2018.04.023","article-title":"A hybrid model based on modular neural networks and fuzzy systems for classification of blood pressure and hypertension risk diagnosis","volume":"107","author":"Melin","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"S203","DOI":"10.1016\/j.jbi.2015.08.003","article-title":"Coronary artery disease risk assessment from unstructured electronic health records using text mining","volume":"58","author":"Jonnagaddala","year":"2015","journal-title":"J. Biomed. Inform."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1016\/j.compeleceng.2017.09.001","article-title":"A novel three-tier Internet of Things architecture with machine learning algorithm for early detection of heart diseases","volume":"65","author":"Kumar","year":"2018","journal-title":"Comput. Electr. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/JBHI.2016.2636665","article-title":"Deep Learning for Health Informatics","volume":"21","author":"Ravi","year":"2016","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Salem, H., Attiya, G., and El-Fishawy, N. (2016, January 23\u201325). Intelligent decision support system for breast cancer diagnosis by gene expression profiles. Proceedings of the 2016 33rd National Radio Science Conference (NRSC), Alexandria, Egypt.","DOI":"10.1109\/NRSC.2016.7450870"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1007\/s10044-021-00958-0","article-title":"Coronavirus disease 2019 (COVID-19): Survival analysis using deep learning and Cox regression model","volume":"24","author":"Atlam","year":"2021","journal-title":"Pattern Anal. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"e364","DOI":"10.7717\/peerj-cs.364","article-title":"A novel perceptual two layer image fusion using deep learning for imbalanced COVID-19 dataset","volume":"7","author":"Elzeki","year":"2021","journal-title":"PeerJ Comput. Sci."},{"key":"ref_16","first-page":"1638","article-title":"Predicting the Risk of Heart Disease Using Advanced Machine Learning Approach","volume":"7","author":"Waigi","year":"2020","journal-title":"Eur. J. Mol. Clin. Med."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"e8","DOI":"10.1016\/j.pedn.2019.09.021","article-title":"Empowering Young Persons with Congenital Heart Disease: Using Intervention Mapping to Develop a Transition Program\u2014The STEPSTONES Project","volume":"50","author":"Mora","year":"2020","journal-title":"J. Pediatr. Nurs."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.neucom.2020.07.056","article-title":"An end-to-end multi-level wavelet convolutional neural networks for heart diseases diagnosis","volume":"417","author":"Khalil","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chowdhury, M.E., Khandakar, A., Alzoubi, K., Mansoor, S., Tahir, A.M., Reaz, M.B.I., and Al-Emadi, N. (2019). Real-Time Smart-Digital Stethoscope System for Heart Diseases Monitoring. Sensors, 19.","DOI":"10.3390\/s19122781"},{"key":"ref_20","first-page":"242","article-title":"Heart disease prediction and classification using machine learning algorithms optimized by particle swarm optimization and ant colony optimization","volume":"12","author":"Khourdifi","year":"2019","journal-title":"Int. J. Intell. Eng. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"100203","DOI":"10.1016\/j.imu.2019.100203","article-title":"Improving the accuracy of prediction of heart disease risk based on ensemble classification techniques","volume":"16","author":"Latha","year":"2019","journal-title":"Inform. Med. Unlocked"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"107562","DOI":"10.1109\/ACCESS.2020.3001149","article-title":"Heart Disease Identification Method Using Machine Learning Classification in E-Healthcare","volume":"8","author":"Li","year":"2020","journal-title":"IEEE Access"},{"key":"ref_23","unstructured":"Dheeru, D., and Taniskidou, E.K. (2021, December 01). {UCI} Machine Learning Repository.2017. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Heart+Disease."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"414","DOI":"10.7763\/IJMLC.2015.V5.544","article-title":"Comparative Study of Classification Techniques (SVM, Logistic Regression and Neural Networks) to Predict the Prevalence of Heart Disease","volume":"5","author":"Khanna","year":"2015","journal-title":"Int. J. Mach. Learn. Comput."},{"key":"ref_25","first-page":"103","article-title":"Prediction of angiographic disease status using rule based data mining techniques","volume":"8","author":"Khan","year":"2016","journal-title":"Biol. Forum Int. J."},{"key":"ref_26","unstructured":"Acharya, A. (2021, December 05). Comparative study of machine learning algorithms for heart disease prediction. Available online: https:\/\/www.theseus.fi\/handle\/10024\/124622."},{"key":"ref_27","unstructured":"Sarangam Kodati, D.R.V. Analysis of heart disease using in data mining tools Orange and Weka. Glob. J. Comput. Sci. Technol., Available online: https:\/\/computerresearch.org\/index.php\/computer\/article\/view\/1663."},{"key":"ref_28","first-page":"887","article-title":"Prediction of heart diseases using data mining and machine learning algorithms and tools","volume":"3","author":"Kumar","year":"2018","journal-title":"Int. J. Sci. Res. Comput. Sci. Eng. Inf. Technol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1007\/s12553-020-00438-1","article-title":"Heart disease classification using data mining tools and machine learning techniques","volume":"10","author":"Tougui","year":"2020","journal-title":"Health Technol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1496","DOI":"10.1007\/s10618-020-00704-w","article-title":"Active learning for hierarchical multi-label classification","volume":"34","author":"Nakano","year":"2020","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"64114","DOI":"10.1103\/PhysRevB.99.064114","article-title":"Accelerating crystal structure prediction by machine-learning interatomic potentials with active learning","volume":"99","author":"Podryabinkin","year":"2019","journal-title":"Phys. Rev. B"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"025002","DOI":"10.1088\/2632-2153\/abc9fe","article-title":"The MLIP package: Moment tensor potentials with MPI and active learning","volume":"2","author":"Novikov","year":"2020","journal-title":"Mach. Learn. Sci. Technol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"82305","DOI":"10.1115\/1.4050489","article-title":"An Automated Machine Learning-Genetic Algorithm Framework With Active Learning for Design Optimization","volume":"143","author":"Owoyele","year":"2021","journal-title":"J. Energy Resour. Technol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"241733","DOI":"10.1063\/1.5023802","article-title":"Less is more: Sampling chemical space with active learning","volume":"148","author":"Smith","year":"2018","journal-title":"J. Chem. Phys."},{"key":"ref_35","unstructured":"Konyushkova, K., Sznitman, R., and Fua, P. (2017). Learning active learning from data. arXiv."},{"key":"ref_36","unstructured":"Gal, Y., Islam, R., and Ghahramani, Z. (2017, January 6\u201311). Deep bayesian active learning with image data. Proceedings of the 34th International Conference on Machine Learning, PMLR, Sydney, NSW, Australia."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1007\/s10916-020-01562-1","article-title":"AI-Driven Tools for Coronavirus Outbreak: Need of Active Learning and Cross-Population Train\/Test Models on Multitudinal\/Multimodal Data","volume":"44","author":"Santosh","year":"2020","journal-title":"J. Med Syst."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Pace, D.F., Dalca, A.V., Geva, T., Powell, A.J., Moghari, M.H., and Golland, P. (2015, January 5\u20139). Interactive whole-heart segmentation in congenital heart disease. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_10"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Ghosh, P., Azam, S., Karim, A., Jonkman, M., and Hasan, M.D.Z. (2021, January 27\u201329). Use of Efficient Machine Learning Techniques in the Identification of Patients with Heart Diseases. Proceedings of the 2021 the 5th International Conference on Information System and Data Mining, Silicon Valley, CA, USA.","DOI":"10.1145\/3471287.3471297"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1093\/cid\/cix731","article-title":"Machine Learning for Healthcare: On the Verge of a Major Shift in Healthcare Epidemiology","volume":"66","author":"Wiens","year":"2018","journal-title":"Clin. Infect. Dis."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"3073","DOI":"10.1039\/C8CS00921J","article-title":"X-ray-activated nanosystems for theranostic applications","volume":"48","author":"Chen","year":"2019","journal-title":"Chem. Soc. Rev."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1016\/j.neucom.2017.08.001","article-title":"Effective active learning strategy for multi-label learning","volume":"273","author":"Reyes","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_43","unstructured":"Yan, Y., Rosales, R., Fung, G., and Dy, J.G. (2011\u20132, January 28). Active learning from crowds. Proceedings of the ICML\u201911: Proceedings of the 28th International Conference on International Conference on Machine Learning, Bellevue, WA, USA."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Huang, S.-J., and Zhou, Z.-H. (2013, January 7\u201310). Active query driven by uncertainty and diversity for incremental multi-label learning. Proceedings of the 2013 IEEE 13th International Conference on Data Mining, Dallas, TX, USA.","DOI":"10.1109\/ICDM.2013.74"},{"key":"ref_45","first-page":"20","article-title":"A New Hybrid Genetic and Information Gain Algorithm for Imputing Missing Values in Cancer Genes Datasets","volume":"11","author":"Elzeki","year":"2019","journal-title":"Int. J. Intell. Syst. Appl."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/1184\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:13:59Z","timestamp":1760134439000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/1184"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,4]]},"references-count":45,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["s22031184"],"URL":"https:\/\/doi.org\/10.3390\/s22031184","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,4]]}}}