{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T15:08:04Z","timestamp":1777043284282,"version":"3.51.4"},"reference-count":49,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,1,26]],"date-time":"2023-01-26T00:00:00Z","timestamp":1674691200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"King Saud University, Riyadh, Saudi Arabia","award":["RSP2023R18"],"award-info":[{"award-number":["RSP2023R18"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The early, valid prediction of heart problems would minimize life threats and save lives, while lack of prediction and false diagnosis can be fatal. Addressing a single dataset alone to build a machine learning model for the identification of heart problems is not practical because each country and hospital has its own data schema, structure, and quality. On this basis, a generic framework has been built for heart problem diagnosis. This framework is a hybrid framework that employs multiple machine learning and deep learning techniques and votes for the best outcome based on a novel voting technique with the intention to remove bias from the model. The framework contains two consequent layers. The first layer contains simultaneous machine learning models running over a given dataset. The second layer consolidates the outputs of the first layer and classifies them as a second classification layer based on novel voting techniques. Prior to the classification process, the framework selects the top features using a proposed feature selection framework. It starts by filtering the columns using multiple feature selection methods and considers the top common features selected. Results from the proposed framework, with 95.6% accuracy, show its superiority over the single machine learning model, classical stacking technique, and traditional voting technique. The main contribution of this work is to demonstrate how the prediction probabilities of multiple models can be exploited for the purpose of creating another layer for final output; this step neutralizes any model bias. Another experimental contribution is proving the complete pipeline\u2019s ability to be retrained and used for other datasets collected using different measurements and with different distributions.<\/jats:p>","DOI":"10.3390\/s23031392","type":"journal-article","created":{"date-parts":[[2023,1,27]],"date-time":"2023-01-27T01:27:58Z","timestamp":1674782878000},"page":"1392","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["A Hybrid Generic Framework for Heart Problem Diagnosis Based on a Machine Learning Paradigm"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4582-1606","authenticated-orcid":false,"given":"Alaa","family":"Menshawi","sequence":"first","affiliation":[{"name":"Information Systems Department, College of Computer and Information Science, King Saud University, Riyadh 11543, Saudi Arabia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3479-3606","authenticated-orcid":false,"given":"Mohammad Mehedi","family":"Hassan","sequence":"additional","affiliation":[{"name":"Information Systems Department, College of Computer and Information Science, King Saud University, Riyadh 11543, Saudi Arabia"}]},{"given":"Nasser","family":"Allheeib","sequence":"additional","affiliation":[{"name":"Information Systems Department, College of Computer and Information Science, King Saud University, Riyadh 11543, Saudi Arabia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4039-891X","authenticated-orcid":false,"given":"Giancarlo","family":"Fortino","sequence":"additional","affiliation":[{"name":"Department of Informatics, Modeling, Electronics, and Systems, University of Calabria, 87036 Rende, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,26]]},"reference":[{"key":"ref_1","unstructured":"WHO (2022, June 02). WHO Cardiovascular Diseases. Available online: https:\/\/www.who.int\/health-topics\/cardiovascular-diseases#tab=tab_1."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12889-020-09298-w","article-title":"Demographic, behavioral, and cardiovascular disease risk factors in the Saudi population: Results from the Prospective Urban Rural Epidemiology study (PURE-Saudi)","volume":"20","author":"Alhabib","year":"2020","journal-title":"BMC Public Health"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Schneeberger, D., Stoeger, K., and Holzinger, A. (2020, January 25\u201328). The european leagal framework for medical AI. Proceedings of the International Cross-Domain Conference for Machine Learning and Knowledge Extraction, Dublin, Ireland.","DOI":"10.1007\/978-3-030-57321-8_12"},{"key":"ref_4","unstructured":"Centers for Disease Control and Prevention (2022, September 12). Multiple Cause of Death 1999\u20132015, Available online: http:\/\/wonder.cdc.gov\/mcd-icd10.html."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"e67","DOI":"10.1161\/CIR.0000000000000558","article-title":"Heart Disease and Stroke Statistics-2018 Update: A Report From the American Heart Association","volume":"137","author":"Benjamin","year":"2018","journal-title":"Circulation"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"e153","DOI":"10.1161\/CIR.0000000000001052","article-title":"Heart Disease and Stroke Statistics\u20142022 Update: A Report From the American Heart Association","volume":"145","author":"Tsao","year":"2022","journal-title":"Circulation"},{"key":"ref_7","first-page":"261","article-title":"Implementation of Machine Learning Model to Predict Heart Failure Disease","volume":"10","author":"Alotaibi","year":"2019","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_8","unstructured":"American Heart Association (2022, June 02). Classes of Heart Failure. Available online: https:\/\/www.heart.org\/en\/health-topics\/heart-failure\/what-is-heart-failure\/classes-of-heart-failure."},{"key":"ref_9","unstructured":"Andreoli, A., Gravina, R., Giannantonio, R., Pierleoni, P., and Fortino, G. (2010). Wearable and Autonomous Biomedical Devices and Systems for Smart Environment, Springer."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1109\/JBHI.2013.2244902","article-title":"Classification Tree for Risk Assessment in Patients Suffering From Congestive Heart Failure via Long-Term Heart Rate Variability","volume":"17","author":"Melillo","year":"2013","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_11","unstructured":"Harvard Medical School (2016). Roughout Life, Heart Attacks Are Twice as Common in Men Than Women, Harvard Health Publishing. Available online: https:\/\/www.health.harvard.edu\/heart-health\/throughout-life-heart-attacks-are-twice-as-common-in-men-than-women."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"100330","DOI":"10.1016\/j.imu.2020.100330","article-title":"Classification models for heart disease prediction using feature selection and PCA","volume":"19","author":"Hassani","year":"2020","journal-title":"Inform. Med. Unlocked"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"81542","DOI":"10.1109\/ACCESS.2019.2923707","article-title":"Effective Heart Disease Prediction Using Hybrid Machine Learning Techniques","volume":"7","author":"Mohan","year":"2019","journal-title":"IEEE Access"},{"key":"ref_14","first-page":"1","article-title":"A Neutrosophic Intelligent System for Heart Disease Diagnosis: Case Study in Developing Country","volume":"11","author":"Radwan","year":"2022","journal-title":"Int. J. Fuzzy Syst. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"489","DOI":"10.37896\/YMER21.04\/48","article-title":"Heart Disease Prediction Using Machine Learning","volume":"21","author":"Biksham","year":"2022","journal-title":"Ymer"},{"key":"ref_16","first-page":"386","article-title":"Heart Disease Prediction Using Machine Learning Techniques","volume":"5","author":"Indraja","year":"2022","journal-title":"Iconic Res. Eng. J."},{"key":"ref_17","first-page":"25","article-title":"Applying Machine Learning Methods in Diagnosing Heart Disease for Diabetic Patients","volume":"3","author":"Parthiban","year":"2012","journal-title":"Int. J. Appl. Inf. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1750","DOI":"10.1109\/JBHI.2014.2337752","article-title":"A Machine Learning System to Improve Heart Failure Patient Assistance","volume":"18","author":"Guidi","year":"2014","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ismaeel, S., Miri, A., and Chourishi, D. (June, January 31). Using the Extreme Learning Machine (ELM) technique for heart disease diagnosis. Proceedings of the 2015 IEEE Canada International Humanitarian Technology Conference (IHTC2015), Ottawa, ON, Canada.","DOI":"10.1109\/IHTC.2015.7238043"},{"key":"ref_20","first-page":"30","article-title":"Diagnosing Coronary Heart Disease using Ensemble Machine Learning","volume":"7","author":"Miao","year":"2016","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_21","first-page":"1","article-title":"Heart Disease Diagnosis on Medical Data Using Ensemble Learning","volume":"1","author":"Dun","year":"2016","journal-title":"Comput. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Thomas, J., and Princy, R.T. (2016, January 18\u201319). Human heart disease prediction system using data mining techniques. Proceedings of the 2016 International Conference on Circuit, Power and Computing Technologies (ICCPCT) 2016, Nagercoil, India.","DOI":"10.1109\/ICCPCT.2016.7530265"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Deepika, K., and Seema, S. (2016, January 21\u201323). Predictive analytics to prevent and control chronic diseases. Proceedings of the 2016 2nd International Conference on Applied and Theoretical Computing and Communication Technology (iCATccT), Bangalore, India.","DOI":"10.1109\/ICATCCT.2016.7912028"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Xu, S., Zhang, Z., Wang, D., Hu, J., Duan, X., and Zhu, T. (2017, January 10\u201312). Cardiovascular risk prediction method based on CFS subset evaluation and random forest classification framework. Proceedings of the 2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA), Beijing, China.","DOI":"10.1109\/ICBDA.2017.8078813"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Gavhane, A., Kokkula, G., Pandya, I., and Devadkar, K. (2018, January 29\u201331). Prediction of heart disease using machine learning. Proceedings of the 2018 Second International Conference on Electronics, Communication and Aerospace Technology (ICECA), Coimbatore, India.","DOI":"10.1109\/ICECA.2018.8474922"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1272","DOI":"10.1016\/j.echo.2018.07.013","article-title":"Diagnosis of Heart Failure With Preserved Ejection Fraction: Machine Learning of Spatiotemporal Variations in Left Ventricular Deformation","volume":"31","author":"Tabassian","year":"2018","journal-title":"J. Am. Soc. Echocardiogr."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s42979-020-00365-y","article-title":"Heart Disease Prediction using Machine Learning Techniques","volume":"1","author":"Shah","year":"2020","journal-title":"SN Comput. Sci."},{"key":"ref_28","unstructured":"Mirkin, E., and Savchenko, E. (2022). International Youth Conference on Electronics, Telecommunications and Information Technologies, Springer."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"118933","DOI":"10.1016\/j.eswa.2022.118933","article-title":"A smart decision support system to diagnose arrhythymia using ensembled ConvNet and ConvNet-LSTM model","volume":"213","author":"Tiwari","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"127","DOI":"10.3233\/IDT-200052","article-title":"An Intelligent Unsupervised Technique for Fraud Detection in Health Care Systems","volume":"15","author":"Kanksha","year":"2021","journal-title":"Intell. Decis. Technol."},{"key":"ref_31","first-page":"1547","article-title":"Classification of Cardiac Abnormalities Using Reduced Features of Heart Rate Variability Signal","volume":"6","author":"Yaghouby","year":"2009","journal-title":"World Appl. Sci. J."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1016\/j.ins.2016.01.082","article-title":"Deep learning approach for active classification of electrocardiogram signals","volume":"345","author":"Bazi","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.bspc.2016.12.017","article-title":"Evaluation of effect of unsupervised dimensionality reduction techniques on automated arrhythmia classification","volume":"34","author":"Rajagopal","year":"2017","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_34","first-page":"166","article-title":"Detection of coronary artery disease by reduced features and extreme learning machine","volume":"91","author":"Singh","year":"2018","journal-title":"Med. Pharm. Rep."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Bashir, S., Khan, Z.S., Khan, F.H., Anjum, A., and Bashir, K. (2019, January 8\u201312). Improving heart disease prediction using feature selection approaches. Proceedings of the 16th International Bhurban Conference on Applied Sciences and Technology (IBCAST), Islamabad, Pakistan.","DOI":"10.1109\/IBCAST.2019.8667106"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"684","DOI":"10.14419\/ijet.v7i2.8.10557","article-title":"Heart disease prediction using machine learning techniques: A survey","volume":"7","author":"Ramalingam","year":"2018","journal-title":"Int. J. Eng. Technol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1038\/s41584-019-0361-0","article-title":"Machine learning in rheumatology approaches the clinic","volume":"16","author":"Pandit","year":"2020","journal-title":"Nat. Rev. Rheumatol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1155","DOI":"10.3389\/fphar.2019.01155","article-title":"Early and Accurate Prediction of Clinical Response to Methotrexate Treatment in Juvenile Idiopathic Arthritis Using Machine Learning","volume":"10","author":"Mo","year":"2019","journal-title":"Front. Pharmacol."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Hosmer, D.W., Lemeshow, S., and Sturdivant, R.X. (2013). Applied Logistic Regression, John Wiley & Sons. [3rd ed.].","DOI":"10.1002\/9781118548387"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Hastie, T., Tibshirani, R., Friedman, J.H., and Friedman, J.H. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer.","DOI":"10.1007\/978-0-387-84858-7"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1011215321374","article-title":"A novel smooth support vector machine for classification","volume":"20","author":"Mangasarian","year":"2001","journal-title":"Comput. Optim. Appl."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2221","DOI":"10.1007\/s13042-020-01111-9","article-title":"PRF-RW: A progressive random forest-based random walk approach for interactive semi-automated pulmonary lobes segmentation","volume":"11","author":"Li","year":"2020","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"111606","DOI":"10.1016\/j.rse.2019.111606","article-title":"RF-MEP: A novel Random Forest method for merging gridded precipitation products and ground-based measurements","volume":"239","author":"Beck","year":"2020","journal-title":"Remote. Sens. Environ."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"103155","DOI":"10.1016\/j.autcon.2020.103155","article-title":"XGBoost algorithm-based prediction of concrete electrical resistivity for structural health monitoring","volume":"114","author":"Dong","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1716","DOI":"10.1038\/s41591-018-0213-5","article-title":"The Artificial Intelligence Clinician learns optimal treatment strategies for sepsis in intensive care","volume":"24","author":"Komorowski","year":"2018","journal-title":"Nat. Med."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Bhanumathi, M., Gautham Kumar, R.S., Karthika Hema Manasa, M., and Aravindh, R. (2021). Heart Disease Prediction Using Convolutional Neural Network, IOS Press.","DOI":"10.3233\/APC210161"},{"key":"ref_47","unstructured":"UCI (2021, December 15). Heart Disease Cleveland UCI. Kaggle.com. Available online: https:\/\/www.kaggle.com\/datasets\/cherngs\/heart-disease-cleveland-uci."},{"key":"ref_48","unstructured":"Ahmad, T., Munir, A., Bhatti, S.H., Aftab, M., and Raza, M.A. (2022, April 02). Cardiovascular Heart Disease Patients Dataset. Available online: https:\/\/plos.figshare.com\/articles\/dataset\/Survival_analysis_of_heart_failure_patients_A_case_study\/5227684\/1."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12911-020-1023-5","article-title":"Machine learning can predict survival of patients with heart failure from serum creatinine and ejection fraction alone","volume":"20","author":"Chicco","year":"2020","journal-title":"BMC Med. Inform. Decis. Mak."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/3\/1392\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:16:21Z","timestamp":1760120181000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/3\/1392"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,26]]},"references-count":49,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23031392"],"URL":"https:\/\/doi.org\/10.3390\/s23031392","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,26]]}}}