{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T16:00:57Z","timestamp":1780761657922,"version":"3.54.1"},"reference-count":25,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,5,25]],"date-time":"2021-05-25T00:00:00Z","timestamp":1621900800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>(1) Background: Diabetic retinopathy, one of the most serious complications of diabetes, is the primary cause of blindness in developed countries. Therefore, the prediction of diabetic retinopathy has a positive impact on its early detection and treatment. The prediction of diabetic retinopathy based on high-dimensional and small-sample-structured datasets (such as biochemical data and physical data) was the problem to be solved in this study. (2) Methods: This study proposed the XGB-Stacking model with the foundation of XGBoost and stacking. First, a wrapped feature selection algorithm, XGBIBS (Improved Backward Search Based on XGBoost), was used to reduce data feature redundancy and improve the effect of a single ensemble learning classifier. Second, in view of the slight limitation of a single classifier, a stacking model fusion method, Sel-Stacking (Select-Stacking), which keeps Label-Proba as the input matrix of meta-classifier and determines the optimal combination of learners by a global search, was used in the XGB-Stacking model. (3) Results: XGBIBS greatly improved the prediction accuracy and the feature reduction rate of a single classifier. Compared to a single classifier, the accuracy of the Sel-Stacking model was improved to varying degrees. Experiments proved that the prediction model of XGB-Stacking based on the XGBIBS algorithm and the Sel-Stacking method made effective predictions on diabetes retinopathy. (4) Conclusion: The XGB-Stacking prediction model of diabetic retinopathy based on biochemical and physical data had outstanding performance. This is highly significant to improve the screening efficiency of diabetes retinopathy and reduce the cost of diagnosis.<\/jats:p>","DOI":"10.3390\/s21113663","type":"journal-article","created":{"date-parts":[[2021,5,25]],"date-time":"2021-05-25T22:02:23Z","timestamp":1621980143000},"page":"3663","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["Diabetic Retinopathy Prediction by Ensemble Learning Based on Biochemical and Physical Data"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8394-5082","authenticated-orcid":false,"given":"Zun","family":"Shen","sequence":"first","affiliation":[{"name":"School of Informatics, Xiamen University, Xiamen 361005, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qingfeng","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Informatics, Xiamen University, Xiamen 361005, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhi","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Microelectronics and Nanoelectronics, Tsinghua University, Beijing 100876, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guoyi","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Informatics, Xiamen University, Xiamen 361005, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bin","family":"Lin","sequence":"additional","affiliation":[{"name":"School of Informatics, Xiamen University, Xiamen 361005, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"107843","DOI":"10.1016\/j.diabres.2019.107843","article-title":"Global and regional diabetes prevalence estimates for 2019 and projections for 2030 and 2045: Results from the International Diabetes Federation Diabetes Atlas","volume":"157","author":"Saeedi","year":"2019","journal-title":"Diabetes Res. Clin. Pract."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1016\/j.ophtha.2010.03.046","article-title":"Automated early detection of diabetic retinopathy","volume":"117","author":"Reinhardt","year":"2010","journal-title":"Ophthalmology"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-019-47181-w","article-title":"Deep learning fundus image analysis for diabetic retinopathy and macular edema grading","volume":"9","author":"Sahlsten","year":"2019","journal-title":"Sci. Rep."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Gadekallu, T.R., Khare, N., Bhattacharya, S., Singh, S., Maddikunta, P.K.R., and Srivastava, G. (2020). Deep neural networks to predict diabetic retinopathy. J. Ambient. Intell. Humaniz. Comput., 1\u201314.","DOI":"10.1007\/s12652-020-01963-7"},{"key":"ref_5","first-page":"1","article-title":"A machine learning ensemble classifier for early prediction of diabetic retinopathy","volume":"41","author":"Somasundaram","year":"2017","journal-title":"J. Med. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1186\/s12859-018-2277-0","article-title":"Predicting diabetic retinopathy and identifying interpretable biomedical features using machine learning algorithms","volume":"19","author":"Tsao","year":"2018","journal-title":"BMC Bioinform."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Dietterich, T.G. (2000). Ensemble Methods in Machine Learning. International Workshop on Multiple Classifier Systems, Springer.","DOI":"10.1007\/3-540-45014-9_1"},{"key":"ref_8","first-page":"1","article-title":"Ensemble methods in data mining: Improving accuracy through combining predictions","volume":"2","author":"Seni","year":"2010","journal-title":"Synth. Lect. Data Min. Knowl. Discov."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1016\/S0167-9473(01)00065-2","article-title":"Stochastic gradient boosting","volume":"38","author":"Friedman","year":"2002","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). Xgboost: A scalable tree boosting system. Proceedings of the 22nd ACM Sigkdd International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_11","first-page":"3146","article-title":"Lightgbm: A highly efficient gradient boosting decision tree","volume":"30","author":"Ke","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_12","unstructured":"Dorogush, A.V., Ershov, V., and Gulin, A. (2018). CatBoost: Gradient boosting with categorical features support. arXiv."},{"key":"ref_13","unstructured":"Ramani, R.G., Balasubramanian, L., and Jacob, S.G. (2012, January 14\u201315). Automatic prediction of Diabetic Retinopathy and Glaucoma through retinal image analysis and data mining techniques. Proceedings of the International Conference on Machine Vision and Image Processing (MVIP), Coimbatore, India."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.compeleceng.2013.11.024","article-title":"A survey on feature selection methods","volume":"40","author":"Chandrashekar","year":"2014","journal-title":"Comput. Electr. Eng."},{"key":"ref_15","first-page":"1","article-title":"Feature selection algorithm based on XGBoost","volume":"40","author":"Li","year":"2019","journal-title":"J. Commun."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1007\/s00500-007-0193-8","article-title":"A genetic algorithm-based method for feature subset selection","volume":"12","author":"Tan","year":"2008","journal-title":"Soft Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1932","DOI":"10.1016\/j.patcog.2008.11.018","article-title":"An improvement on floating search algorithms for feature subset selection","volume":"42","author":"Nakariyakul","year":"2009","journal-title":"Pattern Recognit."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.jretconser.2016.10.002","article-title":"Using an ensemble classifier based on sequential floating forward selection for financial distress prediction problem","volume":"34","author":"Fallahpour","year":"2017","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1023\/A:1012487302797","article-title":"Gene selection for cancer classification using support vector machines","volume":"46","author":"Guyon","year":"2002","journal-title":"Mach. Learn."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sang, X., Xiao, W., Zheng, H., Yang, Y., and Liu, T. (2020). HMMPred: Accurate Prediction of DNA-binding proteins based on HMM Profiles and XGBoost feature selection. Comput. Math. Methods Med.","DOI":"10.1155\/2020\/1384749"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"103899","DOI":"10.1016\/j.compbiomed.2020.103899","article-title":"Improving protein-protein interactions prediction accuracy using XGBoost feature selection and stacked ensemble classifier","volume":"123","author":"Chen","year":"2020","journal-title":"Comput. Biol. Med."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.asoc.2019.01.015","article-title":"Stacking-based ensemble learning of decision trees for interpretable prostate cancer detection","volume":"77","author":"Wang","year":"2019","journal-title":"Appl. Soft Comput."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Rawat, R.M., Akram, M., and Pradeep, S.S. (2020, January 10\u201312). Dementia Detection Using Machine Learning by Stacking Models. Proceedings of the 2020 5th International Conference on Communication and Electronics Systems (ICCES), Coimbatore, India.","DOI":"10.1109\/ICCES48766.2020.9137852"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Hammam, A.A., Elmousalami, H.H., and Hassanien, A.E. (2020). Stacking Deep Learning for Early COVID-19 Vision Diagnosis. Big Data Analytics and Artificial Intelligence against COVID-19: Innovation Vision and Approach, Springer.","DOI":"10.1007\/978-3-030-55258-9_18"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ji, S., Li, R., Shen, S., Li, B., Zhou, B., and Wang, Z. (2021). Heartbeat Classification Based on Multifeature Combination and Stacking-DWKNN Algorithm. J. Healthc. Eng.","DOI":"10.1155\/2021\/8811837"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/11\/3663\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:07:15Z","timestamp":1760162835000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/11\/3663"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,25]]},"references-count":25,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["s21113663"],"URL":"https:\/\/doi.org\/10.3390\/s21113663","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,25]]}}}