{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,14]],"date-time":"2026-11-14T08:03:20Z","timestamp":1794643400220,"version":"4.9.1"},"reference-count":48,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,8,11]],"date-time":"2023-08-11T00:00:00Z","timestamp":1691712000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,11]],"date-time":"2023-08-11T00:00:00Z","timestamp":1691712000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Yonsei Signature Research Cluster Program","award":["of 2022-22-0010"],"award-info":[{"award-number":["of 2022-22-0010"]}]},{"name":"Yonsei Signature Research Cluster Program","award":["of 2022-22-0010"],"award-info":[{"award-number":["of 2022-22-0010"]}]},{"name":"Yonsei Signature Research Cluster Program","award":["of 2022-22-0010"],"award-info":[{"award-number":["of 2022-22-0010"]}]},{"name":"Yonsei Signature Research Cluster Program","award":["of 2022-22-0010"],"award-info":[{"award-number":["of 2022-22-0010"]}]},{"name":"Yonsei Signature Research Cluster Program","award":["of 2022-22-0010"],"award-info":[{"award-number":["of 2022-22-0010"]}]},{"name":"Yonsei Signature Research Cluster Program","award":["of 2022-22-0010"],"award-info":[{"award-number":["of 2022-22-0010"]}]},{"name":"Yonsei Signature Research Cluster Program","award":["of 2022-22-0010"],"award-info":[{"award-number":["of 2022-22-0010"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We compared the prediction performance of machine learning-based undiagnosed diabetes prediction models with that of traditional statistics-based prediction models. We used the 2014\u20132020 Korean National Health and Nutrition Examination Survey (KNHANES) (N\u2009=\u200932,827). The KNHANES 2014\u20132018 data were used as training and internal validation sets and the 2019\u20132020 data as external validation sets. The receiver operating characteristic curve area under the curve (AUC) was used to compare the prediction performance of the machine learning-based and the traditional statistics-based prediction models. Using sex, age, resting heart rate, and waist circumference as features, the machine learning-based model showed a higher AUC (0.788 vs. 0.740) than that of the traditional statistical-based prediction model. Using sex, age, waist circumference, family history of diabetes, hypertension, alcohol consumption, and smoking status as features, the machine learning-based prediction model showed a higher AUC (0.802 vs. 0.759) than the traditional statistical-based prediction model. The machine learning-based prediction model using features for maximum prediction performance showed a higher AUC (0.819 vs. 0.765) than the traditional statistical-based prediction model. Machine learning-based prediction models using anthropometric and lifestyle measurements may outperform the traditional statistics-based prediction models in predicting undiagnosed diabetes.<\/jats:p>","DOI":"10.1038\/s41598-023-40170-0","type":"journal-article","created":{"date-parts":[[2023,8,11]],"date-time":"2023-08-11T17:01:36Z","timestamp":1691773296000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":46,"title":["Comparisons of the prediction models for undiagnosed diabetes between machine learning versus traditional statistical methods"],"prefix":"10.1038","volume":"13","author":[{"given":"Seong Gyu","family":"Choi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Minsuk","family":"Oh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dong\u2013Hyuk","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Byeongchan","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yong-ho","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sun Ha","family":"Jee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Justin Y.","family":"Jeon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,8,11]]},"reference":[{"key":"40170_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.4093\/dmj.2020.0254","volume":"45","author":"CH Jung","year":"2021","unstructured":"Jung, C. H. et al. Diabetes fact sheets in Korea, 2020: An appraisal of current status. Diabetes Metab. J. 45, 1\u201310 (2021).","journal-title":"Diabetes Metab. J."},{"key":"40170_CR2","doi-asserted-by":"publisher","first-page":"371","DOI":"10.1136\/bmj.317.7155.371","volume":"317","author":"DECODE Study Group on behalf of the European Diabetes Epidemiology Study Group","year":"1998","unstructured":"DECODE Study Group on behalf of the European Diabetes Epidemiology Study Group. Will new diagnostic criteria for diabetes mellitus change phenotype of patients with diabetes? Reanalysis of European epidemiological data. BMJ 317, 371\u2013375 (1998).","journal-title":"BMJ"},{"key":"40170_CR3","unstructured":"Kim, S. R. The effects of diabetes self-awareness on diabeteic patients' subjective health level [Master's dissertation]: Ajou University (2013)."},{"key":"40170_CR4","doi-asserted-by":"publisher","first-page":"518","DOI":"10.2337\/diacare.21.4.518","volume":"21","author":"MI Harris","year":"1998","unstructured":"Harris, M. I. et al. Prevalence of diabetes, impaired fasting glucose, and impaired glucose tolerance in US adults: The Third National Health and Nutrition Examination Survey, 1988\u20131994. Diabetes Care 21, 518\u2013524 (1998).","journal-title":"Diabetes Care"},{"key":"40170_CR5","doi-asserted-by":"publisher","first-page":"1723","DOI":"10.2337\/dc11-2347","volume":"35","author":"YH Lee","year":"2012","unstructured":"Lee, Y. H. et al. A simple screening score for diabetes for the Korean population: Development, validation, and comparison with other scores. Diabetes Care 35, 1723\u20131730 (2012).","journal-title":"Diabetes Care"},{"key":"40170_CR6","doi-asserted-by":"publisher","DOI":"10.4178\/epih.e2022009","volume":"44","author":"DH Park","year":"2022","unstructured":"Park, D. H., Cho, W., Lee, Y. H., Jee, S. H. & Jeon, J. Y. The predicting value of resting heart rate to identify undiagnosed diabetes in Korean adult: Korea National Health and Nutrition Examination Survey. Epidemiol. Health. 44, e2022009 (2022).","journal-title":"Epidemiol. Health."},{"key":"40170_CR7","doi-asserted-by":"publisher","first-page":"1187","DOI":"10.2337\/diacare.28.5.1187","volume":"28","author":"M Franciosi","year":"2005","unstructured":"Franciosi, M. et al. Use of the diabetes risk score for opportunistic screening of undiagnosed diabetes and impaired glucose tolerance: The IGLOO (Impaired Glucose Tolerance and Long-Term Outcomes Observational) study. Diabetes Care 28, 1187\u20131194 (2005).","journal-title":"Diabetes Care"},{"key":"40170_CR8","doi-asserted-by":"publisher","first-page":"725","DOI":"10.2337\/diacare.26.3.725","volume":"26","author":"J Lindstrom","year":"2003","unstructured":"Lindstrom, J. & Tuomilehto, J. The diabetes risk score: A practical tool to predict type 2 diabetes risk. Diabetes Care 26, 725\u2013731 (2003).","journal-title":"Diabetes Care"},{"key":"40170_CR9","doi-asserted-by":"publisher","first-page":"76516","DOI":"10.1109\/ACCESS.2020.2989857","volume":"8","author":"MK Hasan","year":"2020","unstructured":"Hasan, M. K., Alam, M. A., Das, D., Hossain, E. & Hasan, M. Diabetes prediction using ensembling of different machine learning classifiers. IEEE Access. 8, 76516\u201376531 (2020).","journal-title":"IEEE Access."},{"key":"40170_CR10","first-page":"427","volume":"479","author":"I Naim","year":"2022","unstructured":"Naim, I., Singh, A. R., Sen, A., Sharma, A. & Mishra, D. Healthcare CHATBOT for diabetic patients using classification. Soft Comput. Theor. Appl. 479, 427\u2013437 (2022).","journal-title":"Soft Comput. Theor. Appl."},{"key":"40170_CR11","doi-asserted-by":"publisher","first-page":"402","DOI":"10.4093\/dmj.2018.0014","volume":"42","author":"KH Ha","year":"2018","unstructured":"Ha, K. H. et al. Development and validation of the Korean diabetes risk score: A 10-year national cohort study. Diabetes Metab. J. 42, 402\u2013414 (2018).","journal-title":"Diabetes Metab. J."},{"key":"40170_CR12","doi-asserted-by":"publisher","first-page":"1904","DOI":"10.1253\/circj.CJ-11-1236","volume":"76","author":"NK Lim","year":"2012","unstructured":"Lim, N. K., Park, S. H., Choi, S. J., Lee, K. S. & Park, H. Y. A risk score for predicting the incidence of type 2 diabetes in a middle-aged Korean Cohort-the Korean genome and epidemiology study. Circ J. 76, 1904\u20131910 (2012).","journal-title":"Circ J."},{"key":"40170_CR13","first-page":"249","volume":"17","author":"JS Jang","year":"2019","unstructured":"Jang, J. S., Lee, M. J. & Lee, T. R. Development of T2DM prediction model using RNN. J. Digt. Converg. 17, 249\u2013255 (2019).","journal-title":"J. Digt. Converg."},{"key":"40170_CR14","unstructured":"Kim DH, Jwa MK, Lim SJ, Park SM, Joo JW. A study on the prediction algorithm of diabetes based on XGBoost: Data from the 2016~2018 Korea National Health and Nutrition Examination Survey. J. Korean Inst. Commun. Inf. Sci. (Abstract). 965\u20136 (2021)."},{"key":"40170_CR15","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1093\/ije\/dyt228","volume":"43","author":"S Kweon","year":"2014","unstructured":"Kweon, S. et al. Data resource profile: the Korea national health and nutrition examination survey (KNHANES). Int. J. Epidemiol. 43, 69\u201377 (2014).","journal-title":"Int. J. Epidemiol."},{"key":"40170_CR16","doi-asserted-by":"publisher","first-page":"839","DOI":"10.1148\/radiology.148.3.6878708","volume":"148","author":"JA Hanley","year":"1983","unstructured":"Hanley, J. A. & McNeil, B. J. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 148, 839\u2013843 (1983).","journal-title":"Radiology"},{"key":"40170_CR17","unstructured":"Moore, A. W. Cross-validation for detecting and preventing overfitting. School Comput Sci Carneigie Mellon University (2001). http:\/\/www.autonlab.org\/tutorials\/overfit10.pdf"},{"key":"40170_CR18","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1109\/MCI.2018.2866730","volume":"13","author":"MS Santos","year":"2018","unstructured":"Santos, M. S., Soares, J. P., Abreu, P. H., Araujo, H. & Santos, J. Cross-validation for imbalanced datasets: avoiding overoptimistic and overfitting approaches [research frontier]. IEEE Comput. Intell. Mag. 13, 59\u201376 (2018).","journal-title":"IEEE Comput. Intell. Mag."},{"key":"40170_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/095281300146272","volume":"12","author":"X Zeng","year":"2000","unstructured":"Zeng, X. & Martinez, T. R. Distribution-balanced stratified cross-validation for accuracy estimation. J. Experim. Theor. Aftif. Intell. 12, 1\u201312 (2000).","journal-title":"J. Experim. Theor. Aftif. Intell."},{"key":"40170_CR20","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1006\/jmps.1999.1279","volume":"44","author":"MW Browne","year":"2000","unstructured":"Browne, M. W. Cross-validation methods. J Math Psychol. 44, 108\u2013132 (2000).","journal-title":"J Math Psychol."},{"key":"40170_CR21","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1002\/bimj.200410135","volume":"47","author":"R Fluss","year":"2005","unstructured":"Fluss, R., Faraggi, D. & Reiser, B. Estimation of the Youden Index and its associated cutoff point. Biom. J. 47, 458\u2013472 (2005).","journal-title":"Biom. J."},{"key":"40170_CR22","doi-asserted-by":"crossref","unstructured":"Dietterich, T. G. Ensemble methods in machine learning. Mult. Classif. Syst. 1\u201315 (2000).","DOI":"10.1007\/3-540-45014-9_1"},{"key":"40170_CR23","doi-asserted-by":"crossref","unstructured":"B\u00fchlmann, P. Bagging, Boosting and Ensemble Methods. In Handbook of Computational Statistics 985\u20131022 (Springer, 2012).","DOI":"10.1007\/978-3-642-21551-3_33"},{"key":"40170_CR24","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1023\/A:1007515423169","volume":"36","author":"E Bauer","year":"1999","unstructured":"Bauer, E. & Kohavi, R. An empirical comparison of voting classification algorithms: Bagging, boosting, and variants. Mach. Learn. 36, 105\u2013139 (1999).","journal-title":"Mach. Learn."},{"key":"40170_CR25","doi-asserted-by":"crossref","unstructured":"Watson DS et al. Clinical applications of machine learning algorithms: beyond the black box. BMJ. 364 (2019).","DOI":"10.2139\/ssrn.3352454"},{"key":"40170_CR26","first-page":"4768","volume":"30","author":"SM Lundberg","year":"2017","unstructured":"Lundberg, S. M. & Lee, S. I. A unified approach to interpreting model predictions. Adv. Neural Inf. Process Syst. 30, 4768\u20134777 (2017).","journal-title":"Adv. Neural Inf. Process Syst."},{"key":"40170_CR27","unstructured":"Lundberg, S. M., Erion, G. G., & Lee, S.I. Consistent individualized feature attribution for tree ensembles. Preprint at https:\/\/arxiv.org\/abs\/1802.03888v3 (2018)."},{"key":"40170_CR28","unstructured":"Yang, J. Fast TreeSHAP: Accelerating SHAP Value Computation for Trees. Preprint at https:\/\/arxiv.org\/abs\/2109.09847 (2021)."},{"key":"40170_CR29","unstructured":"Ribeiro, M. T., Singh, S., & Guestrin, C. Model-agnostic interpretability of machine learning. Preprint at http:\/\/arxiv.org\/abs\/1606.05386 (2016)"},{"key":"40170_CR30","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman, L. Random forests. Mach. Learn. 45, 5\u201332 (2001).","journal-title":"Mach. Learn."},{"key":"40170_CR31","first-page":"3146","volume":"30","author":"G Ke","year":"2017","unstructured":"Ke, G. et al. Lightgbm: A highly efficient gradient boosting decision tree. Adv. Neural Inf. Process. Syst. 30, 3146\u20133154 (2017).","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"40170_CR32","doi-asserted-by":"crossref","unstructured":"Chen, T., & Guestrin, C. Xgboost: A scalable tree boosting system. Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining. Preprint at https:\/\/arxiv.org\/abs\/1603.02754 (2016).","DOI":"10.1145\/2939672.2939785"},{"key":"40170_CR33","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1006\/jcss.1997.1504","volume":"55","author":"Y Freund","year":"1997","unstructured":"Freund, Y. & Schapire, R. E. A decision-theoretic generalization of on-line learning and an application to boosting. J. Comp. Syst. Sci. 55, 119\u2013139 (1997).","journal-title":"J. Comp. Syst. Sci."},{"key":"40170_CR34","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1007\/BF00058655","volume":"24","author":"L Breiman","year":"1996","unstructured":"Breiman, L. Bagging predictors. Mach Learn. 24, 123\u2013140 (1996).","journal-title":"Mach Learn."},{"key":"40170_CR35","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1007\/BF00116037","volume":"5","author":"RE Schapire","year":"1990","unstructured":"Schapire, R. E. The strength of weak learnability. Mach. Learn. 5, 197\u2013227 (1990).","journal-title":"Mach. Learn."},{"key":"40170_CR36","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1016\/S0169-7161(04)24011-1","volume":"24","author":"CD Sutton","year":"2005","unstructured":"Sutton, C. D. Classification and regression trees, bagging, and boosting. Handbook Statist. 24, 303\u2013329 (2005).","journal-title":"Handbook Statist."},{"key":"40170_CR37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10462-009-9124-7","volume":"33","author":"L Rokach","year":"2010","unstructured":"Rokach, L. Ensemble-based classifiers. Artif. Intell. Rev. 33, 1\u201339 (2010).","journal-title":"Artif. Intell. Rev."},{"key":"40170_CR38","doi-asserted-by":"publisher","first-page":"1249","DOI":"10.1002\/widm.1249","volume":"8","author":"O Sagi","year":"2018","unstructured":"Sagi, O. & Rokach, L. Ensemble learning: A survey. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 8, 1249 (2018).","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"40170_CR39","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1613\/jair.614","volume":"11","author":"D Opitz","year":"1999","unstructured":"Opitz, D. & Maclin, R. Popular ensemble methods: An empirical study. J. Artif. Intell. Res. 11, 169\u2013198 (1999).","journal-title":"J. Artif. Intell. Res."},{"key":"40170_CR40","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1016\/j.compeleceng.2013.11.024","volume":"40","author":"G Chandrashekar","year":"2014","unstructured":"Chandrashekar, G. & Sahin, F. A survey on feature selection methods. Comput. Electr. Eng. 40, 16\u201328 (2014).","journal-title":"Comput. Electr. Eng."},{"key":"40170_CR41","doi-asserted-by":"crossref","unstructured":"Akiba, T., Sano, S., Yanase, T., Ohta, T., & Koyama, M. Optuna: A next-generation hyperparameter optimization framework. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2623\u20132631 (2019).","DOI":"10.1145\/3292500.3330701"},{"key":"40170_CR42","doi-asserted-by":"crossref","unstructured":"Bergstra, J., Yamins, D., & Cox, D. D. Hyperopt: A python library for optimizing the hyperparameters of machine learning algorithms. In Proceedings of the 12th Python in Science Conference SciPy, 13\u201319 (2013).","DOI":"10.25080\/Majora-8b375195-003"},{"key":"40170_CR43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12911-019-0918-5","volume":"19","author":"A Dinh","year":"2019","unstructured":"Dinh, A., Miertschin, S., Young, A. & Mohanty, S. D. A data-driven approach to predicting diabetes and cardiovascular disease with machine learning. BMC Med. Inform. Decis. Mak. 19, 1\u201315 (2019).","journal-title":"BMC Med. Inform. Decis. Mak."},{"key":"40170_CR44","doi-asserted-by":"publisher","first-page":"421","DOI":"10.3390\/app10010421","volume":"10","author":"KS Ryu","year":"2020","unstructured":"Ryu, K. S. et al. A deep learning model for estimation of patients with undiagnosed diabetes. Appl. Sci. 10, 421 (2020).","journal-title":"Appl. Sci."},{"key":"40170_CR45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1021\/ci0342472","volume":"44","author":"DM Hawkins","year":"2004","unstructured":"Hawkins, D. M. The problem of overfitting. J. Chem. Inf. Comput. Sci. 44, 1\u201312 (2004).","journal-title":"J. Chem. Inf. Comput. Sci."},{"key":"40170_CR46","doi-asserted-by":"crossref","unstructured":"Marc\u00edlio, W. E., & Eler, D. M. From explanations to feature selection: assessing SHAP values as feature selection mechanism. In Proceedings of the 2020 33rd SIBGRAPI Conf Graph Patterns Images (SIBGRAPI). 340\u2013347 (2020).","DOI":"10.1109\/SIBGRAPI51738.2020.00053"},{"key":"40170_CR47","first-page":"659","volume":"11","author":"P Misra","year":"2020","unstructured":"Misra, P. & Yadav, A. S. Improving the classification accuracy using recursive feature elimination with cross-validation. Int. J. Emerg. Technol. 11, 659\u2013665 (2020).","journal-title":"Int. J. Emerg. Technol."},{"key":"40170_CR48","doi-asserted-by":"publisher","first-page":"1340","DOI":"10.1093\/bioinformatics\/btq134","volume":"26","author":"A Altmann","year":"2010","unstructured":"Altmann, A., Tolo\u015fi, L., Sander, O. & Lengauer, T. Permutation importance: A corrected feature importance measure. Bioinformatics 26, 1340\u20131347 (2010).","journal-title":"Bioinformatics"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-40170-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-40170-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-40170-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,19]],"date-time":"2023-11-19T17:06:53Z","timestamp":1700413613000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-40170-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,11]]},"references-count":48,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["40170"],"URL":"https:\/\/doi.org\/10.1038\/s41598-023-40170-0","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,11]]},"assertion":[{"value":"18 April 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 August 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"13101"}}