{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,17]],"date-time":"2026-11-17T13:55:10Z","timestamp":1794923710353,"version":"4.9.1"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,2,16]],"date-time":"2024-02-16T00:00:00Z","timestamp":1708041600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,16]],"date-time":"2024-02-16T00:00:00Z","timestamp":1708041600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Missing data is frequently an inevitable issue in cohort studies and it can adversely affect the study's findings. We assess the effectiveness of eight frequently utilized statistical and machine learning (ML) imputation methods for dealing with missing data in predictive modelling of cohort study datasets. This evaluation is based on real data and predictive models for cardiovascular disease (CVD) risk.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The data is from a real-world cohort study in Xinjiang, China. It includes personal information, physical examination data, questionnaires, and laboratory biochemical results from 10,164 subjects with a total of 37 variables. Simple imputation (Simple), regression imputation (Regression), expectation-maximization(EM), multiple imputation (MICE) , K nearest neighbor classification (KNN), clustering imputation (Cluster), random forest (RF), and decision tree (Cart) were the chosen imputation methods. Root Mean Square Error (RMSE) and Mean Absolute Error (MAE) are utilised to assess the performance of different methods for missing data imputation at a missing rate of 20%. The datasets processed with different missing data imputation methods were employed to construct a CVD risk prediction model utilizing the support vector machine (SVM). The predictive performance was then compared using the area under the curve (AUC).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      The most effective imputation results were attained by KNN (MAE: 0.2032, RMSE: 0.7438, AUC: 0.730, CI: 0.719-0.741) and RF (MAE: 0.3944, RMSE: 1.4866, AUC: 0.777, CI: 0.769-0.785). The subsequent best performances were achieved by EM, Cart, and MICE, while Simple, Regression, and Cluster attained the worst performances. The CVD risk prediction model was constructed using the complete data (AUC:0.804, CI:0.796-0.812) in comparison with all other models with\n                      <jats:italic>p<\/jats:italic>\n                      &lt;0.05.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>KNN and RF exhibit superior performance and are more adept at imputing missing data in predictive modelling of cohort study datasets.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12874-024-02173-x","type":"journal-article","created":{"date-parts":[[2024,2,16]],"date-time":"2024-02-16T04:03:47Z","timestamp":1708056227000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":150,"title":["Comparison of the effects of imputation methods for missing data in predictive modelling of cohort study datasets"],"prefix":"10.1186","volume":"24","author":[{"given":"JiaHang","family":"Li","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"ShuXia","family":"Guo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"RuLin","family":"Ma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jia","family":"He","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"XiangHui","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"DongSheng","family":"Rui","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"YuSong","family":"Ding","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"LeYao","family":"Jian","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Cheng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Heng","family":"Guo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,2,16]]},"reference":[{"key":"2173_CR1","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1016\/j.jclinepi.2022.08.016","volume":"151","author":"MW Heymans","year":"2022","unstructured":"Heymans MW, Twisk JWR. Handling missing data in clinical research. J Clin Epidemiol. 2022;151:185\u20138.","journal-title":"J Clin Epidemiol"},{"issue":"14","key":"2173_CR2","doi-asserted-by":"publisher","first-page":"1355","DOI":"10.1056\/NEJMsr1203730","volume":"367","author":"RJ Little","year":"2012","unstructured":"Little RJ, D\u2019Agostino R, Cohen ML, Dickersin K, Emerson SS, Farrar JT, Frangakis C, Hogan JW, Molenberghs G, Murphy SA, et al. The prevention and treatment of missing data in clinical trials. N Engl J Med. 2012;367(14):1355\u201360.","journal-title":"N Engl J Med"},{"issue":"1","key":"2173_CR3","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1186\/s12955-019-1181-2","volume":"17","author":"OF Ayilara","year":"2019","unstructured":"Ayilara OF, Zhang L, Sajobi TT, Sawatzky R, Bohm E, Lix LM. Impact of missing data on bias and precision when estimating change in patient-reported outcomes from a clinical registry. Health Qual Life Outcomes. 2019;17(1):106.","journal-title":"Health Qual Life Outcomes"},{"key":"2173_CR4","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1016\/j.jclinepi.2021.11.023","volume":"142","author":"S Nijman","year":"2022","unstructured":"Nijman S, Leeuwenberg AM, Beekers I, Verkouter I, Jacobs J, Bots ML, Asselbergs FW, Moons K, Debray T. Missing data is poorly handled and reported in prediction model studies using machine learning: a literature review. J Clin Epidemiol. 2022;142:218\u201329.","journal-title":"J Clin Epidemiol"},{"issue":"1","key":"2173_CR5","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1186\/s40537-021-00516-9","volume":"8","author":"T Emmanuel","year":"2021","unstructured":"Emmanuel T, Maupong T, Mpoeleng D, Semong T, Mphago B, Tabona O. A survey on missing data in machine learning. J Big Data. 2021;8(1):140.","journal-title":"J Big Data"},{"issue":"5","key":"2173_CR6","doi-asserted-by":"publisher","first-page":"729","DOI":"10.1097\/EDE.0b013e3182576cdb","volume":"23","author":"I Eekhout","year":"2012","unstructured":"Eekhout I, de Boer RM, Twisk JW, de Vet HC, Heymans MW. Missing data: a systematic review of how they are reported and handled. Epidemiology (Cambridge, Mass). 2012;23(5):729\u201332.","journal-title":"Epidemiology (Cambridge, Mass)"},{"issue":"2","key":"2173_CR7","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1093\/jpepsy\/jst048","volume":"39","author":"TD Little","year":"2014","unstructured":"Little TD, Jorgensen TD, Lang KM, Moore EW. On the joys of missing data. J Pediatr Psychol. 2014;39(2):151\u201362.","journal-title":"J Pediatr Psychol"},{"issue":"2","key":"2173_CR8","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1016\/j.artmed.2010.05.002","volume":"50","author":"JM Jerez","year":"2010","unstructured":"Jerez JM, Molina I, Garc\u00eda-Laencina PJ, Alba E, Ribelles N, Mart\u00edn M, Franco L. Missing data imputation using statistical and machine learning methods in a real breast cancer problem. Artif Intell Med. 2010;50(2):105\u201315.","journal-title":"Artif Intell Med"},{"key":"2173_CR9","doi-asserted-by":"publisher","first-page":"105449","DOI":"10.1016\/j.compbiomed.2022.105449","volume":"145","author":"R Rios","year":"2022","unstructured":"Rios R, Miller RJH, Manral N, Sharir T, Einstein AJ, Fish MB, Ruddy TD, Kaufmann PA, Sinusas AJ, Miller EJ, et al. Handling missing values in machine learning to predict patient-specific risk of adverse cardiac events: Insights from REFINE SPECT registry. Comput Biol Med. 2022;145:105449.","journal-title":"Comput Biol Med"},{"key":"2173_CR10","doi-asserted-by":"publisher","first-page":"205031211882291","DOI":"10.1177\/2050312118822912","volume":"7","author":"MR Stavseth","year":"2019","unstructured":"Stavseth MR, Clausen T, R\u00f8islien J. How handling missing data may impact conclusions: a comparison of six different imputation methods for categorical questionnaire data. SAGE Open Med. 2019;7:2050312118822912.","journal-title":"SAGE Open Med"},{"key":"2173_CR11","doi-asserted-by":"crossref","first-page":"204800402094932","DOI":"10.1177\/2048004020949326","volume":"9","author":"J Stewart","year":"2020","unstructured":"Stewart J, Addy K, Campbell S, Wilkinson P. Primary prevention of cardiovascular disease: Updated review of contemporary guidance and literature. JRSM Cardiovasc Dis. 2020;9:2048004020949326.","journal-title":"JRSM Cardiovasc Dis"},{"key":"2173_CR12","unstructured":"The challenge of cardiovascular disease \u2013 quick statistics http:\/\/www.euro.who.int\/en\/health-topics\/noncommunicable-diseases\/cardiovascular-diseases\/data-and-statistics."},{"key":"2173_CR13","doi-asserted-by":"crossref","unstructured":"DB R: Inference and missing data. Biometrika 1976, 63(3):581-592.","DOI":"10.1093\/biomet\/63.3.581"},{"key":"2173_CR14","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1146\/annurev.psych.58.110405.085530","volume":"60","author":"JW Graham","year":"2009","unstructured":"Graham JW. Missing data analysis: making it work in the real world. Ann Rev Psychol. 2009;60:549\u201376.","journal-title":"Ann Rev Psychol"},{"issue":"1","key":"2173_CR15","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1186\/s40537-020-00313-w","volume":"7","author":"SI Khan","year":"2020","unstructured":"Khan SI, Hoque A. SICE: an improved missing data imputation technique. J Big Data. 2020;7(1):37.","journal-title":"J Big Data"},{"issue":"9","key":"2173_CR16","doi-asserted-by":"publisher","first-page":"2647","DOI":"10.1177\/0962280220908613","volume":"29","author":"L Yu","year":"2020","unstructured":"Yu L, Liu L, Peace KE. Regression multiple imputation for missing data analysis. Stat Methods Med Res. 2020;29(9):2647\u201364.","journal-title":"Stat Methods Med Res"},{"issue":"2","key":"2173_CR17","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1111\/biom.12149","volume":"70","author":"LS Chen","year":"2014","unstructured":"Chen LS, Prentice RL, Wang P. A penalized EM algorithm incorporating missing data mechanism for Gaussian parameter estimation. Biometrics. 2014;70(2):312\u201322.","journal-title":"Biometrics"},{"issue":"12","key":"2173_CR18","doi-asserted-by":"publisher","first-page":"2685","DOI":"10.1177\/09622802211047346","volume":"30","author":"LJ Beesley","year":"2021","unstructured":"Beesley LJ, Bondarenko I, Elliot MR, Kurian AW, Katz SJ, Taylor JM. Multiple imputation with missing data indicators. Stat Methods Med Res. 2021;30(12):2685\u2013700.","journal-title":"Stat Methods Med Res"},{"issue":"1","key":"2173_CR19","doi-asserted-by":"publisher","first-page":"1304","DOI":"10.1186\/s40064-016-2941-7","volume":"5","author":"LY Hu","year":"2016","unstructured":"Hu LY, Huang MW, Ke SW, Tsai CF. The distance function effect on k-nearest neighbor classification for medical datasets. SpringerPlus. 2016;5(1):1304.","journal-title":"SpringerPlus"},{"key":"2173_CR20","doi-asserted-by":"crossref","unstructured":"Samad MD, Abrar S, Diawara N: Missing Value Estimation using Clustering and Deep Learning within Multiple Imputation Framework. Knowl-Based Syst. 2022, 249.","DOI":"10.1016\/j.knosys.2022.108968"},{"issue":"6","key":"2173_CR21","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2014-007450","volume":"5","author":"NJ Tierney","year":"2015","unstructured":"Tierney NJ, Harden FA, Harden MJ, Mengersen KL. Using decision trees to understand structure in missing data. BMJ Open. 2015;5(6): e007450.","journal-title":"BMJ Open"},{"issue":"6","key":"2173_CR22","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1002\/sam.11348","volume":"10","author":"F Tang","year":"2017","unstructured":"Tang F, Ishwaran H. Random forest missing data algorithms. Stat Analysis Data Mining. 2017;10(6):363\u201377.","journal-title":"Stat Analysis Data Mining"},{"key":"2173_CR23","doi-asserted-by":"publisher","first-page":"417","DOI":"10.2147\/CLEP.S313343","volume":"13","author":"Y Jiang","year":"2021","unstructured":"Jiang Y, Zhang X, Ma R, Wang X, Liu J, Keerman M, Yan Y, Ma J, Song Y, Zhang J, et al. Cardiovascular Disease Prediction by Machine Learning Algorithms Based on Cytokines in Kazakhs of China. Clin Epidemiol. 2021;13:417\u201328.","journal-title":"Clin Epidemiol"},{"issue":"3","key":"2173_CR24","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1007\/BF00994018","volume":"20","author":"CVV Cortes","year":"1995","unstructured":"Cortes CVV. Support-vector networks. Mach Learn. 1995;20(3):273\u201397.","journal-title":"Mach Learn"},{"issue":"10","key":"2173_CR25","doi-asserted-by":"publisher","first-page":"913","DOI":"10.1080\/08839514.2019.1637138","volume":"33","author":"DPKR Anil Jadhav","year":"2019","unstructured":"Anil Jadhav DPKR. Comparison of Performance of Data Imputation Methods for Numeric Dataset. Appl Artif Intell. 2019;33(10):913\u201333.","journal-title":"Appl Artif Intell"},{"issue":"1","key":"2173_CR26","first-page":"7133","volume":"18","author":"D Bdpczy","year":"2017","unstructured":"Bdpczy D. From predictive methods to missing data imputation: an optimization approach. J Machine Learn Res. 2017;18(1):7133\u201371.","journal-title":"J Machine Learn Res"},{"issue":"4","key":"2173_CR27","doi-asserted-by":"publisher","first-page":"606","DOI":"10.1002\/sim.7173","volume":"36","author":"KJ Lee","year":"2017","unstructured":"Lee KJ, Carlin JB. Multiple imputation in the presence of non-normal data. Stat Med. 2017;36(4):606\u201317.","journal-title":"Stat Med"},{"issue":"1","key":"2173_CR28","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1186\/s12874-020-00932-0","volume":"20","author":"X Xu","year":"2020","unstructured":"Xu X, Xia L, Zhang Q, Wu S, Wu M, Liu H. The ability of different imputation methods for missing values in mental measurement questionnaires. BMC Med Res Methodol. 2020;20(1):42.","journal-title":"BMC Med Res Methodol"},{"issue":"1","key":"2173_CR29","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1002\/mpr.329","volume":"20","author":"MJ Azur","year":"2011","unstructured":"Azur MJ, Stuart EA, Frangakis C, Leaf PJ. Multiple imputation by chained equations: what is it and how does it work? Int J Methods Psychiatr Res. 2011;20(1):40\u20139.","journal-title":"Int J Methods Psychiatr Res"},{"issue":"2","key":"2173_CR30","first-page":"A71","volume":"5","author":"LH Rubin","year":"2007","unstructured":"Rubin LH, Witkiewitz K, Andre JS, Reilly S. Methods for handling missing data in the behavioral neurosciences: don\u2019t throw the baby rat out with the bath water. J Undergrad Neurosci Educ. 2007;5(2):A71-77.","journal-title":"J Undergrad Neurosci Educ"},{"key":"2173_CR31","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1016\/j.nutres.2020.01.001","volume":"75","author":"L Malan","year":"2020","unstructured":"Malan L, Smuts CM, Baumgartner J, Ricci C. Missing data imputation via the expectation-maximization algorithm can improve principal component analysis aimed at deriving biomarker profiles and dietary patterns. Nutr Res (New York, NY). 2020;75:67\u201376.","journal-title":"Nutr Res (New York, NY)"},{"key":"2173_CR32","doi-asserted-by":"crossref","unstructured":"Murti DMPaP, Utomo and Wibawa, Aji Prasetya and Akbar, Muhammad Iqbal: K-Nearest Neighbor (K-NN) based Missing Data Imputation. 2019 5th International Conference on Science in Information Technology (ICSITech) 2019:83-88.","DOI":"10.1109\/ICSITech46713.2019.8987530"},{"issue":"10","key":"2173_CR33","doi-asserted-by":"publisher","first-page":"1282","DOI":"10.1111\/1756-185X.14203","volume":"24","author":"A Alsaber","year":"2021","unstructured":"Alsaber A, Al-Herz A, Pan J, Al-Sultan AT, Mishra D. Handling missing data in a rheumatoid arthritis registry using random forest approach. Int J Rheum Dis. 2021;24(10):1282\u201393.","journal-title":"Int J Rheum Dis"}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-024-02173-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12874-024-02173-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-024-02173-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,16]],"date-time":"2024-02-16T04:07:00Z","timestamp":1708056420000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/s12874-024-02173-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,16]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["2173"],"URL":"https:\/\/doi.org\/10.1186\/s12874-024-02173-x","relation":{},"ISSN":["1471-2288"],"issn-type":[{"value":"1471-2288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,16]]},"assertion":[{"value":"24 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 February 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study was approved by the Institutional Ethics Review Board (IERB) of the First Affiliated Hospital of Shihezi University School of Medicine (IERB No. SHZ2010LL01). All subjects were informed of the procedure and related issues before the experiment and consent was obtained from the subjects themselves or their guardians. All of the participants provided their written informed consent before the start of the study. All methods were carried out by relevant guidelines and regulations.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"41"}}