{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T05:01:08Z","timestamp":1781758868132,"version":"3.54.5"},"reference-count":80,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2025,2,14]],"date-time":"2025-02-14T00:00:00Z","timestamp":1739491200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>The weighted kappa coefficient is commonly used for assessing agreement between two raters on an ordinal scale. This study is the first to assess the impact of missing data on the value of weighted kappa. We compared three methods for handling missing data in a simulation study: predictive mean matching, listwise deletion and a weighted version of Gwet\u2019s kappa. We compared their performances under three missing data mechanisms, using agreement tables with various numbers of categories and different values of weighted kappa. Predictive mean matching outperformed the other two methods in most simulated cases in terms of root mean squared error and in all cases in terms of bias.<\/jats:p>","DOI":"10.3390\/make7010018","type":"journal-article","created":{"date-parts":[[2025,2,14]],"date-time":"2025-02-14T11:14:41Z","timestamp":1739531681000},"page":"18","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Weighted Kappa for Interobserver Agreement and Missing Data"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7302-640X","authenticated-orcid":false,"given":"Matthijs J.","family":"Warrens","sequence":"first","affiliation":[{"name":"GION Education\/Research, Faculty of Behavioural and Social Sciences, University of Groningen, Grote Rozenstraat 3, 9712 TG Groningen, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandra","family":"de Raadt","sequence":"additional","affiliation":[{"name":"GION Education\/Research, Faculty of Behavioural and Social Sciences, University of Groningen, Grote Rozenstraat 3, 9712 TG Groningen, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1495-7298","authenticated-orcid":false,"given":"Roel J.","family":"Bosker","sequence":"additional","affiliation":[{"name":"GION Education\/Research, Faculty of Behavioural and Social Sciences, University of Groningen, Grote Rozenstraat 3, 9712 TG Groningen, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4995-9349","authenticated-orcid":false,"given":"Henk A. L.","family":"Kiers","sequence":"additional","affiliation":[{"name":"Heymans Institute for Psychological Research, Faculty of Behavioural and Social Sciences, University of Groningen, Grote Kruisstraat 2\/1, 9712 TS Groningen, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1007\/s00247-017-3790-4","article-title":"Magnetic resonance enterography has good inter-rater agreementand diagnostic accuracy for detecting inflammation in pediatric Crohn disease","volume":"47","author":"Church","year":"2017","journal-title":"Pediatr. Radiol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1007\/s00357-021-09386-5","article-title":"A Comparison of reliability coefficients for ordinal rating scales","volume":"38","author":"Warrens","year":"2021","journal-title":"J. Classif."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"732","DOI":"10.1017\/S1352465814000241","article-title":"Relationship between expectation management and client retention in online cognitive behavioural therapie","volume":"43","author":"Ekberg","year":"2015","journal-title":"Behav. Cogn. Psychother."},{"key":"ref_4","first-page":"3543","article-title":"Suicidal ideation versus hopelessness\/helplessness in healthy individuals and in patients with benign breast disease and breast cancer: A prospective case\u2013control study in Finland","volume":"35","author":"Eskelinen","year":"2015","journal-title":"Anticancer Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"157","DOI":"10.2147\/CLEP.S129785","article-title":"Missing data and multiple imputation in clinical epidemiological research","volume":"15","author":"Pedersen","year":"2017","journal-title":"Clin. Epidemiol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1016\/j.ecresq.2011.12.006","article-title":"Rater calibration when observational assessment occurs at large scale: Degree of calibration and characteristics of raters associated with calibration","volume":"27","author":"Cash","year":"2012","journal-title":"Early Child. Res. Q."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1111\/apa.14892","article-title":"Effects of different types of classroom physical activity breaks on children\u2019s on task behaviour, academic achievement and cognition","volume":"109","author":"Mavilidi","year":"2019","journal-title":"Acta Paediatr."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.tate.2017.02.018","article-title":"Changes in teachers\u2019 instructional skills during an intensive data-based decision making intervention","volume":"65","author":"Glas","year":"2017","journal-title":"Teach. Teach. Educ."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1256","DOI":"10.1007\/s10803-010-1157-x","article-title":"Diagnosing autism spectrum disorders in adults: The use of Autism Diagnostic Observation Schedule (ADOS) Module 4","volume":"41","author":"Bastiaansen","year":"2011","journal-title":"J. Autism Dev. Disord."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1007\/s10802-005-0930-3","article-title":"Early adversity and the prospective prediction of depressive and anxiety disorders in adolescents","volume":"33","author":"Phillips","year":"2005","journal-title":"J. Abnorm. Child Psychol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"867","DOI":"10.1111\/j.1399-5618.2009.00764.x","article-title":"Stability of symptoms across major depressive episodes in bipolar disorder","volume":"11","author":"Perlis","year":"2009","journal-title":"Bipolar Disord."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1002\/(SICI)1097-0258(20000315)19:5<723::AID-SIM379>3.0.CO;2-A","article-title":"Interval estimation for Cohen\u2019s kappa as a measure of agreement","volume":"19","author":"Blackman","year":"2000","journal-title":"Stat. Med."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"276","DOI":"10.11613\/BM.2012.031","article-title":"Interrater reliability: The kappa statistic","volume":"22","author":"McHugh","year":"2012","journal-title":"Biochem. Medica"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1016\/j.jamcollsurg.2009.09.031","article-title":"Toward robust information: Data quality and inter-rater reliability in American college of surgeons national surgical quality improvement program","volume":"1","author":"Shiloach","year":"2010","journal-title":"J. Am. Coll. Surg."},{"key":"ref_15","first-page":"360","article-title":"Understanding interobserver agreement: The kappa statistic","volume":"37","author":"Viera","year":"2005","journal-title":"Fam. Med."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1111\/1469-7610.00023","article-title":"The diagnostic interview for Social and Communication disorders: Background, inter-rater reliability and clinical use","volume":"43","author":"Wing","year":"2002","journal-title":"J. Child Psychol. Psychiatry"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1016\/j.stamet.2010.05.003","article-title":"Cohen\u2019s kappa can always be increased and decreased by combining categories","volume":"7","author":"Warrens","year":"2010","journal-title":"Stat. Methodol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1037\/h0026256","article-title":"Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit","volume":"70","author":"Cohen","year":"1968","journal-title":"Psychol. Bull."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1177\/001316447303300309","article-title":"The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability","volume":"33","author":"Cohen","year":"1973","journal-title":"Educ. Psychol. Meas."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1019","DOI":"10.1177\/0013164416663277","article-title":"Kappa and rater accuracy: Paradigms and parameters","volume":"77","author":"Conger","year":"2017","journal-title":"Educ. Psychol. Meas."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1037\/h0028106","article-title":"Large sample standard errors of kappa and weighted kappa","volume":"72","author":"Fleiss","year":"1969","journal-title":"Psychol. Bull."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1055","DOI":"10.1016\/0895-4356(93)90173-X","article-title":"The analysis of ordinal agreement data: Beyond weighted kappa","volume":"46","author":"Graham","year":"1993","journal-title":"J. Clin. Epidemiol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1007\/BF02294066","article-title":"Nominal scale agreement among observers","volume":"51","author":"Schouten","year":"1986","journal-title":"Psychometrika"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1177\/0013164403260197","article-title":"A note on the interpretation of weighted kappa and its relations to other rater agreement statistics for metric scales","volume":"64","author":"Schuster","year":"2004","journal-title":"Educ. Psychol. Meas."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1007\/s11336-014-9439-4","article-title":"A new interpretation of the weighted kappa coefficients","volume":"81","author":"Vanbelle","year":"2016","journal-title":"Psychometrika"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1016\/j.stamet.2011.08.006","article-title":"Cohen\u2019s quadratically weighted kappa is higher than linearly weighted kappa for tridiagonal agreement tables","volume":"9","author":"Warrens","year":"2012","journal-title":"Stat. Methodol."},{"key":"ref_28","first-page":"161","article-title":"Misinterpretation and misuse of the kappa statistic","volume":"126","author":"Maclure","year":"1987","journal-title":"J. Epidemiol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1007\/s11336-012-9258-4","article-title":"Some paradoxical results for the quadratically weighted kappa","volume":"77","author":"Warrens","year":"2012","journal-title":"Psychometrika"},{"key":"ref_30","unstructured":"Doewes, A., Kurdhi, N., and Saxena, A. (2023, January 11\u201314). Evaluating quadratic weighted kappa as the standard performance metric for automated essay scoring. Proceedings of the 16th International Conference on Educational Data Mining, Indian Institute of Science Campus, Bengaluru, India."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"110020","DOI":"10.1016\/j.asoc.2023.110020","article-title":"Weighted kappa measures for ordinal multi-class classification performance","volume":"134","author":"Yilmaz","year":"2023","journal-title":"Appl. Soft Comput."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1080\/13645579.2018.1563978","article-title":"Treatment and reporting of item-level missing data in social science research","volume":"22","author":"Berchtold","year":"2019","journal-title":"Int. J. Soc. Res. Methodol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1002\/phar.1569","article-title":"Approach to addressing missing data for electronic medical records and pharmacy claims data research","volume":"35","author":"Bounthavong","year":"2015","journal-title":"Pharmacotherapy"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3297","DOI":"10.1200\/JCO.2011.38.7589","article-title":"Missing data in clinical studies: Issues and methods","volume":"30","author":"Ibrahim","year":"2012","journal-title":"J. Clin. Oncol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1966","DOI":"10.1001\/jama.2015.15281","article-title":"Multiple imputation: A flexible tool for handling missing data","volume":"314","author":"Li","year":"2015","journal-title":"J. Am. Med Assoc."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1146\/annurev.psych.58.110405.085530","article-title":"Missing data analysis: Making it work in the real world","volume":"60","author":"Graham","year":"2009","journal-title":"Annu. Rev. Psychol."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Jakobsen, J.C., Gluud, C., Wetterslev, J., and Winkel, P. (2017). When and how should multiple imputation be used for handling missing data in randomised clinical trials\u2014A practical guide with flowcharts. BMC Med Res. Methodol., 17.","DOI":"10.1186\/s12874-017-0442-1"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"402","DOI":"10.4097\/kjae.2013.64.5.402","article-title":"The prevention and handling of the missing data","volume":"64","author":"Kang","year":"2013","journal-title":"Korean J. Anesthesiol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/2193-1801-2-222","article-title":"Principled missing data methods for researchers","volume":"2","author":"Dong","year":"2013","journal-title":"SpringerPlus"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/s11222-009-9143-x","article-title":"Missing data mechanisms and their implications on the analysis of categorical data","volume":"21","author":"Poleto","year":"2011","journal-title":"Stat. Comput."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1093\/biomet\/63.3.581","article-title":"Inference and missing data","volume":"63","author":"Rubin","year":"1976","journal-title":"Biometrika"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1016\/j.jsp.2009.10.001","article-title":"An introduction to modern missing data analyses","volume":"48","author":"Baraldi","year":"2010","journal-title":"J. Sch. Psychol."},{"key":"ref_43","first-page":"473","article-title":"The treatment of missing values indiscriminant analysis. I. The sampling experiment","volume":"67","author":"Chan","year":"1972","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_44","unstructured":"Enders, C.K. (2010). Applied Missing Data Analysis, Guilford Press."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"913","DOI":"10.1080\/08839514.2019.1637138","article-title":"Comparison of performance of data imputation methods for numeric dataset","volume":"33","author":"Jadhav","year":"2019","journal-title":"Appl. Artif. Intell."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"525","DOI":"10.3102\/00346543074004525","article-title":"Missing data in educational research: A review of reporting practices and suggestions for improvement","volume":"74","author":"Peugh","year":"2004","journal-title":"Rev. Educ. Res."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1177\/0013164487471002","article-title":"A comparison of methods for treating incomplete data in selection research","volume":"47","author":"Raymond","year":"1987","journal-title":"Educ. Psychol. Meas."},{"key":"ref_48","first-page":"77","article-title":"Traditional versus modern missing data handling techniques: An overview","volume":"118","author":"Shylaja","year":"2018","journal-title":"Int. J. Pure Appl. Math."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"3057","DOI":"10.1002\/sim.2787","article-title":"Multiple imputation: Review of theory, implementation and software","volume":"26","author":"Harel","year":"2007","journal-title":"Stat. Med."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Hayati Rezvan, P., Lee, K.J., and Simpson, J.A. (2015). The rise of multiple imputation: A review of reporting and implementation of the method in medical research. BMC Med. Res. Methodol., 15.","DOI":"10.1186\/s12874-015-0022-1"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1198\/000313007X172556","article-title":"Much ado about nothing: A comparison of missing data methods and software to fit incomplete data regression models","volume":"61","author":"Horton","year":"2007","journal-title":"Am. Stat."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Huque, M.D.H., Carlin, J.B., Simpson, J.A., and Lee, K.J. (2018). A comparison of multiple imputation methods in longitudinal studies. BMC Med. Res. Methodol., 18.","DOI":"10.1186\/s12874-018-0615-6"},{"key":"ref_53","unstructured":"Little, R.J.A., and Rubin, D.B. (1987). Statistical Analysis with Missing Data, Wiley."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1102","DOI":"10.1016\/j.jclinepi.2006.01.015","article-title":"Imputation of missing values is superior to complete case analysis and the missing-indicator method in multivariate diagnostic research: A clinical example","volume":"59","author":"Donders","year":"2006","journal-title":"J. Clin. Epidemiol."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1002\/sim.4067","article-title":"Multiple imputation using chained equations: Issues and guidance for practice","volume":"30","author":"White","year":"2011","journal-title":"Stat. Med."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Van Buuren, S. (2012). Flexible Imputation of Missing Data, CRC Press.","DOI":"10.1201\/b11826"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1080\/19312458.2011.624490","article-title":"Goodbye, listwise deletion: Presenting hot deck imputation as an easy and effective tool for handling missing data","volume":"4","author":"Myers","year":"2011","journal-title":"Commun. Methods Meas."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"758","DOI":"10.1016\/j.csda.2013.02.017","article-title":"Model selection and model averaging after multiple imputation","volume":"71","author":"Schomaker","year":"2014","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"2267","DOI":"10.1016\/j.csda.2010.04.005","article-title":"Avoiding bias due to perfect prediction of incomplete categorical variables","volume":"54","author":"White","year":"2010","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Rubin, D.B. (1987). Multiple Imputation for Nonresponse in Surveys, Wiley.","DOI":"10.1002\/9780470316696"},{"key":"ref_61","first-page":"71","article-title":"Methods for handling missing data in the behavioral neurosciences: Don\u2019t throw the baby rat out with the bath water","volume":"5","author":"Rubin","year":"2007","journal-title":"J. Undergrad. Neurosci. Educ."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1002\/(SICI)1097-0258(19990330)18:6<681::AID-SIM71>3.0.CO;2-R","article-title":"Multiple imputation of missing blood pressure covariates in survival analysis","volume":"18","author":"Boshuizen","year":"1999","journal-title":"Stat. Med."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1038\/s41588-024-01793-9","article-title":"Synthetic surrogates improve power for genome-wide association studies of partially missing phenotypes in population biobanks","volume":"56","author":"McCaw","year":"2024","journal-title":"Nat. Genet."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A coefficient of agreement for nominal scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ. Psychol. Meas."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"197","DOI":"10.4172\/2161-0487.1000197","article-title":"Five ways to look at Cohen\u2019s kappa","volume":"5","author":"Warrens","year":"2015","journal-title":"J. Psychol. Psychother."},{"key":"ref_66","unstructured":"Gwet, K.L. (2012). Handbook of Inter-Rater Reliability: The Definitive Guide to Measuring the Extent of Agreement Among Multiple Raters, Advanced Analytics. [3rd ed.]."},{"key":"ref_67","unstructured":"Gwet, K.L. (2014). Handbook of Inter-Rater Reliability: The Definitive Guide to Measuring the Extent of Agreement Among Multiple Raters, Advanced Analytics. [4th ed.]."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"558","DOI":"10.1177\/0013164418823249","article-title":"Kappa coefficients for missing data","volume":"79","author":"Warrens","year":"2019","journal-title":"Educ. Psychol. Meas."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1177\/0013164405285548","article-title":"Including omission mistakes in the calculation of Cohen\u2019s kappa and an analysis of the coefficients paradox features","volume":"66","author":"Simon","year":"2006","journal-title":"Educ. Psychol. Meas."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1016\/j.learninstruc.2007.03.005","article-title":"Methodological issues in developing a multi-dimensional coding procedure for small-group chat communication","volume":"17","author":"Strijbos","year":"2007","journal-title":"Learn. Instr."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1007\/s00357-014-9156-9","article-title":"Corrected Zegers-ten Berge coefficients are special cases of Cohen\u2019s weighted kappa","volume":"31","author":"Warrens","year":"2014","journal-title":"J. Classif."},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"57","DOI":"10.3102\/1076998615622221","article-title":"On matrix sampling and imputation of context questionnaires with implications for the generation of plausible values in large-scale assessments","volume":"41","author":"Kaplan","year":"2016","journal-title":"J. Educ. Behav. Stat."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1007\/s11336-009-9116-1","article-title":"Agreement between two independent groups of raters","volume":"74","author":"Vanbelle","year":"2009","journal-title":"Psychometrika"},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1007\/s11336-011-9210-z","article-title":"Cohen\u2019s linearly weighted kappa is a weighted average of 2 \u00d7 2 kappas","volume":"76","author":"Warrens","year":"2011","journal-title":"Psychometrika"},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"De Silva, A.P., Moreno-Betancur, M., De Livera, A.M., Lee, K.J., and Simpson, J.A. (2019). Multiple imputation methods for handling missing values in a longitudinal categorical variable with restrictions on transitions over time: A simulation study. BMC Med. Res. Methodol., 19.","DOI":"10.1186\/s12874-018-0653-0"},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1080\/17405629.2015.1049526","article-title":"How to handle missing data: A comparison of different approaches","volume":"12","author":"Peeters","year":"2015","journal-title":"Eur. J. Dev. Psychol."},{"key":"ref_77","unstructured":"R Core Team (2019). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing. Available online: http:\/\/www.r-project.org\/index.html."},{"key":"ref_78","first-page":"1","article-title":"Mice: Multivariate imputation by chained equations in R","volume":"45","year":"2011","journal-title":"J. Stat. Softw."},{"key":"ref_79","unstructured":"Allison, P.D. (2023, June 02). Imputation by Predictive Mean Matching: Promise & Peril. Available online: http:\/\/statisticalhorizons.com\/predictive-mean-matching."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1027\/1614-2241\/a000141","article-title":"Multiple imputation by predictive mean matching when sample size is small","volume":"14","author":"Kleinke","year":"2018","journal-title":"Methodology"}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/7\/1\/18\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:34:36Z","timestamp":1760027676000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/7\/1\/18"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,14]]},"references-count":80,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,3]]}},"alternative-id":["make7010018"],"URL":"https:\/\/doi.org\/10.3390\/make7010018","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,14]]}}}