{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,5]],"date-time":"2026-11-05T19:38:46Z","timestamp":1793907526560,"version":"4.8.0"},"reference-count":69,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2024,1,30]],"date-time":"2024-01-30T00:00:00Z","timestamp":1706572800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["J Diabetes Sci Technol"],"published-print":{"date-parts":[[2025,7]]},"abstract":"<jats:sec>\n                    <jats:title>Background:<\/jats:title>\n                    <jats:p>Diabetic foot ulcers (DFUs) are serious complications of diabetes which can lead to lower extremity amputations (LEAs). Risk prediction models can identify high-risk patients who can benefit from early intervention. Machine learning (ML) methods have shown promising utility in medical applications. Explainable modeling can help its integration and acceptance. This study aims to develop a risk prediction model using ML algorithms with explainability for LEA in DFU patients.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>This study is a retrospective review of 2559 inpatient DFU episodes in a tertiary institution from 2012 to 2017. Fifty-one features including patient demographics, comorbidities, medication, wound characteristics, and laboratory results were reviewed. Outcome measures were the risk of major LEA, minor LEA and any LEA. Machine learning models were developed for each outcome, with model performance evaluated using receiver operating characteristic (ROC) curves, balanced-accuracy and F1-score. SHapley Additive exPlanations (SHAP) was applied to interpret the model for explainability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>Model performance for prediction of major, minor, and any LEA event achieved ROC of 0.820, 0.637, and 0.756, respectively, with XGBoost, XGBoost, and Gradient Boosted Trees algorithms demonstrating best results for each model, respectively. Using SHAP, key features that contributed to the predictions were identified for explainability. Total white cell (TWC) count, comorbidity score and red blood cell count contributed highest weightage to major LEA event. Total white cell, eosinophils, and necrotic eschar in the wound contributed most to any LEA event.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions:<\/jats:title>\n                    <jats:p>Machine learning algorithms performed well in predicting the risk of LEA in a patient with DFU. Explainability can help provide clinical insights and identify at-risk patients for early intervention.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/19322968241228606","type":"journal-article","created":{"date-parts":[[2024,1,30]],"date-time":"2024-01-30T05:53:29Z","timestamp":1706594009000},"page":"1008-1022","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":24,"title":["Risk Prediction of Diabetic Foot Amputation Using Machine Learning and Explainable Artificial Intelligence"],"prefix":"10.1177","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-3416-8562","authenticated-orcid":false,"given":"Chien Wei","family":"Oei","sequence":"first","affiliation":[{"name":"Management Information Department, Office of Clinical Epidemiology, Analytics and Knowledge, Tan Tock Seng Hospital, Singapore"},{"name":"Department of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yam Meng","family":"Chan","sequence":"additional","affiliation":[{"name":"Department of General Surgery, Vascular Surgery Service, Tan Tock Seng Hospital, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaojin","family":"Zhang","sequence":"additional","affiliation":[{"name":"Management Information Department, Office of Clinical Epidemiology, Analytics and Knowledge, Tan Tock Seng Hospital, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kee Hao","family":"Leo","sequence":"additional","affiliation":[{"name":"Management Information Department, Office of Clinical Epidemiology, Analytics and Knowledge, Tan Tock Seng Hospital, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Enming","family":"Yong","sequence":"additional","affiliation":[{"name":"Department of General Surgery, Vascular Surgery Service, Tan Tock Seng Hospital, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rhan Chaen","family":"Chong","sequence":"additional","affiliation":[{"name":"Department of General Surgery, Vascular Surgery Service, Tan Tock Seng Hospital, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qiantai","family":"Hong","sequence":"additional","affiliation":[{"name":"Department of General Surgery, Vascular Surgery Service, Tan Tock Seng Hospital, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Li","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of General Surgery, Vascular Surgery Service, Tan Tock Seng Hospital, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ying","family":"Pan","sequence":"additional","affiliation":[{"name":"Department of General Surgery, Vascular Surgery Service, Tan Tock Seng Hospital, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Glenn Wei Leong","family":"Tan","sequence":"additional","affiliation":[{"name":"Department of General Surgery, Vascular Surgery Service, Tan Tock Seng Hospital, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Malcolm Han Wen","family":"Mak","sequence":"additional","affiliation":[{"name":"Department of General Surgery, Vascular Surgery Service, Tan Tock Seng Hospital, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2024,1,30]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1111\/iwj.13540."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvs.2015.10.003."},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejvs.2021.09.041."},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1177\/2473011418788864."},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.3402\/dfa.v5.24445."},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1177\/15347346221097283."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1111\/nyas.13569."},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcdr.2012.10.002."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.7547\/87507315-92-8-425."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1177\/193229681100500636."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.2147\/DMSO.S254586."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.2337\/diacare.27.7.1774."},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.3349\/ymj.2014.55.5.1373."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-020-01195-x."},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.2147\/DMSO.S307815."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1002\/hec.852."},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.imu.2022.101103."},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2019.18962."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2022.3172956."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-022-08748-y."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCONS.2017.8250771."},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1177\/19322968221124583."},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.sjbs.2019.12.020."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0278445."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1111\/iwj.13691."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1177\/19322968221142899."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAI.2023.3266418."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1097\/01.mlr.0000182534.19832.83."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.2307\/2333709."},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.4103\/aca.ACA_94_19."},{"key":"e_1_3_2_32_2","doi-asserted-by":"crossref","unstructured":"Mann HB Whitney DR. On a test of whether one of two random variables is stochastically larger than the other. Ann Math Stat. 1947;18:50-60. https:\/\/www.jstor.org\/stable\/2236101. Accessed June 22 2023.","DOI":"10.1214\/aoms\/1177730491"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1080\/14786440009463897."},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12874-017-0442-1."},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1996.tb02080.x"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994018."},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-30164-8_204."},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324."},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00058655."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1214\/07-STS242."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1013203451"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785."},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1006\/jcss.1997.1504."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1810.11363."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1405.7430."},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1206.2944."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(96)00142-2."},{"key":"e_1_3_2_48_2","doi-asserted-by":"crossref","unstructured":"Chinchor N. MUC-4 evaluation metrics. Proceedings of the Fourth Message Understanding Conference (MUC-4); June 16-18 1992; McLean VA. https:\/\/aclanthology.org\/M92-1002. Accessed June 22 2023.","DOI":"10.3115\/1072064.1072067"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2010.764."},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1705.07874."},{"key":"e_1_3_2_51_2","unstructured":"McKinney W. pandas: a foundational python library for data analysis and statistics. Python High Performance Science Computer 2011. https:\/\/dlr.de\/sc\/portaldata\/15\/resources\/dokumente\/pyhpc2011\/submissions\/pyhpc2011_submission_9.pdf"},{"key":"e_1_3_2_52_2","doi-asserted-by":"crossref","unstructured":"Harris CR Millman KJ van der Walt SJ et al Array programming with NumPy. Nature. 2020;585:357-362. https:\/\/www.nature.com\/articles\/s41586-020-2649-2. Accessed June 20 2023.","DOI":"10.1038\/s41586-020-2649-2"},{"key":"e_1_3_2_53_2","unstructured":"Virtanen P Gommers R Oliphant TE et al SciPy 1.0: fundamental algorithms for scientific computing in Python. Nat Method. 2020;17:261-272. https:\/\/www.nature.com\/articles\/s41592-019-0686-2. Accessed June 20 2023."},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.25080\/Majora-92bf1922-011."},{"issue":"85","key":"e_1_3_2_55_2","first-page":"2825","article-title":"Scikit-learn: machine learning in python","volume":"12","author":"Pedregosa F","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, et al Scikit-learn: machine learning in python. J Mach Learn Res. 2011;12(85):2825-2830.","journal-title":"J Mach Learn Res"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","unstructured":"Droettboom M Hunter J Firing E et al Matplotlib version 1.4.0. Zenodo 2014. doi:10.5281\/zenodo.11451.","DOI":"10.5281\/zenodo.11451."},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1111\/iwj.13723."},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.3390\/medicina56090455."},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00125-017-4488-8."},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0226226."},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1302\/2058-5241.3.180010."},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1055\/s-2007-996108."},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12933-018-0781-1."},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1089\/wound.2019.1091."},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-017-02904-9."},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00125-011-2331-1."},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1177\/2047487319836854."},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.4239\/wjd.v13.i11.940."},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1016\/s1470-2045(19)30149-4."},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbab569."}],"container-title":["Journal of Diabetes Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/19322968241228606","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/19322968241228606","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/19322968241228606","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T18:16:49Z","timestamp":1777400209000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/19322968241228606"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,30]]},"references-count":69,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,7]]}},"alternative-id":["10.1177\/19322968241228606"],"URL":"https:\/\/doi.org\/10.1177\/19322968241228606","relation":{},"ISSN":["1932-2968","1932-2968"],"issn-type":[{"value":"1932-2968","type":"print"},{"value":"1932-2968","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,30]]}}}