{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,9]],"date-time":"2026-11-09T17:08:38Z","timestamp":1794244118008,"version":"4.9.0"},"reference-count":51,"publisher":"BMJ","issue":"1","license":[{"start":{"date-parts":[[2021,7,22]],"date-time":"2021-07-22T00:00:00Z","timestamp":1626912000000},"content-version":"unspecified","delay-in-days":21,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001826","name":"ZonMw","doi-asserted-by":"publisher","award":["837002508"],"award-info":[{"award-number":["837002508"]}],"id":[{"id":"10.13039\/501100001826","id-type":"DOI","asserted-by":"publisher"}]},{"name":"ProVoet","award":["N\/A"],"award-info":[{"award-number":["N\/A"]}]},{"name":"NVvP","award":["N\/A"],"award-info":[{"award-number":["N\/A"]}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Open Diab Res Care"],"published-print":{"date-parts":[[2021,7]]},"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>We aimed to develop a prediction model for foot ulcer recurrence in people with diabetes using easy-to-obtain clinical variables and to validate its predictive performance in order to help risk assessment in this high-risk group.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Research design and methods<\/jats:title>\n                    <jats:p>We used data from a prospective analysis of 304 people with foot ulcer history who had 18-month follow-up for ulcer outcome. Demographic, disease-related and organization-of-care variables were included as potential predictors. Two logistic regression prediction models were created: model 1 for all recurrent foot ulcers (n=126 events) and model 2 for recurrent plantar foot ulcers (n=70 events). We used 10-fold cross-validation, each including five multiple imputation sets for internal validation. Performance was assessed in terms of discrimination using area under the receiver operating characteristic curve (AUC) (0\u20131, 1=perfect discrimination), and calibration with the Brier Score (0\u20131, 0=complete concordance predicted vs observed values) and calibration graphs.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Predictors in model 1 were: a younger age, more severe peripheral sensory neuropathy, fewer months since healing of previous ulcer, presence of a minor lesion, use of a walking aid and not monitoring foot temperatures at home. Mean AUC for model 1 was 0.69 (2SD 0.040) and mean Brier Score was 0.22 (2SD 0.011). Predictors in model 2 were: a younger age, plantar location of previous ulcer, fewer months since healing of previous ulcer, presence of a minor lesion, consumption of alcohol, use of a walking aid, and foot care received in a university medical center. Mean AUC for model 2 was 0.66 (2SD 0.023) and mean Brier Score was 0.16 (2SD 0.0048).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>These internally validated prediction models predict with reasonable to good calibration and fair discrimination who is at highest risk of ulcer recurrence. The people at highest risk should be monitored more carefully and treated more intensively than others.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Trial registration number<\/jats:title>\n                    <jats:p>NTR5403.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1136\/bmjdrc-2021-002257","type":"journal-article","created":{"date-parts":[[2021,7,23]],"date-time":"2021-07-23T13:35:06Z","timestamp":1627047306000},"page":"e002257","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":19,"title":["Development of a prediction model for foot ulcer recurrence in people with diabetes using easy-to-obtain clinical variables"],"prefix":"10.1136","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4834-1691","authenticated-orcid":false,"given":"Wouter B","family":"aan de Stegge","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martijn C","family":"Schut","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ameen","family":"Abu-Hanna","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeff G","family":"van Baal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6420-6046","authenticated-orcid":false,"given":"Jaap J","family":"van Netten","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8357-9163","authenticated-orcid":false,"given":"Sicco A","family":"Bus","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2021,7,23]]},"reference":[{"key":"2021072310302884000_9.1.e002257.1","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(05)67698-2"},{"key":"2021072310302884000_9.1.e002257.2","doi-asserted-by":"publisher","DOI":"10.1007\/s00125-010-1821-x"},{"key":"2021072310302884000_9.1.e002257.3","doi-asserted-by":"publisher","DOI":"10.1111\/dme.13973"},{"key":"2021072310302884000_9.1.e002257.4","doi-asserted-by":"publisher","DOI":"10.1093\/qjmed\/hcq227"},{"key":"2021072310302884000_9.1.e002257.5","doi-asserted-by":"publisher","DOI":"10.2337\/dc19-1614"},{"key":"2021072310302884000_9.1.e002257.6","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMra1615439"},{"key":"2021072310302884000_9.1.e002257.7","doi-asserted-by":"publisher","DOI":"10.1007\/s00125-006-0491-1"},{"key":"2021072310302884000_9.1.e002257.8","unstructured":"National Institute for Health and Care Excellence (NICE) . NG19 diabetic foot problems: prevention and management. London: National Institute for Health and Care Excellence: Clinical Guidelines, 2015."},{"key":"2021072310302884000_9.1.e002257.9","doi-asserted-by":"publisher","DOI":"10.2337\/dc20-S011"},{"key":"2021072310302884000_9.1.e002257.10","article-title":"Practical guidelines on the prevention and management of diabetic foot disease (IWGDF 2019 update)","volume":"36 Suppl 1","author":"Schaper","year":"2020","journal-title":"Diabetes Metab Res Rev"},{"key":"2021072310302884000_9.1.e002257.11","doi-asserted-by":"publisher","DOI":"10.1007\/s00125-010-2030-3"},{"key":"2021072310302884000_9.1.e002257.12","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.diabres.2017.02.034","article-title":"Diabetic foot ulcer development risk classifications' validation: a multicentre prospective cohort study","volume":"127","author":"Monteiro-Soares","year":"2017","journal-title":"Diabetes Res Clin Pract"},{"key":"2021072310302884000_9.1.e002257.13","article-title":"Guidelines on the prevention of foot ulcers in persons with diabetes (IWGDF 2019 update)","volume":"36 Suppl 1","author":"Bus","year":"2020","journal-title":"Diabetes Metab Res Rev"},{"key":"2021072310302884000_9.1.e002257.14","doi-asserted-by":"publisher","DOI":"10.2337\/dc07-0445"},{"key":"2021072310302884000_9.1.e002257.15","doi-asserted-by":"publisher","DOI":"10.2337\/dc13-2470"},{"key":"2021072310302884000_9.1.e002257.16","doi-asserted-by":"publisher","DOI":"10.3310\/hta19880"},{"key":"2021072310302884000_9.1.e002257.17","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1002\/dmrr.2738","article-title":"A shift in priority in diabetic foot care and research: 75% of foot ulcers are preventable","volume":"32 Suppl 1","author":"Bus","year":"2016","journal-title":"Diabetes Metab Res Rev"},{"key":"2021072310302884000_9.1.e002257.18","doi-asserted-by":"crossref","unstructured":"Van Netten JJ , Woodburn J , Bus SA . The future for diabetic foot ulcer prevention: a paradigm shift from stratified healthcare towards personalized medicine. Diabetes Metab Res Rev 2019;36:e3234.","DOI":"10.1002\/dmrr.3234"},{"key":"2021072310302884000_9.1.e002257.19","doi-asserted-by":"crossref","first-page":"S23","DOI":"10.1002\/dmrr.446","article-title":"Repetitive ulceration in neuropathic patients","volume":"20 Suppl 1","author":"Connor","year":"2004","journal-title":"Diabetes Metab Res Rev"},{"key":"2021072310302884000_9.1.e002257.20","doi-asserted-by":"publisher","DOI":"10.7547\/0980130"},{"key":"2021072310302884000_9.1.e002257.21","doi-asserted-by":"publisher","DOI":"10.1111\/j.1742-481X.2012.01022.x"},{"key":"2021072310302884000_9.1.e002257.22","first-page":"b375","article-title":"Prognosis and prognostic research: what, why, and how?","volume":"388","author":"Moons","year":"2008","journal-title":"BMJ"},{"key":"2021072310302884000_9.1.e002257.23","doi-asserted-by":"crossref","first-page":"1480","DOI":"10.1111\/dme.13797","article-title":"The development and validation of a multivariable prognostic model to predict foot ulceration in diabetes using a systematic review and individual patient data meta-analyses","volume":"35","author":"Crawford","year":"2018","journal-title":"Diabet Med"},{"key":"2021072310302884000_9.1.e002257.24","doi-asserted-by":"publisher","DOI":"10.1136\/bmjdrc-2020-001207"},{"key":"2021072310302884000_9.1.e002257.25","doi-asserted-by":"crossref","DOI":"10.1186\/s13063-018-2890-2","article-title":"The cost-effectiveness and cost-utility of at-home infrared temperature monitoring in reducing the incidence of foot ulcer recurrence in patients with diabetes (DIATEMP): study protocol for a randomized controlled trial","volume":"19","author":"Aan de Stegge","year":"2018","journal-title":"Trials"},{"key":"2021072310302884000_9.1.e002257.26","doi-asserted-by":"publisher","DOI":"10.2337\/dc11-0844"},{"key":"2021072310302884000_9.1.e002257.27","doi-asserted-by":"crossref","unstructured":"Van Netten JJ , Bus SA , Apelqvist J . Definitions and criteria for diabetic foot disease. Diabetes Metab Res Rev 2019;36:e3286.","DOI":"10.1002\/dmrr.3268"},{"key":"2021072310302884000_9.1.e002257.28","doi-asserted-by":"crossref","first-page":"S90","DOI":"10.1002\/dmrr.464","article-title":"Diabetic foot ulcer classification system for research purposes: a progress report on criteria for including patients in research studies","volume":"20 Suppl 1","author":"Schaper","year":"2004","journal-title":"Diabetes Metab Res Rev"},{"key":"2021072310302884000_9.1.e002257.29","doi-asserted-by":"publisher","DOI":"10.2337\/dc13-0996"},{"key":"2021072310302884000_9.1.e002257.30","doi-asserted-by":"publisher","DOI":"10.1002\/hec.4730020305"},{"key":"2021072310302884000_9.1.e002257.31","doi-asserted-by":"publisher","DOI":"10.3109\/07853890109002087"},{"key":"2021072310302884000_9.1.e002257.32"},{"key":"2021072310302884000_9.1.e002257.33","doi-asserted-by":"publisher","DOI":"10.1002\/bjs.9736"},{"key":"2021072310302884000_9.1.e002257.34","unstructured":"Akaike H . Information theory as an extension of the maximum likelihood principle. In: Petrov BN , Csaki F , eds. Second International Sympposium on information theory. Budapest: Akademiai Kiado, 1973: 267\u201381."},{"key":"2021072310302884000_9.1.e002257.35","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4"},{"key":"2021072310302884000_9.1.e002257.36","doi-asserted-by":"publisher","DOI":"10.1148\/radiology.143.1.7063747"},{"key":"2021072310302884000_9.1.e002257.37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1175\/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2","article-title":"Verification of forecasts expressed in terms of probability","volume":"78","author":"Brier","year":"1950","journal-title":"Mon Weather Rev"},{"key":"2021072310302884000_9.1.e002257.38","unstructured":"R-Core-Team . A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing, 2019. https:\/\/www.r-project.org\/"},{"key":"2021072310302884000_9.1.e002257.39","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjmed.2007.06.028"},{"key":"2021072310302884000_9.1.e002257.40","doi-asserted-by":"publisher","DOI":"10.1002\/dmrr.2319"},{"key":"2021072310302884000_9.1.e002257.41","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.jss.2019.09.025","article-title":"Incidence and risk factors associated with ulcer recurrence among patients with diabetic foot ulcers treated in a multidisciplinary setting","volume":"246","author":"Hicks","year":"2020","journal-title":"J Surg Res"},{"key":"2021072310302884000_9.1.e002257.42","article-title":"Guidelines on offloading foot ulcers in persons with diabetes (IWGDF 2019 update)","volume":"36 Suppl 1","author":"Bus","year":"2020","journal-title":"Diabetes Metab Res Rev"},{"key":"2021072310302884000_9.1.e002257.43","doi-asserted-by":"publisher","DOI":"10.2337\/diacare.17.6.557"},{"key":"2021072310302884000_9.1.e002257.44","doi-asserted-by":"publisher","DOI":"10.2337\/diacare.21.7.1071"},{"key":"2021072310302884000_9.1.e002257.45","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1002\/mus.26628","article-title":"Development of grading scales of pedal sensory loss using Mokken scale analysis on the Rotterdam diabetic foot study test battery data","volume":"60","author":"Rinkel","year":"2019","journal-title":"Muscle Nerve"},{"key":"2021072310302884000_9.1.e002257.46","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1002\/mus.26192","article-title":"Grading the loss of sensation in diabetic patients: a psychometric evaluation of the Rotterdam diabetic foot study test battery","volume":"58","author":"Rinkel","year":"2018","journal-title":"Muscle Nerve"},{"key":"2021072310302884000_9.1.e002257.47","doi-asserted-by":"crossref","first-page":"1266","DOI":"10.1111\/dme.14323","article-title":"Meta-Analyses of randomized controlled trials reporting the effect of home foot temperature monitoring, patient education or offloading footwear on the incidence of diabetes-related foot ulcers","volume":"37","author":"Alahakoon","year":"2020","journal-title":"Diabet Med"},{"key":"2021072310302884000_9.1.e002257.48","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1007\/s00125-019-05020-7","article-title":"Preventing foot ulceration in diabetes: systematic review and meta-analyses of RCT data","volume":"63","author":"Crawford","year":"2020","journal-title":"Diabetologia"},{"key":"2021072310302884000_9.1.e002257.49","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(14)60613-9"},{"key":"2021072310302884000_9.1.e002257.50","doi-asserted-by":"publisher","DOI":"10.2337\/diacare.27.8.1980"},{"key":"2021072310302884000_9.1.e002257.51","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1007\/s00125-019-05056-9","article-title":"Geospatial mapping and data linkage uncovers variability in outcomes of foot disease according to multiple deprivation: a population cohort study of people with diabetes","volume":"63","author":"Hurst","year":"2020","journal-title":"Diabetologia"}],"container-title":["BMJ Open Diabetes Research &amp; Care"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjdrc-2021-002257","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,23]],"date-time":"2021-07-23T13:35:30Z","timestamp":1627047330000},"score":1,"resource":{"primary":{"URL":"https:\/\/drc.bmj.com\/lookup\/doi\/10.1136\/bmjdrc-2021-002257"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7]]},"references-count":51,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,7,23]]},"published-print":{"date-parts":[[2021,7]]}},"alternative-id":["10.1136\/bmjdrc-2021-002257"],"URL":"https:\/\/doi.org\/10.1136\/bmjdrc-2021-002257","relation":{},"ISSN":["2052-4897"],"issn-type":[{"value":"2052-4897","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7]]}}}