{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,26]],"date-time":"2026-09-26T06:27:41Z","timestamp":1790404061280,"version":"4.1.0"},"reference-count":38,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2021,1,14]],"date-time":"2021-01-14T00:00:00Z","timestamp":1610582400000},"content-version":"vor","delay-in-days":713,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"},{"start":{"date-parts":[[2018,10,11]],"date-time":"2018-10-11T00:00:00Z","timestamp":1539216000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"},{"start":{"date-parts":[[2019,2,1]],"date-time":"2019-02-01T00:00:00Z","timestamp":1548979200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,2,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Background<\/jats:title>\n                  <jats:p>Patients with melanoma and negative sentinel nodes (SNs) have varying outcomes, dependent on several prognostic factors. Considering all these factors in a prediction model might aid in identifying patients who could benefit from a personalized treatment strategy. The objective was to construct and validate a nomogram for recurrence and melanoma-specific mortality (MSM) in patients with melanoma and negative SNs.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>A total of 3220 patients with negative SNs were identified from a cohort of 4124 patients from four EORTC Melanoma Group centres who underwent sentinel lymph node biopsy. Prognostic factors for recurrence and MSM were studied with Cox regression analysis. Significant factors were incorporated in the models. Performance was assessed by discrimination (c-index) and calibration in cross-validation across the four centres. A nomogram was developed for graphical presentation.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>There were 3180 eligible patients. The final prediction model for recurrence and the calibrated model for MSM included three independent prognostic factors: ulceration, anatomical location and Breslow thickness. The c-index was 0\u00b774 for recurrence and 0\u00b776 for the calibrated MSM model. Cross-validation across the four centres showed reasonable model performance. A nomogram was developed based on these models. One-third of the patients had a 5-year recurrence probability of 8\u00b72 per cent or less, and one-third had a recurrence probability of 23\u00b70 per cent or more.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>A nomogram for predicting recurrence and MSM in patients with melanoma and negative SNs was constructed and validated. It could provide personalized estimates useful for tailoring surveillance strategies (reduce or increase intensity), and selection of patients for adjuvant therapy or clinical trials.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1002\/bjs.10995","type":"journal-article","created":{"date-parts":[[2018,10,11]],"date-time":"2018-10-11T10:47:31Z","timestamp":1539254851000},"page":"217-225","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":35,"title":["Development and validation of a nomogram to predict recurrence and melanoma-specific mortality in patients with negative sentinel lymph nodes"],"prefix":"10.1093","volume":"106","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0034-3575","authenticated-orcid":false,"given":"D","family":"Verver","sequence":"first","affiliation":[{"name":"Department of Surgical Oncology, Erasmus MC Cancer Institute, University Medical Centre , Rotterdam,","place":["the Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"D","family":"van Klaveren","sequence":"additional","affiliation":[{"name":"Medical Statistics, Department of Biomedical Data Sciences, Leiden University Medical Centre , Leiden,","place":["the Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"V","family":"Franke","sequence":"additional","affiliation":[{"name":"Department of Surgical Oncology, Netherlands Cancer Institute \u2013 Antoni van Leeuwenhoek , Amsterdam,","place":["the Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"A C J","family":"van Akkooi","sequence":"additional","affiliation":[{"name":"Department of Surgical Oncology, Netherlands Cancer Institute \u2013 Antoni van Leeuwenhoek , Amsterdam,","place":["the Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"P","family":"Rutkowski","sequence":"additional","affiliation":[{"name":"Department of Soft Tissue\/Bone Sarcoma and Melanoma, Maria Sklodowska\u2013Curie Institute Cancer Centre , Warsaw,","place":["Poland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"U","family":"Keilholz","sequence":"additional","affiliation":[{"name":"Charit\u00e9 Comprehensive Cancer Centre, University of Medicine Berlin , Berlin,","place":["Germany"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"A M M","family":"Eggermont","sequence":"additional","affiliation":[{"name":"Department of Surgical Oncology, Gustave Roussy Cancer Campus , Villejuif,","place":["France"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"T","family":"Nijsten","sequence":"additional","affiliation":[{"name":"Department of Dermatology, Erasmus MC University Medical Centre , Rotterdam,","place":["the Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"D J","family":"Gr\u00fcnhagen","sequence":"additional","affiliation":[{"name":"Department of Surgical Oncology, Erasmus MC Cancer Institute, University Medical Centre , Rotterdam,","place":["the Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"C","family":"Verhoef","sequence":"additional","affiliation":[{"name":"Department of Surgical Oncology, Erasmus MC Cancer Institute, University Medical Centre , Rotterdam,","place":["the Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2019,2,1]]},"reference":[{"key":"2024092914052981200_bjs10995-bib-0001","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1001\/archsurg.1992.01420040034005","article-title":"Technical details of intraoperative lymphatic mapping for early stage melanoma","volume":"127","author":"Morton","year":"1992","journal-title":"Arch Surg"},{"key":"2024092914052981200_bjs10995-bib-0002","doi-asserted-by":"crossref","first-page":"3622","DOI":"10.1200\/JCO.2001.19.16.3622","article-title":"Prognostic factors analysis of 17 600 melanoma patients: validation of the American Joint Committee on Cancer melanoma staging system","volume":"19","author":"Balch","year":"2001","journal-title":"J Clin Oncol"},{"key":"2024092914052981200_bjs10995-bib-0003","doi-asserted-by":"crossref","first-page":"599","DOI":"10.1056\/NEJMoa1310460","article-title":"Final trial report of sentinel-node biopsy versus nodal observation in melanoma","volume":"370","author":"Morton","year":"2014","journal-title":"N Engl J Med"},{"key":"2024092914052981200_bjs10995-bib-0004","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1016\/S1470-2045(16)00141-8","article-title":"Complete lymph node dissection versus no dissection in patients with sentinel lymph node biopsy positive melanoma (DeCOG-SLT): a multicentre, randomised, phase 3 trial","volume":"17","author":"Leiter","year":"2016","journal-title":"Lancet Oncol"},{"key":"2024092914052981200_bjs10995-bib-0005","doi-asserted-by":"crossref","first-page":"2211","DOI":"10.1056\/NEJMoa1613210","article-title":"Completion dissection or observation for sentinel-node metastasis in melanoma","volume":"376","author":"Faries","year":"2017","journal-title":"N Engl J Med"},{"key":"2024092914052981200_bjs10995-bib-0006","doi-asserted-by":"crossref","first-page":"1789","DOI":"10.1056\/NEJMoa1802357","article-title":"Adjuvant pembrolizumab versus placebo in resected stage III melanoma","volume":"378","author":"Eggermont","year":"2018","journal-title":"N Engl J Med"},{"key":"2024092914052981200_bjs10995-bib-0007","doi-asserted-by":"crossref","first-page":"1845","DOI":"10.1056\/NEJMoa1611299","article-title":"Prolonged survival in stage III melanoma with ipilimumab adjuvant therapy","volume":"375","author":"Eggermont","year":"2016","journal-title":"N Engl J Med"},{"key":"2024092914052981200_bjs10995-bib-0008","doi-asserted-by":"crossref","first-page":"1813","DOI":"10.1056\/NEJMoa1708539","article-title":"Adjuvant dabrafenib plus trametinib in stage III BRAF-mutated melanoma","volume":"377","author":"Long","year":"2017","journal-title":"N Engl J Med"},{"key":"2024092914052981200_bjs10995-bib-0009","doi-asserted-by":"crossref","first-page":"1824","DOI":"10.1056\/NEJMoa1709030","article-title":"Adjuvant nivolumab versus ipilimumab in resected stage III or IV melanoma","volume":"377","author":"Weber","year":"2017","journal-title":"N Engl J Med"},{"key":"2024092914052981200_bjs10995-bib-0010","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1177\/1203475417720201","article-title":"Metastatic melanoma in sentinel node-negative patients: the Ottawa experience","volume":"22","author":"Ward","year":"2018","journal-title":"J Cutan Med Surg"},{"key":"2024092914052981200_bjs10995-bib-0011","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1245\/s10434-016-5566-8","article-title":"Nodular histologic subtype and ulceration are tumor factors associated with high risk of recurrence in sentinel node-negative melanoma patients","volume":"24","author":"Faut","year":"2017","journal-title":"Ann Surg Oncol"},{"key":"2024092914052981200_bjs10995-bib-0012","doi-asserted-by":"crossref","first-page":"472","DOI":"10.3322\/caac.21409","article-title":"Melanoma staging: evidence-based changes in the American Joint Committee on Cancer eighth edition cancer staging manual","volume":"67","author":"Gershenwald","year":"2017","journal-title":"CA Cancer J Clin"},{"key":"2024092914052981200_bjs10995-bib-0013","doi-asserted-by":"crossref","first-page":"1412","DOI":"10.1016\/j.surg.2015.12.002","article-title":"Prognostic factors in melanoma patients with tumor-negative sentinel lymph nodes","volume":"159","author":"Egger","year":"2016","journal-title":"Surgery"},{"key":"2024092914052981200_bjs10995-bib-0014","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1016\/j.ejca.2016.08.014","article-title":"Effects of time interval between primary melanoma excision and sentinel node biopsy on positivity rate and survival","volume":"67","author":"Oude Ophuis","year":"2016","journal-title":"Eur J Cancer"},{"key":"2024092914052981200_bjs10995-bib-0015","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/j.ejca.2016.05.005","article-title":"Diagnosis and treatment of melanoma. European consensus-based interdisciplinary guideline \u2013 update 2016","volume":"63","author":"Garbe","year":"2016","journal-title":"Eur J Cancer"},{"key":"2024092914052981200_bjs10995-bib-0016","doi-asserted-by":"crossref","first-page":"3635","DOI":"10.1200\/JCO.2001.19.16.3635","article-title":"Final version of the American Joint Committee on Cancer staging system for cutaneous melanoma","volume":"19","author":"Balch","year":"2001","journal-title":"J Clin Oncol"},{"key":"2024092914052981200_bjs10995-bib-0017","doi-asserted-by":"crossref","first-page":"6199","DOI":"10.1200\/JCO.2009.23.4799","article-title":"Final version of 2009 AJCC melanoma staging and classification","volume":"27","author":"Balch","year":"2009","journal-title":"J Clin Oncol"},{"key":"2024092914052981200_bjs10995-bib-0018","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1002\/path.1365","article-title":"The development of optimal pathological assessment of sentinel lymph nodes for melanoma","volume":"200","author":"Cook","year":"2003","journal-title":"J Pathol"},{"key":"2024092914052981200_bjs10995-bib-0019","volume-title":"NCCN Clinical Practice Guidelines in Oncology 2017","author":"National Comprehensive Cancer Network (NCCN)"},{"key":"2024092914052981200_bjs10995-bib-0020","doi-asserted-by":"crossref","first-page":"370","DOI":"10.3322\/caac.21339","article-title":"American Joint Committee on Cancer acceptance criteria for inclusion of risk models for individualized prognosis in the practice of precision medicine","volume":"66","author":"Kattan","year":"2016","journal-title":"CA Cancer J Clin"},{"key":"2024092914052981200_bjs10995-bib-0021","first-page":"1","article-title":"MICE: multivariate imputation by chained equations in R","volume":"45","author":"van Buuren","year":"2011","journal-title":"J Stat Softw"},{"key":"2024092914052981200_bjs10995-bib-0022","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-77244-8","volume-title":"Clinical Prediction Models: a Practical Approach to Development, Valisation, and Updating","author":"Steyerberg","year":"2009"},{"key":"2024092914052981200_bjs10995-bib-0023","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1002\/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4","article-title":"Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors","volume":"15","author":"Harrell","year":"1996","journal-title":"Stat Med"},{"key":"2024092914052981200_bjs10995-bib-0024","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.jclinepi.2015.04.005","article-title":"Prediction models need appropriate internal, internal\u2013external, and external validation","volume":"69","author":"Steyerberg","year":"2016","journal-title":"J Clin Epidemiol"},{"key":"2024092914052981200_bjs10995-bib-0025","doi-asserted-by":"crossref","first-page":"2753","DOI":"10.1245\/s10434-016-5212-5","article-title":"Critical assessment of clinical prognostic tools in melanoma","volume":"23","author":"Mahar","year":"2016","journal-title":"Ann Surg Oncol"},{"key":"2024092914052981200_bjs10995-bib-0026","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1186\/s12885-016-2438-3","article-title":"Melanoma-specific mortality and competing mortality in patients with non-metastatic malignant melanoma: a population-based analysis","volume":"16","author":"Shen","year":"2016","journal-title":"BMC Cancer"},{"key":"2024092914052981200_bjs10995-bib-0027","author":"Dutch Working Group on Melanoma","year":"2013","journal-title":"Melanoma Guideline 2012"},{"key":"2024092914052981200_bjs10995-bib-0028","doi-asserted-by":"crossref","first-page":"1401","DOI":"10.1002\/bjs.6347","article-title":"Follow-up schedules after treatment for malignant melanoma","volume":"95","author":"Francken","year":"2008","journal-title":"Br J Surg"},{"key":"2024092914052981200_bjs10995-bib-0029","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1245\/s10434-016-5642-0","article-title":"Patterns and timing of initial relapse in pathologic stage II melanoma patients","volume":"24","author":"Lee","year":"2017","journal-title":"Ann Surg Oncol"},{"key":"2024092914052981200_bjs10995-bib-0030","doi-asserted-by":"crossref","first-page":"2762","DOI":"10.1245\/s10434-016-5263-7","article-title":"The MELFO-study: prospective, randomized, clinical trial for the evaluation of a stage-adjusted reduced follow-up schedule in cutaneous melanoma patients \u2013 results after 1 year","volume":"23","author":"Damude","year":"2016","journal-title":"Ann Surg Oncol"},{"key":"2024092914052981200_bjs10995-bib-0031","doi-asserted-by":"crossref","first-page":"3042","DOI":"10.1200\/JCO.2009.26.2063","article-title":"Site and timing of first relapse in stage III melanoma patients: implications for follow-up guidelines","volume":"28","author":"Romano","year":"2010","journal-title":"J Clin Oncol"},{"key":"2024092914052981200_bjs10995-bib-0032","doi-asserted-by":"crossref","first-page":"2199","DOI":"10.1200\/JCO.2010.31.5812","article-title":"Prognostic significance of mitotic rate in localized primary cutaneous melanoma: an analysis of patients in the multi-institutional American Joint Committee on Cancer melanoma staging database","volume":"29","author":"Thompson","year":"2011","journal-title":"J Clin Oncol"},{"key":"2024092914052981200_bjs10995-bib-0033","doi-asserted-by":"crossref","first-page":"1364","DOI":"10.1200\/JCO.2007.12.9791","article-title":"How to build and interpret a nomogram for cancer prognosis","volume":"26","author":"Iasonos","year":"2008","journal-title":"J Clin Oncol"},{"key":"2024092914052981200_bjs10995-bib-0034","doi-asserted-by":"crossref","first-page":"2006","DOI":"10.1245\/s10434-010-1050-z","article-title":"Predicting survival outcome of localized melanoma: an electronic prediction tool based on the AJCC melanoma database","volume":"17","author":"Soong","year":"2010","journal-title":"Ann Surg Oncol"},{"key":"2024092914052981200_bjs10995-bib-0035","doi-asserted-by":"crossref","first-page":"2172","DOI":"10.1245\/s10434-018-6370-4","article-title":"Variability in predictions from online tools: a demonstration using internet-based melanoma predictors","volume":"25","author":"Zabor","year":"2018","journal-title":"Ann Surg Oncol"},{"key":"2024092914052981200_bjs10995-bib-0036","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1016\/j.jamcollsurg.2011.12.027","article-title":"A novel and accurate computer model of melanoma prognosis for patients staged by sentinel lymph node biopsy: comparison with the American Joint Committee on Cancer model","volume":"214","author":"Callender","year":"2012","journal-title":"J Am Coll Surg"},{"key":"2024092914052981200_bjs10995-bib-0037","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1111\/bjd.15552","article-title":"Prognostic role of histologic regression in primary cutaneous melanoma: a systematic review and meta-analysis","volume":"178","author":"Gualano","year":"2018","journal-title":"Br J Dermatol"},{"key":"2024092914052981200_bjs10995-bib-0038","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1007\/978-1-62703-727-3_15","article-title":"Lymphatic invasion as a prognostic biomarker in primary cutaneous melanoma","volume":"1102","author":"Xu","year":"2014","journal-title":"Methods Mol Biol"}],"container-title":["Journal of British Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fbjs.10995","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/bjs.10995","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/bjs.10995","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/bjs\/article-pdf\/106\/3\/217\/59431900\/bjs10995.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bjs\/article-pdf\/106\/3\/217\/59431900\/bjs10995.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,29]],"date-time":"2024-09-29T14:05:48Z","timestamp":1727618748000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bjs\/article\/106\/3\/217\/6092775"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,1]]},"references-count":38,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,2,1]]},"published-print":{"date-parts":[[2019,2,6]]}},"URL":"https:\/\/doi.org\/10.1002\/bjs.10995","relation":{},"ISSN":["0007-1323","1365-2168"],"issn-type":[{"value":"0007-1323","type":"print"},{"value":"1365-2168","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,2]]},"published":{"date-parts":[[2019,2,1]]},"assertion":[{"value":"2018-04-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-08-08","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-10-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}