{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,16]],"date-time":"2025-06-16T08:24:32Z","timestamp":1750062272931,"version":"3.37.3"},"reference-count":25,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T00:00:00Z","timestamp":1717372800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T00:00:00Z","timestamp":1717372800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Br J Cancer"],"published-print":{"date-parts":[[2024,7,22]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Neuroendocrine tumours (NETs) are increasing in incidence, often diagnosed at advanced stages, and individuals may experience years of diagnostic delay, particularly when arising from the\u00a0small intestine (SI). Clinical prediction models could present novel opportunities for case finding in primary care.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>An open cohort of adults (18+ years) contributing data to the Optimum Patient Care Research Database between 1st Jan 2000 and 30th March 2023 was identified. This database collects de-identified data from general practices in the UK. Model development approaches\u00a0comprised logistic regression, penalised regression, and XGBoost. Performance (discrimination and calibration) was assessed using internal-external cross-validation. Decision analysis curves compared clinical utility.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Of 11.7 million individuals, 382 had recorded SI NET diagnoses (0.003%). The XGBoost model had the highest AUC (0.869, 95% confidence interval [CI]: 0.841\u20130.898) but was mildly miscalibrated (slope 1.165, 95% CI: 1.088\u20131.243; calibration-in-the-large 0.010, 95% CI: \u22120.164 to 0.185). Clinical utility was similar across all models.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Discussion<\/jats:title>\n                <jats:p>Multivariable prediction models may have clinical utility in identifying individuals with undiagnosed SI NETs using information in their primary care records. Further evaluation including external validation and health economics modelling may identify cost-effective strategies for case finding for this uncommon tumour.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1038\/s41416-024-02736-1","type":"journal-article","created":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T13:04:52Z","timestamp":1717419892000},"page":"305-311","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Identifying patients with undiagnosed small intestinal neuroendocrine tumours in primary care using statistical and machine learning: model development and validation study"],"prefix":"10.1038","volume":"131","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0061-979X","authenticated-orcid":false,"given":"Ash Kieran","family":"Clift","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hadley","family":"Mahon","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ghazanfar","family":"Khan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Freya","family":"Boardman-Pretty","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amanda","family":"Worker","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elena","family":"Marchini","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Orlando","family":"Buendia","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Fish","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohid S.","family":"Khan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,6,3]]},"reference":[{"key":"2736_CR1","doi-asserted-by":"publisher","first-page":"100510","DOI":"10.1016\/j.lanepe.2022.100510","volume":"23","author":"BE White","year":"2022","unstructured":"White BE, Rous B, Chandrakumaran K, Wong K, Bouvier C, Van Hemelrijck M, et al. Incidence and survival of neuroendocrine neoplasia in England 1995-2018: a retrospective, population-based study. Lancet Reg Health Eur. 2022;23:100510.","journal-title":"Lancet Reg Health Eur"},{"key":"2736_CR2","doi-asserted-by":"publisher","first-page":"444","DOI":"10.1159\/000503721","volume":"110","author":"AK Clift","year":"2020","unstructured":"Clift AK, Kidd M, Bodei L, Toumpanakis C, Baum RP, Oberg K, et al. Neuroendocrine Neoplasms of the Small Bowel and Pancreas. Neuroendocrinology. 2020;110:444\u201376.","journal-title":"Neuroendocrinology"},{"key":"2736_CR3","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1159\/000443167","volume":"103","author":"M Pavel","year":"2016","unstructured":"Pavel M, O\u2019Toole D, Costa F, Capdevila J, Gross D, Kianmanesh R, et al. ENETS Consensus Guidelines Update for the Management of Distant metastatic disease of intestinal, pancreatic, bronchial neuroendocrine neoplasms (NEN) and NEN of unknown primary site. Neuroendocrinology. 2016;103:172\u201385.","journal-title":"Neuroendocrinology"},{"key":"2736_CR4","doi-asserted-by":"publisher","DOI":"10.1007\/s11912-021-01029-7","volume":"23","author":"S Das","year":"2021","unstructured":"Das S, Dasari A. Epidemiology, Incidence, and prevalence of neuroendocrine neoplasms: are there global differences? Curr Oncol Rep. 2021;23:43.","journal-title":"Curr Oncol Rep."},{"key":"2736_CR5","doi-asserted-by":"publisher","first-page":"1335","DOI":"10.1001\/jamaoncol.2017.0589","volume":"3","author":"A Dasari","year":"2017","unstructured":"Dasari A, Shen C, Halperin D, Zhao B, Zhou S, Xu Y, et al. Trends in the incidence, prevalence, and survival outcomes in patients with neuroendocrine tumors in the united states. JAMA Oncol. 2017;3:1335\u201342.","journal-title":"JAMA Oncol"},{"key":"2736_CR6","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1159\/000488510","volume":"107","author":"R Basuroy","year":"2018","unstructured":"Basuroy R, Bouvier C, Ramage JK, Sissons M, Kent A, Srirajaskanthan R. Presenting Symptoms and delay in diagnosis of gastrointestinal and pancreatic neuroendocrine tumours. Neuroendocrinology. 2018;107:42\u20139.","journal-title":"Neuroendocrinology"},{"key":"2736_CR7","doi-asserted-by":"publisher","DOI":"10.1186\/s12885-018-5057-3","volume":"18","author":"R Basuroy","year":"2018","unstructured":"Basuroy R, Bouvier C, Ramage JK, Sissons M, Srirajaskanthan R. Delays and routes to diagnosis of neuroendocrine tumours. BMC Cancer. 2018;18:1122.","journal-title":"BMC Cancer"},{"key":"2736_CR8","doi-asserted-by":"publisher","DOI":"10.1186\/s12874-022-01577-x","volume":"22","author":"P Dhiman","year":"2022","unstructured":"Dhiman P, Ma J, Andaur Navarro CL, Speich B, Bullock G, Damen JAA, et al. Methodological conduct of prognostic prediction models developed using machine learning in oncology: a systematic review. BMC Med Res Methodol. 2022;22:101.","journal-title":"BMC Med Res Methodol"},{"key":"2736_CR9","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.jclinepi.2021.06.024","volume":"138","author":"P Dhiman","year":"2021","unstructured":"Dhiman P, Ma J, Navarro CA, Speich B, Bullock G, Damen JA, et al. Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved. J Clin Epidemiol. 2021;138:60\u201372.","journal-title":"J Clin Epidemiol"},{"key":"2736_CR10","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1016\/j.jclinepi.2023.03.024","volume":"158","author":"CL Andaur Navarro","year":"2023","unstructured":"Andaur Navarro CL, Damen JA, Takada T, Nijman SWJ, Dhiman P, Ma J, et al. Systematic review finds \u201cSpin\u201d practices and poor reporting standards in studies on machine learning-based prediction models. J Clin Epidemiol. 2023;158:99\u2013110.","journal-title":"J Clin Epidemiol"},{"key":"2736_CR11","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1016\/j.jclinepi.2023.03.012","volume":"157","author":"P Dhiman","year":"2023","unstructured":"Dhiman P, Ma J, Andaur Navarro CL, Speich B, Bullock G, Damen JA, et al. Overinterpretation of findings in machine learning prediction model studies in oncology: a systematic review. J Clin Epidemiol. 2023;157:120\u201333.","journal-title":"J Clin Epidemiol"},{"key":"2736_CR12","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1016\/j.jclinepi.2016.05.007","volume":"79","author":"PC Austin","year":"2016","unstructured":"Austin PC, van Klaveren D, Vergouwe Y, Nieboer D, Lee DS, Steyerberg EW. Geographic and temporal validity of prediction models: different approaches were useful to examine model performance. J Clin Epidemiol. 2016;79:76\u201385.","journal-title":"J Clin Epidemiol"},{"key":"2736_CR13","doi-asserted-by":"publisher","first-page":"1276","DOI":"10.1002\/sim.7992","volume":"38","author":"RD Riley","year":"2019","unstructured":"Riley RD, Snell KI, Ensor J, Burke DL, Harrell FE Jr, et al. Minimum sample size for developing a multivariable prediction model: PART II - binary and time-to-event outcomes. Stat Med. 2019;38:1276\u201396.","journal-title":"Stat Med"},{"key":"2736_CR14","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1093\/annonc\/mdv505","volume":"27","author":"E Leoncini","year":"2016","unstructured":"Leoncini E, Carioli G, La Vecchia C, Boccia S, Rindi G. Risk factors for neuroendocrine neoplasms: a systematic review and meta-analysis. Ann Oncol. 2016;27:68\u201381.","journal-title":"Ann Oncol"},{"key":"2736_CR15","doi-asserted-by":"publisher","first-page":"639","DOI":"10.1002\/sim.1310","volume":"22","author":"P Royston","year":"2003","unstructured":"Royston P, Sauerbrei W. Stability of multivariable fractional polynomial models with selection of variables and transformations: a bootstrap investigation. Stat Med. 2003;22:639\u201359.","journal-title":"Stat Med"},{"key":"2736_CR16","doi-asserted-by":"publisher","first-page":"i3140","DOI":"10.1136\/bmj.i3140","volume":"353","author":"RD Riley","year":"2016","unstructured":"Riley RD, Ensor J, Snell KI, Debray TP, Altman DG, Moons KG, et al. External validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: opportunities and challenges. BMJ. 2016;353:i3140.","journal-title":"BMJ"},{"key":"2736_CR17","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-14-25","volume":"14","author":"J IntHout","year":"2014","unstructured":"IntHout J, Ioannidis JP, Borm GF. The Hartung-Knapp-Sidik-Jonkman method for random effects meta-analysis is straightforward and considerably outperforms the standard DerSimonian-Laird method. BMC Med Res Methodol. 2014;14:25.","journal-title":"BMC Med Res Methodol"},{"key":"2736_CR18","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-7-91","volume":"7","author":"S Varma","year":"2006","unstructured":"Varma S, Simon R. Bias in error estimation when using cross-validation for model selection. BMC Bioinform. 2006;7:91.","journal-title":"BMC Bioinform"},{"key":"2736_CR19","doi-asserted-by":"publisher","first-page":"565","DOI":"10.1177\/0272989X06295361","volume":"26","author":"AJ Vickers","year":"2006","unstructured":"Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Mak. 2006;26:565\u201374.","journal-title":"Med Decis Mak"},{"key":"2736_CR20","doi-asserted-by":"publisher","first-page":"735","DOI":"10.7326\/L15-5093-2","volume":"162","author":"GS Collins","year":"2015","unstructured":"Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD). Ann Intern Med. 2015;162:735\u20136.","journal-title":"Ann Intern Med"},{"key":"2736_CR21","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1200\/JGO.2015.002980","volume":"3","author":"S Singh","year":"2017","unstructured":"Singh S, Granberg D, Wolin E, Warner R, Sissons M, Kolarova T, et al. Patient-reported burden of a neuroendocrine tumor (NET) diagnosis: results from the first global survey of patients with NETs. J Glob Oncol. 2017;3:43\u201353.","journal-title":"J Glob Oncol"},{"key":"2736_CR22","doi-asserted-by":"publisher","first-page":"639","DOI":"10.1097\/MPA.0000000000000818","volume":"46","author":"EM Wolin","year":"2017","unstructured":"Wolin EM, Leyden J, Goldstein G, Kolarova T, Hollander R, Warner RRP. Patient-reported experience of diagnosis, management, and burden of neuroendocrine tumors: results from a large patient survey in the united states. Pancreas. 2017;46:639\u201347.","journal-title":"Pancreas"},{"key":"2736_CR23","first-page":"A179","volume":"71","author":"H Gould","year":"2022","unstructured":"Gould H, Amin K, Karategos T, Abbas S, Taylor R, Cook K, et al. P286 Earlier diagnosis of neuroendocrine tumours (NETs) through transformation of the South Wales NET service. Gut. 2022;71:A179.","journal-title":"Gut"},{"key":"2736_CR24","doi-asserted-by":"publisher","first-page":"3217","DOI":"10.2217\/fon-2020-1254","volume":"17","author":"NM Zimmerman","year":"2021","unstructured":"Zimmerman NM, Ray D, Princic N, Moynihan M, Clarke C, Phan A. Exploration of machine learning techniques to examine the journey to neuroendocrine tumor diagnosis with real-world data. Future Oncol. 2021;17:3217\u201330.","journal-title":"Future Oncol"},{"key":"2736_CR25","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1186\/s41512-022-00136-8","volume":"6","author":"M Sperrin","year":"2022","unstructured":"Sperrin M, Riley RD, Collins GS, Martin GP. Targeted validation: validating clinical prediction models in their intended population and setting. Diagn Progn Res. 2022;6:24.","journal-title":"Diagn Progn Res"}],"container-title":["British Journal of Cancer"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41416-024-02736-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41416-024-02736-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41416-024-02736-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,22]],"date-time":"2024-07-22T13:03:47Z","timestamp":1721653427000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41416-024-02736-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,3]]},"references-count":25,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,7,22]]}},"alternative-id":["2736"],"URL":"https:\/\/doi.org\/10.1038\/s41416-024-02736-1","relation":{},"ISSN":["0007-0920","1532-1827"],"issn-type":[{"type":"print","value":"0007-0920"},{"type":"electronic","value":"1532-1827"}],"subject":[],"published":{"date-parts":[[2024,6,3]]},"assertion":[{"value":"26 July 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 May 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 May 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 June 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"During the study conduct, AKC, HM, GK, FB-P, AW, EM, OB and PF were employees of Mendelian. MK reports consultancy fees from Advanced Accelerator Applications (a Novartis company), BMS, Ipsen, Mendelian, and Novartis.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"Ethical approval for the OPCRD database for clinical research purposes has been obtained from the NHS Health Research Authority (REC reference 20\/EM\/0148). This study was approved by the ADEPT committee (reference: PROTOCOL2318).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}}]}}