{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T12:24:35Z","timestamp":1768998275086,"version":"3.49.0"},"reference-count":32,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T00:00:00Z","timestamp":1763078400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Cancers"],"abstract":"<jats:p>Background: Staging systems are essential for guiding treatment and predicting outcomes in cancer patients. For pancreatic neuroendocrine tumors, the American Joint Committee on Cancer (AJCC) Tumor, Lymph Node, and Metastasis (TNM) system is the current standard. However, its predictive accuracy is limited, as survival curves often overlap, particularly between Stage I and Stage II. Improved methods of patient stratification are therefore needed. Methods: We applied the Ensemble Algorithm for Clustering Cancer Data (EACCD) that involves calculating dissimilarities, ensemble learning, and hierarchical clustering. Data were obtained from the Surveillance, Epidemiology, and End Results (SEER) program of the National Cancer Institute. Models were developed with AJCC TNM variables (T, N, M) and expanded by including patient age. Results: The AJCC TNM system achieved a C-index of 0.6656 (95% CI: 0.6473\u20130.6839), with survival curves showing poor separation. In contrast, the EACCD model using TNM variables produced four prognostic groups with refined and clear separation, yielding a comparable C-index of 0.6685 (95% CI: 0.6518\u20130.6852). When age was added, EACCD identified five groups with even stronger stratification and a higher C-index of 0.7015 (95% CI: 0.6852\u20130.7178). Conclusions: EACCD provides a refined prognostic framework for pancreatic neuroendocrine tumors, outperforming the AJCC TNM system by offering clearer survival stratification, comparable or higher C-index values, and integration of additional clinical factors.<\/jats:p>","DOI":"10.3390\/cancers17223658","type":"journal-article","created":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T14:37:52Z","timestamp":1763131072000},"page":"3658","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Using Machine Learning to Revise the AJCC Staging System for Neuroendocrine Tumors of the Pancreas"],"prefix":"10.3390","volume":"17","author":[{"given":"Jacob","family":"Hillman","sequence":"first","affiliation":[{"name":"Department of Data and Decision Sciences, Emory University, Atlanta, GA 30322, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Quinn","family":"Clark","sequence":"additional","affiliation":[{"name":"NYU School of Global Public Health, New York, NY 10003, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liam","family":"Rehm","sequence":"additional","affiliation":[{"name":"Sora Schools, Atlanta, GA 30326, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8743-6007","authenticated-orcid":false,"given":"Anwar E.","family":"Ahmed","sequence":"additional","affiliation":[{"name":"Department of Preventive Medicine and Biostatistics, Uniformed Services University of the Health Sciences, Bethesda, MD 20814, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5787-3441","authenticated-orcid":false,"given":"Dechang","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Preventive Medicine and Biostatistics, Uniformed Services University of the Health Sciences, Bethesda, MD 20814, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,14]]},"reference":[{"key":"ref_1","first-page":"10","article-title":"Cancer statistics, 2025","volume":"75","author":"Siegel","year":"2025","journal-title":"CA A Cancer J. Clin."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1016\/j.surg.2018.10.031","article-title":"Systematic review of current prognostication systems for pancreatic neuroendocrine neoplasms","volume":"165","author":"Teo","year":"2019","journal-title":"Surgery"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"21","DOI":"10.5582\/irdr.2017.01007","article-title":"Pancreatic Neuroendocrine Tumors","volume":"6","author":"Sun","year":"2017","journal-title":"Intractable Rare Dis. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"312","DOI":"10.5732\/cjc.012.10295","article-title":"Pancreatic neuroendocrine tumors: Biology, diagnosis, and treatment","volume":"32","author":"Ro","year":"2013","journal-title":"Chin. J. Cancer"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Akirov, A., Larouche, V., Alshehri, S., Asa, S.L., and Ezzat, S. (2019). Treatment Options for Pancreatic Neuroendocrine Tumors. Cancers, 11.","DOI":"10.3390\/cancers11060828"},{"key":"ref_6","first-page":"e660","article-title":"TNM Staging of Pancreatic Neuroendocrine Tumors","volume":"95","author":"Yang","year":"2016","journal-title":"Medicine"},{"key":"ref_7","unstructured":"American Joint Committee on Cancer (2017). AJCC Cancer Staging Manual, American Joint Committee on Cancer. [8th ed.]. Corrected at 3rd printing; AJCC."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1002\/cam4.1336","article-title":"Assessment of the American Joint Commission on Cancer 8th Edition Staging System for Patients with Pancreatic Neuroendocrine Tumors: A Surveillance, Epidemiology, and End Results analysis","volume":"7","author":"Li","year":"2018","journal-title":"Cancer Med."},{"key":"ref_9","unstructured":"Rindi, G., Dasari, A., Hope, T.A., Mittra, E., Thomas, S.A., and Wei, A.C. (2024). AJCC Cancer Staging System Neuroendocrine Tumors of the Pancreas, American College of Surgeons. [9th ed.]."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Heng, X., Chen, B., Zhao, K., Li, J., Wu, W., Peng, Y., and Zhong, R. (2023). Comparison of nomogram for Primary Nonfunctional Pancreatic Neuroendocrine Tumors based on the 7th vs 8th edition of the AJCC cancer staging manual. PLoS ONE, 18.","DOI":"10.1371\/journal.pone.0284930"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chen, D., Xing, K., Henson, D., Sheng, L., Schwartz, A.M., and Cheng, X. (2009). Developing Prognostic Systems of Cancer Patients by Ensemble Clustering. BioMed Res. Int., 2009.","DOI":"10.1155\/2009\/632786"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Qi, R., Wu, D., Sheng, L., Henson, D., Schwartz, A., Xu, E., Xing, K., and Chen, D. (2013). On an ensemble algorithm for clustering cancer patient data. BMC Syst. Biol., 7.","DOI":"10.1186\/1752-0509-7-S4-S9"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1007\/s42519-021-00234-8","article-title":"Using Weighted Differences in Hazards as Effect Sizes for Survival Data","volume":"16","author":"Wang","year":"2022","journal-title":"J. Stat. Theory Pract."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3611","DOI":"10.1002\/cam4.1629","article-title":"Creating prognostic systems for cancer patients: A demonstration using breast cancer","volume":"7","author":"Hueman","year":"2018","journal-title":"Cancer Med."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yang, C.Q., Gardiner, L., Wang, H., Hueman, M.T., and Chen, D. (2019). Creating Prognostic Systems for Well-Differentiated Thyroid Cancer Using Machine Learning. Front. Endocrinol., 10.","DOI":"10.3389\/fendo.2019.00288"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"12","DOI":"10.21037\/jgo.2016.11.10","article-title":"The anatomy of the TNM for colon cancer","volume":"8","author":"Henson","year":"2017","journal-title":"J. Gastrointest. Oncol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1423","DOI":"10.1111\/1759-7714.13926","article-title":"Expanding TNM for lung cancer through machine learning","volume":"12","author":"Hueman","year":"2021","journal-title":"Thorac. Cancer"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1511","DOI":"10.1111\/aogs.14137","article-title":"A prognostic system for epithelial ovarian carcinomas using machine learning","volume":"100","author":"Grimley","year":"2021","journal-title":"Acta Obs. Gynecol. Scand."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"744","DOI":"10.1016\/j.ygyno.2020.09.047","article-title":"Using machine learning to create prognostic systems for endometrial cancer","volume":"159","author":"Praiss","year":"2020","journal-title":"Gynecol. Oncol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"514","DOI":"10.3390\/biomedinformatics3030035","article-title":"Using Machine Learning to Expand the Ann Arbor Staging System for Hodgkin and Non-Hodgkin Lymphoma","volume":"3","author":"Wang","year":"2023","journal-title":"BioMedInformatics"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yang, C.Q., Wang, H., Liu, Z., Hueman, M.T., Bhaskaran, A., Henson, D.E., Sheng, L., and Chen, D. (2021). Integrating additional factors into the TNM staging for cutaneous melanoma by machine learning. PLoS ONE, 16.","DOI":"10.1371\/journal.pone.0257949"},{"key":"ref_22","unstructured":"National Cancer Institute, DCCPS, Surveillance Research Program (2025, June 02). Surveillance, Epidemiology, and End Results (SEER) Program Research Data (2000\u20132019). National Cancer Institute 2024, Available online: https:\/\/seer.cancer.gov\/."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"574","DOI":"10.21037\/gs-20-634","article-title":"The clinical characteristics and survival associations of pancreatic neuroendocrine tumors: Does age matter?","volume":"10","author":"Liu","year":"2021","journal-title":"Gland. Surg"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1080\/01621459.1958.10501452","article-title":"Nonparametric Estimation from Incomplete Observations","volume":"53","author":"Kaplan","year":"1958","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_25","unstructured":"Huan, W., Li, S., and Dechang, C. (2023). Perspective Chapter: Using Effect Sizes to Study the Survival Difference between Two Groups. Recent Advances in Biostatistics, IntechOpen."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1075","DOI":"10.1198\/jasa.2011.tm10183","article-title":"Hierarchical Clustering With Prototypes via Minimax Linkage","volume":"106","author":"Bien","year":"2011","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1002\/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4","article-title":"Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors","volume":"15","author":"Harrell","year":"1996","journal-title":"Stat. Med."},{"key":"ref_28","unstructured":"R Core Team (2023). R: A Language and Environment for Statistical Computing, R Core Team."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1002\/sim.6370","article-title":"Comparing two correlated C indices with right-censored survival outcome: A one-shot nonparametric approach","volume":"34","author":"Kang","year":"2015","journal-title":"Stat. Med."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1002\/jso.28141","article-title":"A Methodological and Survival Comparison of NCDB and SEER Database for Colon Cancer Research","volume":"132","author":"Erkaya","year":"2025","journal-title":"J. Surg. Oncol."},{"key":"ref_31","first-page":"1477","article-title":"Comparing SEER and NCDB: A case study using colorectal cancer","volume":"35","author":"Liu","year":"2024","journal-title":"Cancer Causes Control."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"e13343","DOI":"10.1111\/jne.13343","article-title":"European Neuroendocrine Tumour Society (ENETS) 2023 guidance paper for nonfunctioning pancreatic neuroendocrine tumours","volume":"35","author":"Denecke","year":"2023","journal-title":"J. Neuroendocrinol."}],"container-title":["Cancers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-6694\/17\/22\/3658\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T14:47:16Z","timestamp":1763131636000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-6694\/17\/22\/3658"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,14]]},"references-count":32,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["cancers17223658"],"URL":"https:\/\/doi.org\/10.3390\/cancers17223658","relation":{},"ISSN":["2072-6694"],"issn-type":[{"value":"2072-6694","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,14]]}}}