{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,5]],"date-time":"2026-10-05T20:56:00Z","timestamp":1791233760443,"version":"4.1.0"},"reference-count":60,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2025,8,20]],"date-time":"2025-08-20T00:00:00Z","timestamp":1755648000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Austrian Science Fund FWF","award":["DOC110"],"award-info":[{"award-number":["DOC110"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Cancers"],"abstract":"<jats:p>Background\/Objectives: Head and neck squamous cell carcinoma (HNSCC) diagnosis and treatment rely heavily on computed tomography (CT) imaging to evaluate tumor characteristics and lymph node (LN) involvement, crucial for staging, prognosis, and therapy planning. Conventional LN evaluation methods based on morphological criteria such as size, shape, and anatomical location often lack sensitivity for early metastasis detection. This study leverages radiomics to extract quantitative features from CT images, addressing the limitations of subjective assessment and aiming to enhance LN classification accuracy while potentially reducing reliance on invasive histopathology. Methods: We analyzed 234 LNs from 27 HNSCC patients, deriving 120 features per node, resulting in over 25,000 data points classified into reactive, pathologic, and pathologic with extracapsular spread classes. Considering the challenges of high dimensionality and limited dataset size, more than 44,000 experiments systematically optimized machine learning models, feature selection methods, and hyperparameters, including ensemble approaches to strengthen classification robustness. A Pareto front strategy was employed to balance diagnostic accuracy with significant feature reduction. Results: The optimal model, validated via 5-fold cross-validation, achieved a balanced accuracy of 0.90, an area under the curve (AUC) of 0.93, and an F1-score of 0.88 using only five radiomics features. Conclusions: This interpretable approach aligns well with clinical radiology practice, demonstrating strong potential for clinical application in noninvasive LN classification in HNSCC.<\/jats:p>","DOI":"10.3390\/cancers17162711","type":"journal-article","created":{"date-parts":[[2025,8,20]],"date-time":"2025-08-20T13:18:14Z","timestamp":1755695894000},"page":"2711","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Machine Learning-Based Classification of Cervical Lymph Nodes in HNSCC: A Radiomics Approach with Feature Selection Optimization"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-2787-0281","authenticated-orcid":false,"given":"Sara","family":"Naccour","sequence":"first","affiliation":[{"name":"Department of Otorhinolaryngology-Head and Neck Surgery, Medical University of Innsbruck, 6020 Innsbruck, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1561-8992","authenticated-orcid":false,"given":"Assaad","family":"Moawad","sequence":"additional","affiliation":[{"name":"Datathings, 5, rue de l\u2019industrie, L-1811 Luxembourg, Luxembourg"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1413-7396","authenticated-orcid":false,"given":"Matthias","family":"Santer","sequence":"additional","affiliation":[{"name":"Department of Otorhinolaryngology-Head and Neck Surgery, Medical University of Innsbruck, 6020 Innsbruck, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9176-7415","authenticated-orcid":false,"given":"Daniel","family":"Dejaco","sequence":"additional","affiliation":[{"name":"Department of Otorhinolaryngology-Head and Neck Surgery, Medical University of Innsbruck, 6020 Innsbruck, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2833-3224","authenticated-orcid":false,"given":"Wolfgang","family":"Freysinger","sequence":"additional","affiliation":[{"name":"Department of Otorhinolaryngology-Head and Neck Surgery, Medical University of Innsbruck, 6020 Innsbruck, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,8,20]]},"reference":[{"key":"ref_1","first-page":"7","article-title":"Cancer statistics","volume":"66","author":"Siegel","year":"2016","journal-title":"CA Cancer J. Clin."},{"key":"ref_2","first-page":"229","article-title":"Global cancer statistics 2022: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries","volume":"74","author":"Bray","year":"2024","journal-title":"CA Cancer J. Clin."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"S1","DOI":"10.14639\/0392-100X-suppl.1-40-2020","article-title":"Metastatic disease in head & neck oncology","volume":"40","author":"Pisani","year":"2020","journal-title":"Acta Otorhinolaryngol. Ital."},{"key":"ref_4","first-page":"102626","article-title":"A gradient mapping guided explainable deep neural network for extracapsular extension identification in 3D head and neck cancer computed tomography images","volume":"82","author":"Wang","year":"2022","journal-title":"Med. Image Anal."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1001\/archotol.1997.01900020027004","article-title":"Detection of cervical metastasis. A meta-analysis comparing computed tomography with physical examination","volume":"123","author":"Merritt","year":"1997","journal-title":"Arch. Otolaryngol. Head Neck Surg."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.anl.2021.05.007","article-title":"Neck dissection and trans oral robotic surgery for oropharyngeal squamous cell carcinoma","volume":"49","author":"Meccariello","year":"2021","journal-title":"Auris Nasus Larynx"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"W17","DOI":"10.2214\/AJR.12.8960","article-title":"Evaluation of cervical lymph nodes in head and neck cancer with CT and MRI: Tips, traps, and a systematic approach","volume":"200","author":"Hoang","year":"2013","journal-title":"Am. J. Roentgenol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1186\/s13244-020-00887-2","article-title":"Radiomics in medical imaging\u2014\u201chow-to\u201d guide and critical reflection","volume":"11","author":"Timmeren","year":"2020","journal-title":"Insights Imaging"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1148\/radiol.2015151169","article-title":"Radiomics: Images Are More than Pictures, They Are Data","volume":"278","author":"Gillies","year":"2016","journal-title":"Radiology"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kann, B.H., Aneja, S., Loganadane, G.V., Kelly, J.R., Smith, S.M., Decker, R.H., Yu, J.B., Park, H.S., Yarbrough, W.G., and Malhotra, A. (2018). Pretreatment Identification of Head and Neck Cancer Nodal Metastasis and Extranodal Extension Using Deep Learning Neural Networks. Sci. Rep., 8.","DOI":"10.1038\/s41598-018-32441-y"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Tomita, H., Yamashiro, T., Heianna, J., Nakasone, T., Kobayashi, T., Mishiro, S., Hirahara, D., Takaya, E., Mimura, H., and Murayama, S. (2021). Deep Learning for the Preoperative Diagnosis of Metastatic Cervical Lymph Nodes on Contrast-Enhanced Computed ToMography in Patients with Oral Squamous Cell Carcinoma. Cancers, 13.","DOI":"10.3390\/cancers13040600"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Bardos, Z.R., Dejaco, D., Santer, M., Kloppenburg, M., Mangesius, S., Widmann, G., Ganswindt, U., Rumpold, G., Riechelmann, H., and Freysinger, W. (2022). Benchmarking Eliminative Radiomic Feature Selection for Head and Neck Lymph Node Classification. Cancers, 14.","DOI":"10.3390\/cancers14030477"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1097\/EDE.0b013e3181577511","article-title":"Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and elaboration","volume":"18","author":"Vandenbroucke","year":"2007","journal-title":"Epidemiology"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"h5527","DOI":"10.1136\/bmj.h5527","article-title":"STARD 2015: An updated list of essential items for reporting diagnostic accuracy studies","volume":"351","author":"Bossuyt","year":"2015","journal-title":"BMJ"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1783","DOI":"10.1016\/j.ejrad.2013.04.024","article-title":"Radiological detection of extracapsular spread in head and neck squamous cell carcinoma (HNSCC) cervical metastases","volume":"82","author":"Url","year":"2013","journal-title":"Eur. J. Radiol."},{"key":"ref_16","unstructured":"(2021, November 19). PyRadiomics. Available online: https:\/\/github.com\/Radiomics\/pyradiomics."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"e104","DOI":"10.1158\/0008-5472.CAN-17-0339","article-title":"Computational Radiomics System to Decode the Radiographic Phenotype","volume":"77","author":"Griethuysen","year":"2017","journal-title":"Cancer Res."},{"key":"ref_18","first-page":"1157","article-title":"An Introduction to Variable and Feature Selection","volume":"3","author":"Guyon","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2507","DOI":"10.1093\/bioinformatics\/btm344","article-title":"A review of feature selection techniques in bioinformatics","volume":"23","author":"Saeys","year":"2007","journal-title":"Bioinformatics"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"572","DOI":"10.1016\/S0140-6736(02)07746-2","article-title":"Use of proteomic patterns in serum to identify ovarian cancer","volume":"359","author":"Petricoin","year":"2002","journal-title":"Lancet"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1638","DOI":"10.1093\/bioinformatics\/bth098","article-title":"Application of the GA\/KNN method to SELDI proteomics data","volume":"20","author":"Li","year":"2004","journal-title":"Bioinformatics"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1109\/5254.671091","article-title":"Feature Subset Selection Using Genetic Algorithms","volume":"13","author":"Yang","year":"1998","journal-title":"IEEE Intell. Syst. Appl."},{"key":"ref_23","unstructured":"Holland, J.H., Langton, C., and Wilson, S.W. (1975). Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. A Bradford Book, The MIT Press Cambridge, Massachusetts Institute of Technology."},{"key":"ref_24","unstructured":"Deb, K. (2001). Multi-Objective Optimization Using Evolutionary Algorithms, Michigan State University."},{"key":"ref_25","unstructured":"Fonseca, C.M., and Fleming, P. (1993, January 17\u201321). Genetic Algorithms for Multiobjective Optimization: Formulation, Discussion and Generalization. Proceedings of the Fifth International Conference on Genetic Algorithms, Urbana-Champaign, IL, USA."},{"key":"ref_26","unstructured":"Hall, M.A. (1999). Correlation-Based Feature Selection for Machine Learning, The University of Waikato."},{"key":"ref_27","unstructured":"Blake, C., Keogh, E., and Merz, C.J. (1998). UCI Repository of Machine Learning Databases, University of California, Irvine. Available online: https:\/\/archive.ics.uci.edu\/ml."},{"key":"ref_28","unstructured":"Yang, Y., and Pedersen, J.O. (1997, January 8\u201312). A Comparative Study on Feature Selection in Text Categorization. Proceedings of the Fourteenth International Conference on Machine Learning (ICML\u201997), San Francisco, CA, USA."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1198\/TECH.2011.08118","article-title":"Sparse discriminant analysis","volume":"53","author":"Clemmensen","year":"2011","journal-title":"Technometrics"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1111\/j.1469-1809.1936.tb02137.x","article-title":"The Use of Multiple Measurements in Taxonomic Problems","volume":"7","author":"Fisher","year":"1936","journal-title":"Ann. Eugen."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1093\/biomet\/57.3.519","article-title":"Measures of multivariate skewness and kurtosis with applications","volume":"57","author":"Mardia","year":"1970","journal-title":"Biometrika"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Nayak, N., Chang, H., Borowsky, A., Spellman, P., and Parvin, B. (2013, January 7\u201311). Classification of tumor histopathology via sparse feature learning. Proceedings of the 2013 IEEE 10th International Symposium on Biomedical Imaging, San Francisco, CA, USA.","DOI":"10.1109\/ISBI.2013.6556499"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1146\/annurev-bioeng-060418-052147","article-title":"Sparse Data\u2013Driven Learning for Effective and Efficient Biomedical Image Segmentation","volume":"22","author":"Onofrey","year":"2022","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1023\/A:1012487302797","article-title":"Gene Selection for Cancer Classification using Support Vector Machines","volume":"46","author":"Guyon","year":"2002","journal-title":"Mach. Learn."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Remeseiro, B., and Bolon-Canedo, V. (2019). A Review of Feature Selection Methods in Medical Applications. Comput. Biol. Med., 112.","DOI":"10.1016\/j.compbiomed.2019.103375"},{"key":"ref_36","first-page":"3","article-title":"A Review of Feature Selection and Its Methods","volume":"19","author":"Venkatesh","year":"2019","journal-title":"Cybern. Inf. Technol."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Benjamin, K.J.M., Katipalli, T., and Paquola, A.C.M. (2023). dRFEtools: Dynamic Recursive Feature Elimination for Omics Data. Bioinformatics, 39.","DOI":"10.1093\/bioinformatics\/btad513"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1016\/j.ygeno.2012.04.003","article-title":"Random forests for genomic data analysis","volume":"99","author":"Chen","year":"2012","journal-title":"Genomics"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"03008","DOI":"10.1051\/shsconf\/202213903008","article-title":"Random forest classification algorithm for medical industry data","volume":"139","author":"Vlachas","year":"2022","journal-title":"SHS Web Conf."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"36043003","DOI":"10.11604\/pamj.2022.42.89.33833","article-title":"Application of random forest model to predict the demand of essential medicines for non-communicable diseases management in public health facilities, 2022","volume":"42","author":"Mbonyinshuti","year":"2022","journal-title":"Pan. Afr. Med. J."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Loef, B., Wong, A., Janssen, N.A.H., Strak, M., Hoekstra, J., Picavet, H.S.J., Boshuizen, H.C.H., Verschuren, W.M.M., and Herber, G.C.M. (2022). Using random forest to identify longitudinal predictors of health in a 30-year cohort study. Sci. Rep., 12.","DOI":"10.1038\/s41598-022-14632-w"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). XGBoost: A Scalable Tree Boosting System. Proceedings of the Conference: The 22nd ACM SIGKDD International Conference, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Chang, W., Liu, Y., Xiao, Z., Yuan, X., Xu, X., Zhang, S., and Zhou, S. (2019). A Machine-Learning-Based Prediction Method for Hypertension Outcomes Based on Medical Data. Diagnostics, 9.","DOI":"10.3390\/diagnostics9040178"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1089\/neur.2020.0009","article-title":"XGBoost, a Machine Learning Method, Predicts Neurological Recovery in Patients with Cervical Spinal Cord Injury","volume":"1","author":"Inoue","year":"2020","journal-title":"Neurotrauma Rep."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"4514","DOI":"10.1016\/j.jksuci.2020.10.013","article-title":"An optimized XGBoost based diagnostic system for effective prediction of heart disease","volume":"34","author":"Budholiya","year":"2022","journal-title":"J. King Saud Univ.-Comput. Inf. Sci."},{"key":"ref_47","unstructured":"Ghojogh, B., and Crowley, M. (2019). Linear and Quadratic Discriminant Analysis: Tutorial. arXiv."},{"key":"ref_48","unstructured":"Liu, J., Cai, X., and Niranjan, M. (2023). GO-LDA: Generalised Optimal Linear Discriminant Analysis. arXiv."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1023\/A:1022627411411","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_50","first-page":"140","article-title":"Pattern Recognition and Machine Learning","volume":"16","author":"Bishop","year":"2006","journal-title":"J. Electron. Imaging"},{"key":"ref_51","unstructured":"Vapnik, V.N. (1998). Statistical Learning Theory, John Wiley & Sons."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1023\/A:1009715923555","article-title":"A tutorial on support vector machines for pattern recognition","volume":"2","author":"Burges","year":"1998","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Sch\u00f6lkopf, B., and Smola, A.J. (2001). Learning with Kernels\u2014Support Vector Machines, Regularization, Optimization, and Beyond, MIT Press.","DOI":"10.7551\/mitpress\/4175.001.0001"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/3-540-45014-9_1","article-title":"Ensemble Methods in Machine Learning","volume":"Volume 1857","author":"Dietterich","year":"2000","journal-title":"Multiple Classifier Systems"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1613\/jair.614","article-title":"Popular Ensemble Methods: An Empirical Study","volume":"11","author":"Opitz","year":"1999","journal-title":"J. Artif. Intell. Res."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Barsouk, A., Aluru, J.S., Rawla, P., Saginala, K., and Barsouk, A. (2023). Epidemiology, Risk Factors, and Prevention of Head and Neck Squamous Cell Carcinoma. Med. Sci., 11.","DOI":"10.3390\/medsci11020042"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"901","DOI":"10.1017\/S0022215118001718","article-title":"Reviewing indications for panendoscopy in the investigation of head and neck squamous cell carcinoma","volume":"132","author":"Noor","year":"2018","journal-title":"J. Laryngol. Otol."},{"key":"ref_58","unstructured":"National Comprehensive Cancer Network (2022, January 08). Guidelines for Head and Neck Cancers, Version 1. Available online: https:\/\/www.nccn.org\/guidelines\/guidelines-detail?category=1&id=1437."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.bjoms.2016.01.004","article-title":"Tumour seeding after fine-needle aspiration and core biopsy of the head and neck\u2014A systematic review","volume":"54","author":"Shah","year":"2016","journal-title":"Br. J. Oral Maxillofac. Surg."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1177\/0194599816643041","article-title":"Diagnostic Accuracy of Fine-Needle Aspiration for Parotid and Submandibular Gland Lesions","volume":"155","author":"Feinstein","year":"2016","journal-title":"Otolaryngol. Head Neck Surg."}],"container-title":["Cancers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-6694\/17\/16\/2711\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:31:56Z","timestamp":1760034716000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-6694\/17\/16\/2711"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,20]]},"references-count":60,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2025,8]]}},"alternative-id":["cancers17162711"],"URL":"https:\/\/doi.org\/10.3390\/cancers17162711","relation":{},"ISSN":["2072-6694"],"issn-type":[{"value":"2072-6694","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,20]]}}}