{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T23:34:45Z","timestamp":1780356885437,"version":"3.54.1"},"reference-count":36,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2024,8,2]],"date-time":"2024-08-02T00:00:00Z","timestamp":1722556800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100013209","name":"Hellenic Foundation for Research and Innovation","doi-asserted-by":"publisher","award":["3656"],"award-info":[{"award-number":["3656"]}],"id":[{"id":"10.13039\/501100013209","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>This study explores a multi-modal machine-learning-based approach to classify solitary pulmonary nodules (SPNs). Non-small cell lung cancer (NSCLC), presenting primarily as SPNs, is the leading cause of cancer-related deaths worldwide. Early detection and appropriate management of SPNs are critical to improving patient outcomes, necessitating efficient diagnostic methodologies. While CT and PET scans are pivotal in the diagnostic process, their interpretation remains prone to human error and delays in treatment implementation. This study proposes a machine-learning-based network to mitigate these concerns, integrating CT, PET, and manually extracted features in a multi-modal manner by integrating multiple image modalities and tabular features). CT and PET images are classified by a VGG19 network, while additional SPN features in combination with the outputs of VGG19 are processed by an XGBoost model to perform the ultimate diagnosis. The proposed methodology is evaluated using patient data from the Department of Nuclear Medicine of the University Hospital of Patras in Greece. We used 402 patient cases with human annotations to internally validate the model and 96 histopathological-confirmed cases for external evaluation. The model exhibited 97% agreement with the human readers and 85% diagnostic performance in the external set. It also identified the VGG19 predictions from CT and PET images, SUVmax, and diameter as key malignancy predictors. The study suggests that combining all available image modalities and SPN characteristics improves the agreement of the model with the human readers and the diagnostic efficiency.<\/jats:p>","DOI":"10.3390\/bdcc8080085","type":"journal-article","created":{"date-parts":[[2024,8,2]],"date-time":"2024-08-02T13:14:42Z","timestamp":1722604482000},"page":"85","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A Multi-Modal Machine Learning Methodology for Predicting Solitary Pulmonary Nodule Malignancy in Patients Undergoing PET\/CT Examination"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6439-9282","authenticated-orcid":false,"given":"Ioannis D.","family":"Apostolopoulos","sequence":"first","affiliation":[{"name":"Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nikolaos D.","family":"Papathanasiou","sequence":"additional","affiliation":[{"name":"Department of Nuclear Medicine, University Hospital of Patras, 26504 Rio, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dimitris J.","family":"Apostolopoulos","sequence":"additional","affiliation":[{"name":"Department of Nuclear Medicine, University Hospital of Patras, 26504 Rio, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5416-1991","authenticated-orcid":false,"given":"Nikolaos","family":"Papandrianos","sequence":"additional","affiliation":[{"name":"Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2498-9661","authenticated-orcid":false,"given":"Elpiniki I.","family":"Papageorgiou","sequence":"additional","affiliation":[{"name":"Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Rodak, O., Peris-D\u00edaz, M.D., Olbromski, M., Podhorska-Oko\u0142\u00f3w, M., and Dzi\u0119giel, P. (2021). Current Landscape of Non-Small Cell Lung Cancer: Epidemiology, Histological Classification, Targeted Therapies, and Immunotherapy. Cancers, 13.","DOI":"10.3390\/cancers13184705"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1001\/jama.2021.24287","article-title":"Evaluating the Patient with a Pulmonary Nodule: A Review","volume":"327","author":"Mazzone","year":"2022","journal-title":"JAMA"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1111\/imj.14219","article-title":"Evaluation of the Solitary Pulmonary Nodule","volume":"49","author":"Cruickshank","year":"2019","journal-title":"Intern. Med. J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1053\/j.sult.2022.01.006","article-title":"Solitary Pulmonary Nodule Evaluation: Pearls and Pitfalls","volume":"43","author":"Ko","year":"2022","journal-title":"Semin. Ultrasound CT MRI"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1983","DOI":"10.1007\/s00330-021-08268-z","article-title":"Development and Validation of a Preoperative CT-Based Radiomic Nomogram to Predict Pathology Invasiveness in Patients with a Solitary Pulmonary Nodule: A Machine Learning Approach, Multicenter, Diagnostic Study","volume":"32","author":"Huang","year":"2022","journal-title":"Eur. Radiol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.1007\/s11517-021-02378-y","article-title":"Automatic Classification of Solitary Pulmonary Nodules in PET\/CT Imaging Employing Transfer Learning Techniques","volume":"59","author":"Apostolopoulos","year":"2021","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Apostolopoulos, I.D., Apostolopoulos, D.J., and Panayiotakis, G.S. (2022, January 18). Solitary Pulmonary Nodule Malignancy Classification Utilising 3D Features and Semi-Supervised Deep Learning. Proceedings of the 2022 13th IEEE International Conference on Information, Intelligence, Systems & Applications (IISA), Corfu, Greece.","DOI":"10.1109\/IISA56318.2022.9904334"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3207","DOI":"10.1002\/mp.13592","article-title":"Machine Learning Approach for Distinguishing Malignant and Benign Lung Nodules Utilizing Standardized Perinodular Parenchymal Features from CT","volume":"46","author":"Uthoff","year":"2019","journal-title":"Med. Phys."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.1016\/j.bbe.2021.08.006","article-title":"Classification of Lung Nodule Malignancy in Computed Tomography Imaging Utilising Generative Adversarial Networks and Semi-Supervised Transfer Learning","volume":"41","author":"Apostolopoulos","year":"2021","journal-title":"Biocybern. Biomed. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.ejmp.2021.03.013","article-title":"Benign-Malignant Pulmonary Nodule Classification in Low-Dose CT with Convolutional Features","volume":"83","author":"Astaraki","year":"2021","journal-title":"Phys. Med."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e55","DOI":"10.1016\/j.acra.2019.05.018","article-title":"Deep Learning for the Classification of Small (\u22642 Cm) Pulmonary Nodules on CT Imaging: A Preliminary Study","volume":"27","author":"Chae","year":"2020","journal-title":"Acad. Radiol."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Chen, S., Harmon, S., Perk, T., Li, X., Chen, M., Li, Y., and Jeraj, R. (2017). Diagnostic Classification of Solitary Pulmonary Nodules Using Dual Time 18F-FDG PET\/CT Image Texture Features in Granuloma-Endemic Regions. Sci. Rep., 7.","DOI":"10.1038\/s41598-017-08764-7"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1007\/s11547-023-01730-6","article-title":"Combined Model Integrating Deep Learning, Radiomics, and Clinical Data to Classify Lung Nodules at Chest CT","volume":"129","author":"Lin","year":"2024","journal-title":"Radiol. Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1242","DOI":"10.1007\/s10278-020-00372-8","article-title":"Multi-Model Ensemble Learning Architecture Based on 3D CNN for Lung Nodule Malignancy Suspiciousness Classification","volume":"33","author":"Liu","year":"2020","journal-title":"J. Digit. Imaging"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1097\/RLU.0000000000003661","article-title":"Performance Evaluation of a Deep Learning System for Differential Diagnosis of Lung Cancer with Conventional CT and FDG PET\/CT Using Transfer Learning and Metadata","volume":"46","author":"Park","year":"2021","journal-title":"Clin. Nucl. Med."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"82","DOI":"10.4274\/mirt.galenos.2021.43760","article-title":"Diagnostic Performance of Machine Learning Models Based on 18F-FDG PET\/CT Radiomic Features in the Classification of Solitary Pulmonary Nodules","volume":"31","author":"Uyulan","year":"2022","journal-title":"Mol. Imaging Radionucl. Ther."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1186\/s13643-021-01856-6","article-title":"Solitary Pulmonary Nodule Malignancy Predictive Models Applicable to Routine Clinical Practice: A Systematic Review","volume":"10","author":"Librero","year":"2021","journal-title":"Syst. Rev."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.media.2017.06.015","article-title":"Validation, Comparison, and Combination of Algorithms for Automatic Detection of Pulmonary Nodules in Computed Tomography Images: The LUNA16 Challenge","volume":"42","author":"Setio","year":"2017","journal-title":"Med. Image Anal."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1109\/TMI.2021.3123572","article-title":"Semi-Supervised Deep Transfer Learning for Benign-Malignant Diagnosis of Pulmonary Nodules in Chest CT Images","volume":"41","author":"Shi","year":"2022","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Huang, B., Sollee, J., Luo, Y.-H., Reddy, A., Zhong, Z., Wu, J., Mammarappallil, J., Healey, T., Cheng, G., and Azzoli, C. (2022). Prediction of Lung Malignancy Progression and Survival with Machine Learning Based on Pre-Treatment FDG-PET\/CT. eBioMedicine, 82.","DOI":"10.1016\/j.ebiom.2022.104127"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1200\/CCI.21.00021","article-title":"Machine Learning Radiomics Model for Early Identification of Small-Cell Lung Cancer on Computed Tomography Scans","volume":"5","author":"Shah","year":"2021","journal-title":"JCO Clin. Cancer Inform."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wang, H., Li, Y., Han, J., Lin, Q., Zhao, L., Li, Q., Zhao, J., Li, H., Wang, Y., and Hu, C. (2023). A Machine Learning-Based PET\/CT Model for Automatic Diagnosis of Early-Stage Lung Cancer. Front. Oncol., 13.","DOI":"10.3389\/fonc.2023.1192908"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kang, Y., Chiu, Y.-W., Lin, M.-Y., Su, F.-Y., and Huang, S.-T. (2021, January 10\u201312). Towards Model-Informed Precision Dosing with Expert-in-the-Loop Machine Learning. Proceedings of the 2021 IEEE 22nd International Conference on Information Reuse and Integration for Data Science (IRI), IEEE, Las Vegas, NV, USA.","DOI":"10.1109\/IRI51335.2021.00053"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Samaras, A.-D., Moustakidis, S., Apostolopoulos, I.D., Papandrianos, N., and Papageorgiou, E. (2023). Classification Models for Assessing Coronary Artery Disease Instances Using Clinical and Biometric Data: An Explainable Man-in-the-Loop Approach. Sci. Rep., 13.","DOI":"10.1038\/s41598-023-33500-9"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wang, H., Zhu, H., Ding, L., and Yang, K. (2023). A Diagnostic Classification of Lung Nodules Using Multiple-Scale Residual Network. Sci. Rep., 13.","DOI":"10.1038\/s41598-023-38350-z"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"617","DOI":"10.21037\/tlcr.2017.09.01","article-title":"Role of PET\/CT for Precision Medicine in Lung Cancer: Perspective of the Society of Nuclear Medicine and Molecular Imaging","volume":"6","author":"Greenspan","year":"2017","journal-title":"Transl. Lung Cancer Res."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1811","DOI":"10.1002\/1878-0261.12534","article-title":"Tumor-proximal Liquid Biopsy to Improve Diagnostic and Prognostic Performances of Circulating Tumor Cells","volume":"13","author":"Buscail","year":"2019","journal-title":"Mol. Oncol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1007\/s00066-019-01518-6","article-title":"Image-Based Lung Functional Radiotherapy Planning for Non-Small Cell Lung Cancer","volume":"196","author":"Mounessi","year":"2020","journal-title":"Strahlenther. Onkol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_30","unstructured":"Goodfellow, I., Bengio, Y., Courville, A., and Bengio, Y. (2016). Deep Learning, MIT Press."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"LeCun, Y., Kavukcuoglu, K., and Farabet, C. (June, January 30). Convolutional Networks and Applications in Vision. Proceedings of the 2010 IEEE International Symposium on Circuits and Systems, Paris, France.","DOI":"10.1109\/ISCAS.2010.5537907"},{"key":"ref_32","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13). XGBoost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_35","first-page":"1015","article-title":"Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation","volume":"Volume 4304","author":"Sattar","year":"2006","journal-title":"AI 2006: Advances in Artificial Intelligence"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1016\/j.chest.2022.08.2227","article-title":"Diagnostic Accuracy of a Convolutional Neural Network Assessment of Solitary Pulmonary Nodules Compared with PET With CT Imaging and Dynamic Contrast-Enhanced CT Imaging Using Unenhanced and Contrast-Enhanced CT Imaging","volume":"163","author":"Debruyn","year":"2023","journal-title":"Chest"}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/8\/8\/85\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:29:09Z","timestamp":1760110149000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/8\/8\/85"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,2]]},"references-count":36,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["bdcc8080085"],"URL":"https:\/\/doi.org\/10.3390\/bdcc8080085","relation":{},"ISSN":["2504-2289"],"issn-type":[{"value":"2504-2289","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,2]]}}}