{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T05:56:45Z","timestamp":1776923805986,"version":"3.51.2"},"reference-count":33,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,7,3]],"date-time":"2023-07-03T00:00:00Z","timestamp":1688342400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>Up to 20% of renal masses \u22644 cm is found to be benign at the time of surgical excision, raising concern for overtreatment. However, the risk of malignancy is currently unable to be accurately predicted prior to surgery using imaging alone. The objective of this study is to propose a machine learning (ML) framework for pre-operative renal tumor classification using readily available clinical and CT imaging data. We tested both traditional ML methods (i.e., XGBoost, random forest (RF)) and deep learning (DL) methods (i.e., multilayer perceptron (MLP), 3D convolutional neural network (3DCNN)) to build the classification model. We discovered that the combination of clinical and radiomics features produced the best results (i.e., AUC [95% CI] of 0.719 [0.712\u20130.726], a precision [95% CI] of 0.976 [0.975\u20130.978], a recall [95% CI] of 0.683 [0.675\u20130.691], and a specificity [95% CI] of 0.827 [0.817\u20130.837]). Our analysis revealed that employing ML models with CT scans and clinical data holds promise for classifying the risk of renal malignancy. Future work should focus on externally validating the proposed model and features to better support clinical decision-making in renal cancer diagnosis.<\/jats:p>","DOI":"10.3390\/informatics10030055","type":"journal-article","created":{"date-parts":[[2023,7,4]],"date-time":"2023-07-04T01:42:47Z","timestamp":1688434967000},"page":"55","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Classification of Benign and Malignant Renal Tumors Based on CT Scans and Clinical Data Using Machine Learning Methods"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5291-5198","authenticated-orcid":false,"given":"Jie","family":"Xu","sequence":"first","affiliation":[{"name":"Department of Health Outcomes & Biomedical Informatics, University of Florida, Gainesville, FL 32611, USA"}]},{"given":"Xing","family":"He","sequence":"additional","affiliation":[{"name":"Department of Health Outcomes & Biomedical Informatics, University of Florida, Gainesville, FL 32611, USA"}]},{"given":"Wei","family":"Shao","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of Florida, Gainesville, FL 32611, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2238-5429","authenticated-orcid":false,"given":"Jiang","family":"Bian","sequence":"additional","affiliation":[{"name":"Department of Health Outcomes & Biomedical Informatics, University of Florida, Gainesville, FL 32611, USA"}]},{"given":"Russell","family":"Terry","sequence":"additional","affiliation":[{"name":"Department of Urology, University of Florida, Gainesville, FL 32611, USA"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,3]]},"reference":[{"key":"ref_1","unstructured":"(2023, March 25). Kidney Cancer. Available online: https:\/\/my.clevelandclinic.org\/health\/diseases\/9409-kidney-cancer-overview."},{"key":"ref_2","unstructured":"(2023, March 25). Kidney Cancer. Available online: https:\/\/www.urologyhealth.org\/urology-a-z\/k\/kidney-cancer."},{"key":"ref_3","unstructured":"(2023, March 25). Surgery for Kidney Cancer. Available online: https:\/\/www.hopkinsmedicine.org\/health\/treatment-tests-and-therapies\/surgery-for-kidney-cancer."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1016\/j.eururo.2019.01.034","article-title":"Re: The Temporal Association of Robotic Surgical Diffusion with Overtreatment of the Small Renal Mass","volume":"75","author":"Veccia","year":"2019","journal-title":"Eur. Urol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"330","DOI":"10.4103\/UA.UA_17_17","article-title":"Pathological Nature of Renal Tumors\u2014Does Size Matter?","volume":"9","author":"Kurban","year":"2017","journal-title":"Urol. Ann."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Expert Panel on Urologic Imaging, Wang, Z.J., Nikolaidis, P., Khatri, G., Dogra, V.S., Ganeshan, D., Goldfarb, S., Gore, J.L., Gupta, R.T., and Hartman, R.P. (2020). ACR Appropriateness Criteria\u00ae Indeterminate Renal Mass. J. Am. Coll. Radiol., 17, S415\u2013S428.","DOI":"10.1016\/j.jacr.2020.09.010"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2021","DOI":"10.1148\/rg.2018180127","article-title":"2017 AUA Renal Mass and Localized Renal Cancer Guidelines: Imaging Implications","volume":"38","author":"Ward","year":"2018","journal-title":"Radiographics"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1913","DOI":"10.1007\/s00345-018-2447-8","article-title":"WHO\/ISUP Classification, Grading and Pathological Staging of Renal Cell Carcinoma: Standards and Controversies","volume":"36","author":"Warren","year":"2018","journal-title":"World J. Urol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1387","DOI":"10.1148\/rg.2021200202","article-title":"Role of Imaging in Renal Cell Carcinoma: A Multidisciplinary Perspective","volume":"41","author":"Lo","year":"2021","journal-title":"Radiographics"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.crad.2019.09.131","article-title":"Usefulness of CT Texture Analysis in Differentiating Benign and Malignant Renal Tumours","volume":"75","author":"Deng","year":"2020","journal-title":"Clin. Radiol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e19725","DOI":"10.1097\/MD.0000000000019725","article-title":"Discriminating Malignant and Benign Clinical T1 Renal Masses on Computed Tomography: A Pragmatic Radiomics and Machine Learning Approach","volume":"99","author":"Uhlig","year":"2020","journal-title":"Medicine"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"13729","DOI":"10.1038\/s41598-021-93069-z","article-title":"Radiomics Models Based on Enhanced Computed Tomography to Distinguish Clear Cell from Non-Clear Cell Renal Cell Carcinomas","volume":"11","author":"Wang","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"W288","DOI":"10.2214\/AJR.18.19551","article-title":"Differentiation of Predominantly Solid Enhancing Lipid-Poor Renal Cell Masses by Use of Contrast-Enhanced CT: Evaluating the Role of Texture in Tumor Subtyping","volume":"211","author":"Varghese","year":"2018","journal-title":"Am. J. Roentgenol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"20200002","DOI":"10.1259\/bjr.20200002","article-title":"Deep Learning Based Classification of Solid Lipid-Poor Contrast Enhancing Renal Masses Using Contrast Enhanced CT","volume":"93","author":"Oberai","year":"2020","journal-title":"Br. J. Radiol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"5183","DOI":"10.1007\/s00330-020-06787-9","article-title":"Automated Classification of Solid Renal Masses on Contrast-Enhanced Computed Tomography Images Using Convolutional Neural Network with Decision Fusion","volume":"30","author":"Zabihollahy","year":"2020","journal-title":"Eur. Radiol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"605","DOI":"10.2214\/AJR.19.22074","article-title":"Differentiation of Small (\u2264 4 Cm) Renal Masses on Multiphase Contrast-Enhanced CT by Deep Learning","volume":"214","author":"Tanaka","year":"2020","journal-title":"AJR Am. J. Roentgenol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1038\/s41698-021-00195-y","article-title":"Deep Learning for End-to-End Kidney Cancer Diagnosis on Multi-Phase Abdominal Computed Tomography","volume":"5","author":"Uhm","year":"2021","journal-title":"NPJ Precis. Oncol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1007\/s10278-019-00230-2","article-title":"The Classification of Renal Cancer in 3-Phase CT Images Using a Deep Learning Method","volume":"32","author":"Han","year":"2019","journal-title":"J. Digit. Imaging"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1016\/j.tranon.2018.10.012","article-title":"A Deep Learning-Based Radiomics Model for Differentiating Benign and Malignant Renal Tumors","volume":"12","author":"Zhou","year":"2019","journal-title":"Transl. Oncol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2009","DOI":"10.1007\/s00261-019-01929-0","article-title":"Deep Learning and Radiomics: The Utility of Google TensorFlowTM Inception in Classifying Clear Cell Renal Cell Carcinoma and Oncocytoma on Multiphasic CT","volume":"44","author":"Coy","year":"2019","journal-title":"Abdom. Radiol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1288","DOI":"10.3174\/ajnr.A1073","article-title":"Multiphase CT Angiography versus Single-Phase CT Angiography: Comparison of Image Quality and Radiation Dose","volume":"29","author":"Yang","year":"2008","journal-title":"AJNR Am. J. Neuroradiol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1016\/j.eururo.2022.01.040","article-title":"Novel Imaging Methods for Renal Mass Characterization: A Collaborative Review","volume":"81","author":"Roussel","year":"2022","journal-title":"Eur. Urol."},{"key":"ref_23","unstructured":"Heller, N., Sathianathen, N., Kalapara, A., Walczak, E., Moore, K., Kaluzniak, H., Rosenberg, J., Blake, P., Rengel, Z., and Oestreich, M. (2019). The KiTS19 Challenge Data: 300 Kidney Tumor Cases with Clinical Context, CT Semantic Segmentations, and Surgical Outcomes. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e104","DOI":"10.1158\/0008-5472.CAN-17-0339","article-title":"Computational Radiomics System to Decode the Radiographic Phenotype","volume":"77","author":"Fedorov","year":"2017","journal-title":"Cancer Res."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2131","DOI":"10.1109\/TCBB.2019.2911071","article-title":"XGBoost Model for Chronic Kidney Disease Diagnosis","volume":"17","author":"Ogunleye","year":"2020","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinform."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1093\/bioinformatics\/btac065","article-title":"Federated Random Forests Can Improve Local Performance of Predictive Models for Various Healthcare Applications","volume":"38","author":"Hauschild","year":"2022","journal-title":"Bioinformatics"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1109\/TNNLS.2015.2424995","article-title":"Extreme Learning Machine for Multilayer Perceptron","volume":"27","author":"Tang","year":"2016","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_28","unstructured":"(2022, December 01). Wikipedia Contributors Precision and Recall. Available online: https:\/\/en.wikipedia.org\/w\/index.php?title=Precision_and_recall&oldid=1146375274."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2333\/bhmk.12.17_1","article-title":"The Bootstrap Method for Assessing Statistical Accuracy","volume":"12","author":"Efron","year":"1985","journal-title":"Behaviormetrika"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"McKight, P.E., and Najab, J. (2010). Kruskal-Wallis Test. Corsini Encycl. Psychol., 1.","DOI":"10.1002\/9780470479216.corpsy0491"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1097\/JU.0000000000001911","article-title":"Renal Mass and Localized Renal Cancer: Evaluation, Management, and Follow-up: AUA Guideline: Part I","volume":"206","author":"Campbell","year":"2021","journal-title":"J. Urol."},{"key":"ref_32","first-page":"MR000022","article-title":"Search Strategies to Identify Diagnostic Accuracy Studies in MEDLINE and EMBASE","volume":"2013","author":"Beynon","year":"2013","journal-title":"Cochrane Database Syst. Rev."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Abimanyi-Ochom, J., Bohingamu Mudiyanselage, S., Catchpool, M., Firipis, M., Wanni Arachchige Dona, S., and Watts, J.J. (2019). Strategies to Reduce Diagnostic Errors: A Systematic Review. BMC Med. Inform. Decis. Mak., 19.","DOI":"10.1186\/s12911-019-0901-1"}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/10\/3\/55\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:05:04Z","timestamp":1760126704000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/10\/3\/55"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,3]]},"references-count":33,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["informatics10030055"],"URL":"https:\/\/doi.org\/10.3390\/informatics10030055","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,3]]}}}