{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T10:03:29Z","timestamp":1790071409112,"version":"4.0.1"},"reference-count":35,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2026,9,15]],"date-time":"2026-09-15T00:00:00Z","timestamp":1789430400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010418","name":"Institute for Information & Communications Technology Planning & Evaluation","doi-asserted-by":"publisher","award":["2024-0-00047"],"award-info":[{"award-number":["2024-0-00047"]}],"id":[{"id":"10.13039\/501100010418","id-type":"DOI","asserted-by":"publisher"}]},{"award":["2024-0-00047"],"award-info":[{"award-number":["2024-0-00047"]}],"id":[{"id":"https:\/\/ror.org\/01g0hqq23","id-type":"ROR","asserted-by":"publisher"}]},{"name":"Korean government"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Multimodal studies of prostate cancer typically report aggregate fusion gains from histology and transcriptomics but rarely characterize when each modality is informative. We asked whether morphology and transcriptomics contribute differently to distinct clinical endpoints, using Gleason grading and nodal status prediction. On 401 TCGA-PRAD patients with matched whole-slide images, bulk RNA sequencing, and clinical data, we evaluated 45 morphological configurations, seven RNA configurations, and six fusion strategies across four grading formulations, T-stage, and N-stage. To avoid per-task model selection, morphology used a single fixed configuration (gated ABMIL on UNI features). Contribution estimates used repeated stratified five-fold cross-validation, with a locked conformal-prediction protocol and gene set enrichment analysis. The two endpoints showed opposite modality dependence. For Gleason grade, the fixed morphological model exceeded the best RNA configuration across all 45 configurations (five-class macro-F1: 0.445 versus 0.398). For nodal status, no morphological configuration exceeded AUROC 0.62, whereas transcriptomics reached 0.68 (permutation p = 0.037); a direct interaction test confirmed the reversal (bootstrap 95% CI excluding zero). Fusion gains were modest and task-dependent; enrichment analysis linked the nodal signal to loss of smooth muscle programs, consistent with established dedifferentiation biology. The informative modality is task-dependent: morphology predicts grade, transcriptomics predicts nodal status.<\/jats:p>","DOI":"10.3390\/jimaging12090446","type":"journal-article","created":{"date-parts":[[2026,9,15]],"date-time":"2026-09-15T13:33:42Z","timestamp":1789479222000},"page":"446","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Morphology Predicts Grade, Transcriptomics Predicts Nodal Status: Task-Dependent Modality Contributions in Multimodal Prostate Cancer Classification"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-6232-5341","authenticated-orcid":false,"given":"Chae Eun","family":"Moon","sequence":"first","affiliation":[{"name":"Department of AI Software Convergence, Konyang University, 158 Gwanjeo-dong-ro, Seo-gu, Daejeon 35365, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"methodology","vocabulary":"credit"},{"role":"software","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-4611-1337","authenticated-orcid":false,"given":"Ho Jung","family":"Song","sequence":"additional","affiliation":[{"name":"Department of Medical Engineering, Konyang University, 158 Gwanjeo-dong-ro, Seo-gu, Daejeon 35365, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"software","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"writing-original-draft","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3443-263X","authenticated-orcid":false,"given":"Yong Suk","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Konyang University, 158 Gwanjeo-dong-ro, Seo-gu, Daejeon 35365, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"resources","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"},{"role":"funding-acquisition","vocabulary":"credit"},{"role":"project-administration","vocabulary":"credit"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,15]]},"reference":[{"key":"ref_1","first-page":"209","article-title":"Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries","volume":"71","author":"Sung","year":"2021","journal-title":"CA Cancer J. Clin."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1097\/PAS.0000000000000530","article-title":"The 2014 International Society of Urological Pathology (ISUP) Consensus Conference on Gleason Grading of Prostatic Carcinoma: Definition of Grading Patterns and Proposal for a New Grading System","volume":"40","author":"Epstein","year":"2016","journal-title":"Am. J. Surg. Pathol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/S0022-5347(17)59889-4","article-title":"Prediction of Prognosis for Prostatic Adenocarcinoma by Combined Histological Grading and Clinical Staging","volume":"111","author":"Gleason","year":"1974","journal-title":"J. Urol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1080\/21681805.2016.1206619","article-title":"Interobserver Variability in Gleason Histological Grading of Prostate Cancer","volume":"50","author":"Ozkan","year":"2016","journal-title":"Scand. J. Urol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1053\/hupa.2001.21135","article-title":"Interobserver Reproducibility of Gleason Grading of Prostatic Carcinoma: General Pathologists","volume":"32","author":"Allsbrook","year":"2001","journal-title":"Hum. Pathol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1038\/s41571-019-0252-y","article-title":"Artificial Intelligence in Digital Pathology: New Tools for Diagnosis and Precision Oncology","volume":"16","author":"Bera","year":"2019","journal-title":"Nat. Rev. Clin. Oncol."},{"key":"ref_7","first-page":"2127","article-title":"Attention-Based Deep Multiple Instance Learning","volume":"Volume 80","author":"Ilse","year":"2018","journal-title":"Proceedings of the 35th International Conference on Machine Learning (ICML)"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"850","DOI":"10.1038\/s41591-024-02857-3","article-title":"Towards a General-Purpose Foundation Model for Computational Pathology","volume":"30","author":"Chen","year":"2024","journal-title":"Nat. Med."},{"key":"ref_9","unstructured":"Zimmermann, E., Vorontsov, E., Viret, J., Casson, A., Zelechowski, M., Shaikovski, G., Tenenholtz, N., Hall, J., Fuchs, T., and Fusi, N. (2024). Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathology. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Filiot, A., Ghermi, R., Olivier, A., Jacob, P., Fidon, L., Mac Kain, A., Saillard, C., and Schiratti, J.-B. (2023). Scaling Self-Supervised Learning for Histopathology with Masked Image Modeling. medRxiv.","DOI":"10.1101\/2023.07.21.23292757"},{"key":"ref_11","unstructured":"Filiot, A., Jacob, P., Mac Kain, A., and Saillard, C. (2024). Phikon-v2, a Large and Public Feature Extractor for Biomarker Prediction. arXiv."},{"key":"ref_12","unstructured":"Saillard, C., Jenatton, R., Llinares-L\u00f3pez, F., Mariet, Z., Cahan\u00e9, D., Durand, E., and Vert, J.-P. (2026, August 10). H-Optimus-0. Bioptimus. Available online: https:\/\/github.com\/bioptimus\/releases\/tree\/main\/models\/h-optimus\/v0."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1038\/s41551-020-00682-w","article-title":"Data-Efficient and Weakly Supervised Computational Pathology on Whole-Slide Images","volume":"5","author":"Lu","year":"2021","journal-title":"Nat. Biomed. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Li, B., Li, Y., and Eliceiri, K.W. (2021, January 20\u201325). Dual-Stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-Supervised Contrastive Learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01409"},{"key":"ref_15","first-page":"2136","article-title":"TransMIL: Transformer Based Correlated Multiple Instance Learning for Whole Slide Image Classification","volume":"34","author":"Shao","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1038\/s41591-021-01620-2","article-title":"Artificial Intelligence for Diagnosis and Gleason Grading of Prostate Cancer: The PANDA Challenge","volume":"28","author":"Bulten","year":"2022","journal-title":"Nat. Med."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1016\/S1470-2045(19)30738-7","article-title":"Artificial Intelligence for Diagnosis and Grading of Prostate Cancer in Biopsies: A Population-Based, Diagnostic Study","volume":"21","author":"Kartasalo","year":"2020","journal-title":"Lancet Oncol."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Song, H.J., Cho, Y.S., and Kim, Y.S. (2026). Comparative Evaluation of Feature Extractors, Aggregation Strategies, and Classification Hierarchies for Ovarian Cancer Subtype Classification in Whole Slide Images. Diagnostics, 16.","DOI":"10.3390\/diagnostics16101570"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1038\/nrg2484","article-title":"RNA-Seq: A Revolutionary Tool for Transcriptomics","volume":"10","author":"Wang","year":"2009","journal-title":"Nat. Rev. Genet."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1038\/s41568-021-00408-3","article-title":"Harnessing Multimodal Data Integration to Advance Precision Oncology","volume":"22","author":"Boehm","year":"2022","journal-title":"Nat. Rev. Cancer"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1095","DOI":"10.1016\/j.ccell.2022.09.012","article-title":"Artificial Intelligence for Multimodal Data Integration in Oncology","volume":"40","author":"Lipkova","year":"2022","journal-title":"Cancer Cell"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1109\/TMI.2020.3021387","article-title":"Pathomic Fusion: An Integrated Framework for Fusing Histopathology and Genomic Features for Cancer Diagnosis and Prognosis","volume":"41","author":"Chen","year":"2022","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"865","DOI":"10.1016\/j.ccell.2022.07.004","article-title":"Pan-Cancer Integrative Histology-Genomic Analysis via Multimodal Deep Learning","volume":"40","author":"Chen","year":"2022","journal-title":"Cancer Cell"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Chen, R.J., Lu, M.Y., Weng, W.-H., Chen, T.Y., Williamson, D.F.K., Manz, T., Shady, M., and Mahmood, F. (2021, January 10\u201317). Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00398"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zadeh, A., Chen, M., Poria, S., Cambria, E., and Morency, L.-P. (2017, January 7\u201311). Tensor Fusion Network for Multimodal Sentiment Analysis. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP), Copenhagen, Denmark.","DOI":"10.18653\/v1\/D17-1115"},{"key":"ref_26","first-page":"622","article-title":"Pathology-and-Genomics Multimodal Transformer for Survival Outcome Prediction","volume":"Volume 14225","author":"Ding","year":"2023","journal-title":"Medical Image Computing and Computer Assisted Intervention (MICCAI 2023)"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1111\/bju.15386","article-title":"Deep Learning Approach to Predict Lymph Node Metastasis Directly from Primary Tumour Histology in Prostate Cancer","volume":"128","author":"Wessels","year":"2021","journal-title":"BJU Int."},{"key":"ref_28","first-page":"2912","article-title":"Reactive Stroma in Human Prostate Cancer: Induction of Myofibroblast Phenotype and Extracellular Matrix Remodeling","volume":"8","author":"Tuxhorn","year":"2002","journal-title":"Clin. Cancer Res."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.mad.2004.09.023","article-title":"Profiling Molecular Targets of TGF-\u03b21 in Prostate Fibroblast-to-Myofibroblast Transdifferentiation","volume":"126","author":"Untergasser","year":"2005","journal-title":"Mech. Ageing Dev."},{"key":"ref_30","first-page":"4792","article-title":"Reactive Stroma as a Predictor of Biochemical-Free Recurrence in Prostate Cancer","volume":"9","author":"Ayala","year":"2003","journal-title":"Clin. Cancer Res."},{"key":"ref_31","unstructured":"Vovk, V., Gammerman, A., and Shafer, G. (2005). Algorithmic Learning in a Random World, Springer."},{"key":"ref_32","first-page":"3581","article-title":"Classification with Valid and Adaptive Coverage","volume":"33","author":"Romano","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_33","unstructured":"(2015). The Cancer Genome Atlas Research Network. The Molecular Taxonomy of Primary Prostate Cancer. Cell, 163, 1011\u20131025."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"15545","DOI":"10.1073\/pnas.0506580102","article-title":"Gene Set Enrichment Analysis: A Knowledge-Based Approach for Interpreting Genome-Wide Expression Profiles","volume":"102","author":"Subramanian","year":"2005","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_35","first-page":"142","article-title":"Systematic Comparison of Deep Learning Strategies for Weakly Supervised Gleason Grading","volume":"Volume 11320","author":"Atzori","year":"2020","journal-title":"Medical Imaging 2020: Digital Pathology"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/12\/9\/446\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T09:19:42Z","timestamp":1790068782000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/12\/9\/446"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,15]]},"references-count":35,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["jimaging12090446"],"URL":"https:\/\/doi.org\/10.3390\/jimaging12090446","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,15]]}}}