{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T07:45:05Z","timestamp":1773215105684,"version":"3.50.1"},"reference-count":45,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,7,18]],"date-time":"2022-07-18T00:00:00Z","timestamp":1658102400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>The role of multi-parametric magnetic resonance imaging (mp-MRI) is becoming increasingly important in the diagnosis of the clinical severity of prostate cancer (PCa). However, mp-MRI images usually contain several unaligned 3D sequences, such as DWI image sequences and T2-weighted image sequences, and there are many images among the entirety of 3D sequence images that do not contain cancerous tissue, which affects the accuracy of large-scale prostate cancer detection. Therefore, there is a great need for a method that uses accurate computer-aided detection of mp-MRI images and minimizes the influence of useless features. Our proposed PCa detection method is divided into three stages: (i) multimodal image alignment, (ii) automatic cropping of the sequence images to the entire prostate region, and, finally, (iii) combining multiple modal images of each patient into novel 3D sequences and using 3D convolutional neural networks to learn the newly composed 3D sequences with different modal alignments. We arrange the different modal methods to make the model fully learn the cancerous tissue features; then, we predict the clinical severity of PCa and generate a 3D cancer response map for the 3D sequence images from the last convolution layer of the network. The prediction results and 3D response map help to understand the features that the model focuses on during the process of 3D-CNN feature learning. We applied our method to Toho hospital prostate cancer patient data; the AUC (=0.85) results were significantly higher than those of other methods.<\/jats:p>","DOI":"10.3390\/a15070248","type":"journal-article","created":{"date-parts":[[2022,7,18]],"date-time":"2022-07-18T11:32:23Z","timestamp":1658143943000},"page":"248","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Semi-Automatic Multiparametric MR Imaging Classification Using Novel Image Input Sequences and 3D Convolutional Neural Networks"],"prefix":"10.3390","volume":"15","author":[{"given":"Bochong","family":"Li","sequence":"first","affiliation":[{"name":"Graduate School of Science and Technology, Chiba University, Chiba-shi 263-8522, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ryo","family":"Oka","sequence":"additional","affiliation":[{"name":"Department of Urology, Toho University Sakura Medical Center, Sakura-shi 285-8741, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ping","family":"Xuan","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Heilongjiang University, Harbin 150080, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuichiro","family":"Yoshimura","sequence":"additional","affiliation":[{"name":"School of Medicine, Toyama University, Toyama 930-8555, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Toshiya","family":"Nakaguchi","sequence":"additional","affiliation":[{"name":"Center for Frontier Medical Engineering, Chiba University, Chiba-shi 263-8522, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"162","DOI":"10.6004\/jnccn.2010.0012","article-title":"Prostate cancer","volume":"8","author":"Mohler","year":"2010","journal-title":"J. Natl. Compr. Cancer Netw."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1016\/j.eururo.2020.01.012","article-title":"Management of patients with advanced prostate cancer: Report of the advanced prostate cancer consensus conference 2019","volume":"77","author":"Gillessen","year":"2020","journal-title":"Eur. Urol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.eururo.2015.08.052","article-title":"PI-RADS prostate imaging\u2013reporting and data system: 2015, version 2","volume":"69","author":"Weinreb","year":"2016","journal-title":"Eur. Urol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1320","DOI":"10.1056\/NEJMoa0810084","article-title":"Screening and prostate-cancer mortality in a randomized European study","volume":"360","author":"Hugosson","year":"2009","journal-title":"N. Engl. J. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"343","DOI":"10.2214\/AJR.13.11046","article-title":"Accuracy of multiparametric MRI for prostate cancer detection: A meta-analysis","volume":"202","author":"Hamoen","year":"2014","journal-title":"Am. J. Roentgenol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"6821","DOI":"10.2147\/CMAR.S257769","article-title":"The Value of Prostate-Specific Antigen-Related Indexes and Imaging Screening in the Diagnosis of Prostate Cancer","volume":"12","author":"Bai","year":"2020","journal-title":"Cancer Manag. Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"E6265","DOI":"10.1073\/pnas.1505935112","article-title":"Automatic classification of prostate cancer Gleason scores from multiparametric magnetic resonance images","volume":"112","author":"Fehr","year":"2015","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1097\/MOU.0b013e32835481c2","article-title":"Multiparametric MRI and prostate cancer diagnosis and risk stratification","volume":"22","author":"Turkbey","year":"2012","journal-title":"Curr. Opin. Urol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1148\/radiol.13121454","article-title":"Quantitative analysis of multiparametric prostate MR images: Differentiation between prostate cancer and normal tissue and correlation with Gleason score\u2014a computer-aided diagnosis development study","volume":"267","author":"Peng","year":"2013","journal-title":"Radiology"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1111\/j.1464-410X.2010.09483.x","article-title":"Documenting the location of prostate biopsies with image fusion","volume":"107","author":"Turkbey","year":"2011","journal-title":"BJU Int."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.eururo.2014.10.026","article-title":"Detection of clinically significant prostate cancer using magnetic resonance imaging\u2013ultrasound fusion targeted biopsy: A systematic review","volume":"68","author":"Valerio","year":"2015","journal-title":"Eur. Urol."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Liu, P., Wang, S., Turkbey, B., Grant, K., Pinto, P., Choyke, P., Wood, B.J., and Summers, R.M. (2013, January 26). A prostate cancer computer-aided diagnosis system using multimodal magnetic resonance imaging and targeted biopsy labels. Medical Imaging 2013: Computer-Aided Diagnosis. Proceedings of the International Society for Optics and Photonics, Lake Buena Vista, FL, USA.","DOI":"10.1117\/12.2007927"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lemaitre, G. (2016). Computer-Aided Diagnosis for Prostate Cancer Using Multi-Parametric Magnetic Resonance Imaging. [Ph.D. Thesis, Universitat de Girona, Escola Polit\u00e8cnica Superior].","DOI":"10.1109\/EMBC.2017.8037522"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Litjens, G.J., Vos, P.C., Barentsz, J.O., Karssemeijer, N., and Huisman, H.J. (2011, January 4). Automatic computer aided detection of abnormalities in multi-parametric prostate MRI. Medical Imaging 2011: Computer-Aided Diagnosis. Proceedings of the International Society for Optics and Photonics, Lake Buena Vista, FL, USA.","DOI":"10.1117\/12.877844"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Litjens, G.J., Barentsz, J.O., Karssemeijer, N., and Huisman, H.J. (2012, January 23). Automated computer-aided detection of prostate cancer in MR images: From a whole-organ to a zone-based approach. Proceedings of the Medical Imaging 2012: Computer-Aided Diagnosis, International Society for Optics and Photonics, San Diego, CA, USA.","DOI":"10.1117\/12.911061"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2444","DOI":"10.1109\/TIP.2010.2048612","article-title":"Prostate cancer localization with multispectral MRI using cost-sensitive support vector machines and conditional random fields","volume":"19","author":"Artan","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3833","DOI":"10.1088\/0031-9155\/57\/12\/3833","article-title":"Computer-aided diagnosis of prostate cancer in the peripheral zone using multiparametric MRI","volume":"57","author":"Niaf","year":"2012","journal-title":"Phys. Med. Biol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1016\/j.media.2012.10.004","article-title":"Multi-kernel graph embedding for detection, Gleason grading of prostate cancer via MRI\/MRS","volume":"17","author":"Tiwari","year":"2013","journal-title":"Med. Image Anal."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"789561","DOI":"10.1155\/2014\/789561","article-title":"Computer aided-diagnosis of prostate cancer on multiparametric MRI: A technical review of current research","volume":"2014","author":"Wang","year":"2014","journal-title":"BioMed Res. Int."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1007\/978-981-13-8950-4_25","article-title":"CNN-based Prostate Zonal Segmentation on T2-weighted MR Images: A Cross-dataset Study","volume":"Volume 151","author":"Esposito","year":"2020","journal-title":"Neural Approaches to Dynamics of Signal Exchanges"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.neucom.2019.07.006","article-title":"USE-Net: Incorporating Squeeze-and-Excitation blocks into U-Net for prostate zonal segmentation of multi-institutional MRI datasets","volume":"365","author":"Rundo","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2390","DOI":"10.1118\/1.1593633","article-title":"Detection of prostate cancer by integration of line-scan diffusion, T2-mapping and T2-weighted magnetic resonance imaging; a multichannel statistical classifier","volume":"30","author":"Chan","year":"2003","journal-title":"Med. Phys."},{"key":"ref_23","first-page":"327","article-title":"Prostate cancer detection with multi- parametric MRI: Logistic regression analysis of quantitative T2, diffusion-weighted imaging, and dynamic contrast-enhanced MRI","volume":"30","author":"Langer","year":"2009","journal-title":"J. Magn. Reson. Imaging Off. J. Int. Soc. Magn. Reson. Med."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1002\/nbm.1777","article-title":"Multimodal wavelet embedding representation for data combination (MaWERiC): Integrating magnetic resonance imaging and spectroscopy for prostate cancer detection","volume":"25","author":"Tiwari","year":"2012","journal-title":"NMR Biomed."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1038\/538020a","article-title":"Can we open the black box of AI?","volume":"538","author":"Castelvecchi","year":"2016","journal-title":"Nat. News"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27\u201330). Learning deep features for discriminative localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.319"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Chattopadhay, A., Sarkar, A., Howlader, P., and Balasubramanian, V.N. (2018, January 12\u201315). Grad-cam++: Generalized gradient-based visual explanations for deep convolutional networks. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.","DOI":"10.1109\/WACV.2018.00097"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1016\/S0262-8856(03)00137-9","article-title":"Image registration methods: A survey","volume":"21","author":"Zitova","year":"2003","journal-title":"Image Vis. Comput."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"R1","DOI":"10.1088\/0031-9155\/46\/3\/201","article-title":"Medical image registration","volume":"46","author":"Hill","year":"2001","journal-title":"Phys. Med. Biol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"590638","DOI":"10.1155\/2014\/590638","article-title":"Functional MRI in prostate cancer detection","volume":"2014","author":"Sankineni","year":"2014","journal-title":"BioMed Res. Int."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1054","DOI":"10.1002\/mrm.1298","article-title":"Comparison of quantitative T2 mapping and diffusion-weighted imaging in the normal and pathologic prostate","volume":"46","author":"Gibbs","year":"2001","journal-title":"Magn. Reson. Med. Off. J. Int. Soc. Magn. Reson. Med."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"De Santi, B., Salvi, M., Giannini, V., Meiburger, K.M., Marzola, F., Russo, F., Bosco, M., and Molinariet, F. (2020, January 20\u201324). Comparison of Histogram-based Textural Features between Cancerous and Normal Prostatic Tissue in Multiparametric Magnetic Resonance Images. Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada.","DOI":"10.1109\/EMBC44109.2020.9176307"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2033","DOI":"10.1016\/j.neuroimage.2010.09.025","article-title":"A reproducible evaluation of ANTs similarity metric performance in brain image registration","volume":"54","author":"Avants","year":"2011","journal-title":"Neuroimage"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Yu, L., Yang, X., Chen, H., Qin, J., and Heng, P.A. (2017, January 4\u20139). Volumetric ConvNets with mixed residual connections for automated prostate segmentation from 3D MR images. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.10510"},{"key":"ref_37","first-page":"8026","article-title":"Pytorch: An imperative style, high-performance deep learning library","volume":"32","author":"Paszke","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/s10479-005-5724-z","article-title":"A tutorial on the cross-entropy method","volume":"134","author":"Kroese","year":"2005","journal-title":"Ann. Oper. Res."},{"key":"ref_39","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"044501","DOI":"10.1117\/1.JMI.5.4.044501","article-title":"PROSTATEx Challenges for computerized classification of prostate lesions from multiparametric magnetic resonance images","volume":"5","author":"Armato","year":"2018","journal-title":"J. Med. Imaging"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., and Fei-Fei, L. (2014, January 23\u201328). Large-scale video classification with convolutional neural networks. Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.223"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Kopuklu, O., Kose, N., Gunduz, A., and Rigoll, G. (2019, January 27\u201328). Resource efficient 3d convolutional neural networks. Proceedings of the IEEE\/CVF International Conference on Computer Vision Workshops, Seoul, Korea.","DOI":"10.1109\/ICCVW.2019.00240"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.1007\/s00330-019-06417-z","article-title":"Semi-automatic classification of prostate cancer on multi-parametric MR imaging using a multi-channel 3D convolutional neural network","volume":"30","author":"Aldoj","year":"2020","journal-title":"Eur. Radiol."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2030","DOI":"10.1007\/s00261-018-1824-5","article-title":"Deep transfer learning-based prostate cancer classification using 3 Tesla multi-parametric MRI","volume":"44","author":"Zhong","year":"2019","journal-title":"Abdom. Radiol."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Chen, Q., Xu, X., Hu, S., Li, X., Zou, Q., and Li, Y. (2017, January 16). A transfer learning approach for classification of clinical significant prostate cancers from mpMRI scans. Medical Imaging 2017: Computer-Aided Diagnosis. Proceedings of the International Society for Optics and Photonics, Orlando, FL, USA.","DOI":"10.1117\/12.2279021"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/7\/248\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:52:47Z","timestamp":1760140367000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/7\/248"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,18]]},"references-count":45,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["a15070248"],"URL":"https:\/\/doi.org\/10.3390\/a15070248","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,18]]}}}