{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,22]],"date-time":"2026-03-22T02:39:57Z","timestamp":1774147197819,"version":"3.50.1"},"reference-count":38,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2021,4,23]],"date-time":"2021-04-23T00:00:00Z","timestamp":1619136000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The diagnosis of brain pathologies usually involves imaging to analyze the condition of the brain. Magnetic resonance imaging (MRI) technology is widely used in brain disorder diagnosis. The image quality of MRI depends on the magnetostatic field strength and scanning time. Scanners with lower field strengths have the disadvantages of a low resolution and high imaging cost, and scanning takes a long time. The traditional super-resolution reconstruction method based on MRI generally states an optimization problem in terms of prior information. It solves the problem using an iterative approach with a large time cost. Many methods based on deep learning have emerged to replace traditional methods. MRI super-resolution technology based on deep learning can effectively improve MRI resolution through a three-dimensional convolutional neural network; however, the training costs are relatively high. In this paper, we propose the use of two-dimensional super-resolution technology for the super-resolution reconstruction of MRI images. In the first reconstruction, we choose a scale factor of 2 and simulate half the volume of MRI slices as input. We utilize a receiving field block enhanced super-resolution generative adversarial network (RFB-ESRGAN), which is superior to other super-resolution technologies in terms of texture and frequency information. We then rebuild the super-resolution reconstructed slices in the MRI. In the second reconstruction, the image after the first reconstruction is composed of only half of the slices, and there are still missing values. In our previous work, we adopted the traditional interpolation method, and there was still a gap in the visual effect of the reconstructed images. Therefore, we propose a noise-based super-resolution network (nESRGAN). The noise addition to the network can provide additional texture restoration possibilities. We use nESRGAN to further restore MRI resolution and high-frequency information. Finally, we achieve the 3D reconstruction of brain MRI images through two super-resolution reconstructions. Our proposed method is superior to 3D super-resolution technology based on deep learning in terms of perception range and image quality evaluation standards.<\/jats:p>","DOI":"10.3390\/s21092978","type":"journal-article","created":{"date-parts":[[2021,4,25]],"date-time":"2021-04-25T02:12:57Z","timestamp":1619316777000},"page":"2978","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["3D MRI Reconstruction Based on 2D Generative Adversarial Network Super-Resolution"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5699-9659","authenticated-orcid":false,"given":"Hongtao","family":"Zhang","sequence":"first","affiliation":[{"name":"Graduate School of Engineering, Kochi University of Technology, Kami, Kochi 782-8502, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3023-2163","authenticated-orcid":false,"given":"Yuki","family":"Shinomiya","sequence":"additional","affiliation":[{"name":"School of Information, Kochi University of Technology, Kami, Kochi 782-8502, Japan"}]},{"given":"Shinichi","family":"Yoshida","sequence":"additional","affiliation":[{"name":"School of Information, Kochi University of Technology, Kami, Kochi 782-8502, Japan"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1241","DOI":"10.1016\/j.neuroimage.2011.10.065","article-title":"The future of ultra-high field MRI and fMRI for study of the human brain","volume":"62","author":"Duyn","year":"2012","journal-title":"NeuroImage"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1093\/cercor\/10.4.433","article-title":"Volumetry of Hippocampus and Amygdala with High-resolution MRI and Three-dimensional Analysis Software: Minimizing the Discrepancies between Laboratories","volume":"10","author":"Pruessner","year":"2000","journal-title":"Cereb. Cortex"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/j.mric.2007.06.002","article-title":"A Review of MR Physics: 3T versus 1.5T","volume":"15","author":"Soher","year":"2006","journal-title":"Magn. Reson. Imaging Clin. N. Am."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.ejrad.2007.11.006","article-title":"Clinical advantages of 3.0T MRI over 1.5T","volume":"65","author":"Willinek","year":"2008","journal-title":"Eur. J. Radiol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1016\/S0730-725X(02)00511-8","article-title":"MRI inter-slice reconstruction using super-resolution","volume":"20","author":"Greenspan","year":"2002","journal-title":"Magn. Reson. Imaging"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"817","DOI":"10.1109\/34.790425","article-title":"Super-resolution reconstruction of image sequences","volume":"21","author":"Elad","year":"1999","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","first-page":"83143V","article-title":"February. Super-resolution reconstruction in MRI: Better images faster?","volume":"Volume 8314","author":"Plenge","year":"2012","journal-title":"Medical Imaging 2012: Image Processing"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1983","DOI":"10.1002\/mrm.24187","article-title":"Super-resolution methods in MRI: Can they improve the trade-off between resolution, signal-to-noise ratio, and acquisition time?","volume":"68","author":"Plenge","year":"2012","journal-title":"Magn. Reson. Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2459","DOI":"10.1109\/TMI.2015.2437894","article-title":"LRTV: MR Image Super-Resolution with Low-Rank and Total Variation Regularizations","volume":"34","author":"Shi","year":"2015","journal-title":"IEEE Trans. Med Imaging"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3106","DOI":"10.1109\/TMM.2019.2919431","article-title":"Deep Learning for Single Image Super-Resolution: A Brief Review","volume":"21","author":"Yang","year":"2019","journal-title":"IEEE Trans. Multimed."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Glasner, D., Bagon, S., and Irani, M. (October, January 29). Super-resolution from a single image. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan.","DOI":"10.1109\/ICCV.2009.5459271"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/TIP.2008.2008067","article-title":"Generalizing the Nonlocal-Means to Super-Resolution Reconstruction","volume":"18","author":"Protter","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wang, Z., Chen, J., and Hoi, S.C.H. (2020). Deep learning for image super-resolution: A survey. IEEE Trans. Pattern Anal. Mach. Intell.","DOI":"10.1109\/TPAMI.2020.2982166"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lim, B., Son, S., Kim, H., Nah, S., and Lee, K.M. (2017, January 21\u201326). Enhanced deep residual networks for single image super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.151"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Tong, T., Li, G., Liu, X., and Gao, Q. (2017, January 22\u201329). Image super-resolution using dense skip connections. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.514"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2017, January 21\u201326). Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.19"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Qiao, Y., and Loy, C.C. (2018, January 8\u201314). Esrgan: Enhanced super-resolution generative adversarial networks. Proceedings of the European Conference on Computer Vision (ECCV) Workshops, Munich, Germany.","DOI":"10.1007\/978-3-030-11021-5_5"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Shang, T., Dai, Q., Zhu, S., Yang, T., and Guo, Y. (2020, January 14\u201319). Perceptual extreme super-resolution network with receptive field block. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Virtual.","DOI":"10.1109\/CVPRW50498.2020.00228"},{"key":"ref_20","unstructured":"Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative adversarial networks. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Odena, A., Dumoulin, V., and Olah, C. (2016). Deconvolution and Checkerboard Artifacts. Distill, 1.","DOI":"10.23915\/distill.00003"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wang, Y., Teng, Q., He, X., Feng, J., and Zhang, T. (2019). CT-image of rock samples super resolution using 3D convolutional neural network. Comput. Geosci., 133.","DOI":"10.1016\/j.cageo.2019.104314"},{"key":"ref_23","unstructured":"S\u00e1nchez, I., and Vilaplana, V. (2018). Brain MRI super-resolution using 3D generative adversarial networks. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Chen, Y., Xie, Y., Zhou, Z., Shi, F., Christodoulou, A.G., and Li, D. (2018, January 4\u20137). Brain MRI super resolution using 3D deep densely connected neural networks. Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), Washington, DC, USA.","DOI":"10.1109\/ISBI.2018.8363679"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Srinivasan, K., Ankur, A., and Sharma, A. (2017, January 12\u201314). Super-resolution of magnetic resonance images using deep convolutional neural networks. Proceedings of the 2017 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW), Taipei, Taiwan.","DOI":"10.1109\/ICCE-China.2017.7990985"},{"key":"ref_26","unstructured":"Lyu, Q., Chenyu, Y., Hongming, S., and Ge, W. (2018). Super-resolution MRI through deep learning. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., and Tang, X. (2016). Accelerating the super-resolution convolutional neural network. European Conference on Computer Vision, Proceedings of the 14th European Conference, Amsterdam, The Netherlands, 11\u201314 October 2016, Springer.","DOI":"10.1007\/978-3-319-46475-6_25"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Karras, T., Samuli, L., and Timo, A. (2019, January 16\u201320). A style-based generator architecture for generative adversarial networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00453"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Liu, S., and Huang, D. (2018, January 8\u201314). Receptive field block net for accurate and fast object detection. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01252-6_24"},{"key":"ref_30","unstructured":"Jolicoeur-Martineau, A. (2018). The relativistic discriminator: A key element missing from standard GAN. arXiv."},{"key":"ref_31","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_32","unstructured":"Ioffe, S., and Szegedy, C. (2015, January 6\u201311). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the International Conference on Machine Learning, Lille, France."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hor\u00e9, A., and Ziou, D. (2010, January 23\u201326). Image quality metrics: PSNR vs. SSIM. Proceedings of the 20th International Conference on Pattern Recognition, Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.579"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhang, R., Isola, P., Efros, A.A., Shechtman, E., and Wang, O. (2018, January 18\u201323). The unreasonable effectiveness of deep features as a perceptual metric. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00068"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Rakotonirina, N.C., and Rasoanaivo, A. (2020, January 4\u20138). ESRGAN+: Further improving enhanced super-resolution generative adversarial network. Proceedings of the ICASSP 2020\u2014International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.","DOI":"10.1109\/ICASSP40776.2020.9054071"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., He, K., and Tang, X. (2014). Learning a deep convolutional network for image super-resolution. European Conference on Computer Vision, Proceedings of the 13th European Conference, Zurich, Switzerland, 6\u201312 September 2014, Springer.","DOI":"10.1007\/978-3-319-10593-2_13"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Hongtao, Z., Shinomiya, Y., and Yoshida, S. (2020, January 11\u201314). 3D Brain MRI Reconstruction based on 2D Super-Resolution Technology. Proceedings of the 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Toronto, ON, Canada.","DOI":"10.1109\/SMC42975.2020.9283444"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1109\/LSP.2003.821718","article-title":"Adaptive Image Interpolation Based on Local Gradient Features","volume":"11","author":"Hwang","year":"2004","journal-title":"IEEE Signal Process. Lett."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/9\/2978\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:52:10Z","timestamp":1760161930000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/9\/2978"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,23]]},"references-count":38,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["s21092978"],"URL":"https:\/\/doi.org\/10.3390\/s21092978","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,23]]}}}