{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T20:32:17Z","timestamp":1773693137308,"version":"3.50.1"},"reference-count":41,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2022,5,26]],"date-time":"2022-05-26T00:00:00Z","timestamp":1653523200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science and Technology Research Program of Chongqing Municipal Education Commission","award":["KJQN202100620"],"award-info":[{"award-number":["KJQN202100620"]}]},{"name":"Science and Technology Research Program of Chongqing Municipal Education Commission","award":["cstc2020jcyj-msxmX0687"],"award-info":[{"award-number":["cstc2020jcyj-msxmX0687"]}]},{"name":"Natural Science Foundation of Chongqing Province of China","award":["KJQN202100620"],"award-info":[{"award-number":["KJQN202100620"]}]},{"name":"Natural Science Foundation of Chongqing Province of China","award":["cstc2020jcyj-msxmX0687"],"award-info":[{"award-number":["cstc2020jcyj-msxmX0687"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Magnetic resonance (MR) imaging is an important computer-aided diagnosis technique with rich pathological information. The factor of physical and physiological constraint seriously affects the applicability of that technique. Thus, computed tomography (CT)-based radiotherapy is more popular on account of its imaging rapidity and environmental simplicity. Therefore, it is of great theoretical and practical significance to design a method that can construct an MR image from the corresponding CT image. In this paper, we treat MR imaging as a machine vision problem and propose a multi-conditional constraint generative adversarial network (GAN) for MR imaging from CT scan data. Considering reversibility of GAN, both generator and reverse generator are designed for MR and CT imaging, respectively, which can constrain each other and improve consistency between features of CT and MR images. In addition, we innovatively treat the real and generated MR image discrimination as object re-identification; cosine error fusing with original GAN loss is designed to enhance verisimilitude and textural features of the MR image. The experimental results with the challenging public CT-MR image dataset show distinct performance improvement over other GANs utilized in medical imaging and demonstrate the effect of our method for medical image modal transformation.<\/jats:p>","DOI":"10.3390\/s22114043","type":"journal-article","created":{"date-parts":[[2022,5,31]],"date-time":"2022-05-31T02:30:06Z","timestamp":1653964206000},"page":"4043","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Multi-Conditional Constraint Generative Adversarial Network-Based MR Imaging from CT Scan Data"],"prefix":"10.3390","volume":"22","author":[{"given":"Mingjie","family":"Liu","sequence":"first","affiliation":[{"name":"Automation School, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2189-6657","authenticated-orcid":false,"given":"Wei","family":"Zou","sequence":"additional","affiliation":[{"name":"Automation School, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wentao","family":"Wang","sequence":"additional","affiliation":[{"name":"Automation School, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8486-5738","authenticated-orcid":false,"given":"Cheng-Bin","family":"Jin","sequence":"additional","affiliation":[{"name":"HUYA Incorporation, Guangzhou 511446, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junsheng","family":"Chen","sequence":"additional","affiliation":[{"name":"Automation School, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Changhao","family":"Piao","sequence":"additional","affiliation":[{"name":"Automation School, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Vaughan, J.T., Snyder, C., DelaBarre, L., Tian, J., Akgun, C., Ugurbil, K., Olson, C., and Gopinath, A. (2006, January 11\u201316). Current and Future Trends in Magnetic Resonance Imaging (MRI). Proceedings of the 2006 IEEE MTT-S International Microwave Symposium Digest, Piscataway, NJ, USA.","DOI":"10.1109\/MWSYM.2006.249451"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-018-20713-6","article-title":"Effect of tube current on computed tomography radiomic features","volume":"8","author":"Mackin","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1002\/(SICI)1522-2594(200001)43:1<116::AID-MRM14>3.0.CO;2-5","article-title":"Validation of MR-based polymer gel dosimetry as a preclinical three-dimensional verification tool in conformal radiotherapy","volume":"43","author":"Derycke","year":"2000","journal-title":"Magn. Reson. Med. Off. J. Int. Soc. Magn. Reson. Med."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1109\/TMI.2011.2174158","article-title":"Realistic Analytical Phantoms for Parallel Magnetic Resonance Imaging","volume":"31","author":"Lejeune","year":"2012","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","article-title":"A survey on deep learning in medical image analysis","volume":"42","author":"Litjens","year":"2017","journal-title":"Med. Image Anal."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2720","DOI":"10.1109\/TBME.2018.2814538","article-title":"Medical Image Synthesis with Deep Convolutional Adversarial Networks","volume":"65","author":"Nie","year":"2018","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yu, B., Zhou, L., Wang, L., Fripp, J., and Bourgeat, P. (2018, January 4\u20137). 3D cGAN based cross-modality MR image synthesis for brain tumor segmentation. Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), Washington, DC, USA.","DOI":"10.1109\/ISBI.2018.8363653"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1109\/TMI.2015.2461533","article-title":"Estimating CT Image From MRI Data Using Structured Random Forest and Auto-Context Model","volume":"35","author":"Huynh","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Jog, A., Carass, A., and Prince, J.L. (May, January 29). Improving magnetic resonance resolution with supervised learning. Proceedings of the 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI), Beijing China.","DOI":"10.1109\/ISBI.2014.6868038"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1431","DOI":"10.2967\/jnumed.109.069112","article-title":"Toward implementing an MRI-based PET attenuation-correction method for neurologic studies on the MR-PET brain prototype","volume":"51","author":"Catana","year":"2010","journal-title":"J. Nucl. Med."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4742","DOI":"10.1118\/1.4958676","article-title":"A patch-based pseudo-CT approach for MRI-only radiotherapy in the pelvis","volume":"43","author":"Andreasen","year":"2016","journal-title":"Med. Phys."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"6531","DOI":"10.1088\/0031-9155\/61\/17\/6531","article-title":"Atlas-guided generation of pseudo-CT images for MRI-only and hybrid PET-MRI-guided radiotherapy treatment planning","volume":"61","author":"Arabi","year":"2016","journal-title":"Phys. Med. Biol."},{"key":"ref_13","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20138). Imagenet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems 25 (NIPS 2012), Lake Tahoe, NV, USA."},{"key":"ref_14","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (July, January 26). Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhao, C., Carass, A., Lee, J., He, Y., and Prince, J.L. (2017, January 10). Whole brain segmentation and labeling from CT using synthetic MR images. Proceedings of the International Workshop on Machine Learning in Medical Imaging, Quebec City, QC, Canada.","DOI":"10.1007\/978-3-319-67389-9_34"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1136\/jnnp-2012-303821","article-title":"Voxel-wise mapping of cervical cord damage in multiple sclerosis patients with different clinical phenotypes","volume":"84","author":"Rocca","year":"2013","journal-title":"J. Neurol. Neurosurg. Psychiatry"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Nie, D., Trullo, R., Lian, J., Petitjean, C., Ruan, S., Wang, Q., and Shen, D. (2017, January 10\u201314). Medical image synthesis with context-aware generative adversarial networks. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Quebec City, QC, Canada.","DOI":"10.1007\/978-3-319-66179-7_48"},{"key":"ref_20","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8\u201313). Generative adversarial nets. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1408","DOI":"10.1002\/mp.12155","article-title":"MR-based synthetic CT generation using a deep convolutional neural network method","volume":"44","author":"Han","year":"2017","journal-title":"Med. Phys."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Bi, L., Kim, J., Kumar, A., Feng, D.G., and Fulham, M. (2017, January 14). Synthesis of Positron Emission Tomography (PET) Images via Multi-channel Generative Adversarial Networks (GANs). Proceedings of the 5th International Workshop on Computat Methods for Mol Imaging (CMMI)\/2nd International Workshop on Reconstruct & Analysis of Moving Body Organs (RAMBO)\/1st International Stroke Workshop on Imaging & Treatment Challenges (SWITCH), Quebec City, QC, Canada.","DOI":"10.1007\/978-3-319-67564-0_5"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ben-Cohen, A., Klang, E., Raskin, S.P., Amitai, M.M., and Greenspan, H. (2017, January 10). Virtual PET images from CT data using deep convolutional networks: Initial results. Proceedings of the International Workshop on Simulation and Synthesis in Medical Imaging, Quebec City, QC, Canada.","DOI":"10.1007\/978-3-319-68127-6_6"},{"key":"ref_24","unstructured":"Kim, T., Cha, M., Kim, H., Lee, J.K., and Kim, J. (2017, January 6\u201311). Learning to Discover Cross-Domain Relations with Generative Adversarial Networks. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wolterink, J.M., Dinkla, A.M., Savenije, M.H., Seevinck, P.R., van den Berg, C.A., and I\u0161gum, I. (2017, January 10). Deep MR to CT synthesis using unpaired data. Proceedings of the International Workshop on Simulation and Synthesis in Medical Imaging, Quebec City, QC, Canada.","DOI":"10.1007\/978-3-319-68127-6_2"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Jin, C.B., Kim, H., Liu, M., Jung, W., Joo, S., Park, E., Ahn, Y.S., Han, I.H., Lee, J.I., and Cui, X. (2019). Deep CT to MR Synthesis Using Paired and Unpaired Data. Sensors, 19.","DOI":"10.3390\/s19102361"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Jin, C.-B., Kim, H., Liu, M., Han, I.H., Lee, J.I., Lee, J.H., Joo, S., Park, E., Ahn, Y.S., and Cui, X. (2019). DC2Anet: Generating Lumbar Spine MR Images from CT Scan Data Based on Semi-Supervised Learning. Appl. Sci., 9.","DOI":"10.3390\/app9122521"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Yi, Z., Zhang, H., Tan, P., and Gong, M. (2017, January 22\u201329). DualGAN: Unsupervised dual learning for image-to-image translation. Proceedings of the Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.310"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1088","DOI":"10.1109\/TPAMI.2018.2823766","article-title":"Detecting Regions of Maximal Divergence for Spatio-Temporal Anomaly Detection","volume":"41","author":"Barz","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1223","DOI":"10.21037\/qims-19-885","article-title":"Magnetic resonance image (MRI) synthesis from brain computed tomography (CT) images based on deep learning methods for magnetic resonance (MR)-guided radiotherapy","volume":"10","author":"Li","year":"2020","journal-title":"Quant. Imaging Med. Surg."},{"key":"ref_32","unstructured":"Mirza, M., and Osindero, S. Conditional generative adversarial nets. arXiv, 2014."},{"key":"ref_33","unstructured":"Vondrick, C., Pirsiavash, H., and Torralba, A. (2016, January 5\u201310). Generating Videos with Scene Dynamics. Proceedings of the Advances in Neural Information Processing Systems 29 (NIPS 2016), Barcelona, Spain."},{"key":"ref_34","unstructured":"Denton, E.L., Chintala, S., and Fergus, R. (2015, January 7\u201312). Deep generative image models using a Laplacian pyramid of adversarial networks. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Johnson, J., Alahi, A., and Fei-Fei, L. (2016, January 8\u201316). Perceptual losses for real-time style transfer and super-resolution. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"He, K.M., Zhang, X.Y., Ren, S.Q., and Sun, J. (2016, January 27\u201330). IEEE. Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_37","unstructured":"Ulyanov, D., Vedaldi, A., and Lempitsky, V. (2016). Instance normalization: The missing ingredient for fast stylization. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/S0375-9601(00)00725-8","article-title":"Extended tanh-function method and its applications to nonlinear equations","volume":"277","author":"Fan","year":"2000","journal-title":"Phys. Lett. A"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.-Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-image translation with conditional adversarial networks. Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_40","unstructured":"Xu, B., Wang, N., Chen, T., and Li, M. (2015). Empirical evaluation of rectified activations in convolutional network. arXiv."},{"key":"ref_41","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/11\/4043\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:19:21Z","timestamp":1760138361000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/11\/4043"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,26]]},"references-count":41,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2022,6]]}},"alternative-id":["s22114043"],"URL":"https:\/\/doi.org\/10.3390\/s22114043","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,26]]}}}