{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T15:46:14Z","timestamp":1780501574223,"version":"3.54.1"},"reference-count":36,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2022,6,20]],"date-time":"2022-06-20T00:00:00Z","timestamp":1655683200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Objective: With the strengths of deep learning, computer-aided diagnosis (CAD) is a hot topic for researchers in medical image analysis. One of the main requirements for training a deep learning model is providing enough data for the network. However, in medical images, due to the difficulties of data collection and data privacy, finding an appropriate dataset (balanced, enough samples, etc.) is quite a challenge. Although image synthesis could be beneficial to overcome this issue, synthesizing 3D images is a hard task. The main objective of this paper is to generate 3D T1 weighted MRI corresponding to FDG-PET. In this study, we propose a separable convolution-based Elicit generative adversarial network (E-GAN). The proposed architecture can reconstruct 3D T1 weighted MRI from 2D high-level features and geometrical information retrieved from a Sobel filter. Experimental results on the ADNI datasets for healthy subjects show that the proposed model improves the quality of images compared with the state of the art. In addition, the evaluation of E-GAN and the state of art methods gives a better result on the structural information (13.73% improvement for PSNR and 22.95% for SSIM compared to Pix2Pix GAN) and textural information (6.9% improvements for homogeneity error in Haralick features compared to Pix2Pix GAN).<\/jats:p>","DOI":"10.3390\/s22124640","type":"journal-article","created":{"date-parts":[[2022,6,22]],"date-time":"2022-06-22T04:12:01Z","timestamp":1655871121000},"page":"4640","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["FDG-PET to T1 Weighted MRI Translation with 3D Elicit Generative Adversarial Network (E-GAN)"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2844-4132","authenticated-orcid":false,"given":"Farideh","family":"Bazangani","sequence":"first","affiliation":[{"name":"Department of Mathematics and Computer Science, CNRS, Aix Marseilles University, UMR, 7249 Marseille, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fr\u00e9d\u00e9ric J. P.","family":"Richard","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, CNRS, Aix Marseilles University, UMR, 7249 Marseille, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Badih","family":"Ghattas","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, CNRS, Aix Marseilles University, UMR, 7249 Marseille, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric","family":"Guedj","sequence":"additional","affiliation":[{"name":"Molecular Neuroimaging, Marseille Public University Hospital System, 13005 Marseille, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,20]]},"reference":[{"key":"ref_1","unstructured":"Antoniou, A., Edwards, H., and Storkey, A. (2018). Data augmentation generative adversarial networks. arXiv."},{"key":"ref_2","first-page":"1744","article-title":"Auto-context and its application to high-level vision tasks and 3d brain image segmentation","volume":"32","author":"Tu","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"646013","DOI":"10.3389\/fnins.2021.646013","article-title":"Bidirectional Mapping of Brain MRI and PET With 3D Reversible GAN for the Diagnosis of Alzheimer\u2019s Disease","volume":"15","author":"Lin","year":"2021","journal-title":"Front. Neurosci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1088\/0031-9155\/61\/2\/791","article-title":"Predicting standard-dose PET image from low-dose PET and multimodal MR images using mapping-based sparse representation","volume":"61","author":"Wang","year":"2016","journal-title":"Phys. Med. Biol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"5301","DOI":"10.1118\/1.4928400","article-title":"Prediction of standard-dose brain PET image by using MRI and low-dose brain [18F] FDG PET images","volume":"42","author":"Kang","year":"2015","journal-title":"Med. Phys."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Sevetlidis, V., Giuffrida, V., and Tsaftaris, S. (2017, January 10). Whole image synthesis using a deep encoder-decoder network. Proceedings of the International Workshop on Simulation and Synthesis in Medical Imaging, Qu\u00e9bec City, QC, Canada.","DOI":"10.1007\/978-3-319-46630-9_13"},{"key":"ref_7","unstructured":"Goodfellow, I., Vinyals, O., and Saxe, A.M. (2014). Generative adversarial nets. Adv. Neural Inf. Process. Syst., 27."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Chartsias, A., Joyce, T., Dharmakumar, R., and Tsaftaris, S.A. (2017, January 10). Adversarial image synthesis for unpaired multi-modal cardiac data. Proceedings of the International Workshop on Simulation and Synthesis in Medical Imaging, Qu\u00e9bec City, QC, Canada.","DOI":"10.1007\/978-3-319-68127-6_1"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2375","DOI":"10.1109\/TMI.2019.2901750","article-title":"Image synthesis in multi-contrast MRI with conditional generative adversarial networks","volume":"38","author":"Dar","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"101944","DOI":"10.1016\/j.media.2020.101944","article-title":"Multi-stream generative adversarial networks for MR image synthesis","volume":"70","author":"Yurt","year":"2021","journal-title":"Med. Image Anal."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2772","DOI":"10.1109\/TMI.2020.2975344","article-title":"Hi-net: Hybrid-fusion network for multi-modal MR image synthesis","volume":"39","author":"Zhou","year":"2020","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"101800","DOI":"10.1016\/j.compmedimag.2020.101800","article-title":"MRI image synthesis with dual discriminator adversarial learning and difficulty-aware attention mechanism for hippocampal subfields segmentation","volume":"86","author":"Ma","year":"2020","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1328","DOI":"10.1109\/TMI.2018.2884053","article-title":"3D auto-context-based locality adaptive multi-modality GANs for PET synthesis","volume":"38","author":"Wang","year":"2018","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yu, B., Zhou, L., Wang, L., Fripp, J., and Bourgeat, P. (2018, January 4\u20137). 3D cGAN based cross-modality MR image synthesis for brain tumor segmentation. Proceedings of the IEEE 15th International Symposium on Biomedical Imaging, Washington, DC, USA.","DOI":"10.1109\/ISBI.2018.8363653"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2772","DOI":"10.1109\/TMI.2019.2895894","article-title":"Ea-GANs: Edge-aware generative adversarial networks for cross-modality MR image synthesis","volume":"38","author":"Yu","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_16","unstructured":"Ouderaa, V., Fa, T., and Worrall, D. (2019). Reversible gans for memory-efficient image-to-image translation. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.-Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Shin, H.C., Tenenholtz, N.A., Rogers, J.K., Schwarz, C.G., Senjem, M.L., Gunter, J.L., Andriole, K.P., and Michalski, M. (2018, January 16). Medical image synthesis for data augmentation and anonymization using generative adversarial networks. Proceedings of the International Workshop on Simulation and Synthesis in Medical Imaging, Granada, Spain.","DOI":"10.1007\/978-3-030-00536-8_1"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1016\/j.neuroimage.2018.03.045","article-title":"3D conditional generative adversarial networks for high-quality PET image estimation at low dose","volume":"174","author":"Wang","year":"2018","journal-title":"Neuroimage"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sikka, A., Peri, V., and Bathula, D. (2018, January 16). MRI to FDG-PET: Cross-modal synthesis using 3d u-net for multi-modal Alzheimer\u2019s classification. Proceedings of the International Workshop on Simulation and Synthesis in Medical Imaging, Granada, Spain.","DOI":"10.1007\/978-3-030-00536-8_9"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1718","DOI":"10.1002\/mrm.28819","article-title":"Three-dimensional self-attention conditional GAN with spectral normalization for multimodal neuroimaging synthesis","volume":"86","author":"Toga","year":"2021","journal-title":"Magn. Reson. Med."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Thanh-Tung, H., and Tran, T. (2020, January 19\u201324). Catastrophic forgetting and mode collapse in GANs. Proceedings of the International Joint Conference on Neural Networks (IJCNN), Glasgow, UK.","DOI":"10.1109\/IJCNN48605.2020.9207181"},{"key":"ref_24","unstructured":"Arjovsky, M., and Bottou, L. (2017). Towards principled methods for training generative adversarial networks. arXiv."},{"key":"ref_25","unstructured":"Arjovsky, M., Chintala, S., and Bottou, L. (2017, January 6\u201311). Wasserstein generative adversarial networks. Proceedings of the International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/TMI.2020.3022591","article-title":"Multi-View Separable Pyramid Network for AD Prediction at MCI Stage by 18 F-FDG Brain PET Imaging","volume":"40","author":"Pan","year":"2020","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Mamalet, F., and Garcia, C. (2012, January 11\u201314). Simplifying convnets for fast learning. Proceedings of the International Conference on Artificial Neural Networks, Lausanne, Switzerland.","DOI":"10.1007\/978-3-642-33266-1_8"},{"key":"ref_28","unstructured":"Zhang, H., Goodfellow, I., Metaxas, D., Metaxas, D., and Odena, A. (2019, January 9\u201315). Self-Attention Generative Adversarial Networks. Proceedings of the International Conference on Machine Learning, PMLR, Long Beach, CA, USA."},{"key":"ref_29","first-page":"37","article-title":"Dynamic thresholding based adaptive canny edge detection","volume":"975","author":"Hossain","year":"2016","journal-title":"Int. J. Comput. Appl."},{"key":"ref_30","first-page":"291","article-title":"Edge detection of images using Sobel operator","volume":"2","author":"Vairalkar","year":"2012","journal-title":"Int. J. Emerg. Technol. Adv. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Mao, X., Li, Q., Xie, H., Lau, R.Y.K., Wang, Z., and Smolley, S.P. (2017, January 22\u201329). Least squares generative adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.304"},{"key":"ref_32","unstructured":"Huszar, F. (2015). How (not) to train your generative model: Scheduled sampling, likelihood, adversary. arXiv."},{"key":"ref_33","unstructured":"Radford, A., Metz, L., and Chintala, S. (2016). Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv."},{"key":"ref_34","unstructured":"Penny, W., Friston, K., Ashburner, J., Kiebel, S., and Nichols, T. (2011). Statistical Parametric Mapping: The Analysis of Functional Brain Images, Elsevier."},{"key":"ref_35","unstructured":"Wu, J., Zhang, C., Xue, T., Freeman, B., and Tenenbaum, J. (2016, January 5\u201310). Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling. Proceedings of the 30th International Conference on Neural Information Processing Systems, Barcelona, Spain."},{"key":"ref_36","first-page":"4531","article-title":"HCo-occurrence matrix and its statistical features as an approach for identification of phase transitions of mesogens","volume":"2","author":"Nageswara","year":"2013","journal-title":"Int. J. Innov. Res. Sci. Eng. Technol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/12\/4640\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:35:30Z","timestamp":1760139330000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/12\/4640"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,20]]},"references-count":36,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,6]]}},"alternative-id":["s22124640"],"URL":"https:\/\/doi.org\/10.3390\/s22124640","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,20]]}}}