{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T04:04:55Z","timestamp":1783569895971,"version":"3.55.0"},"reference-count":44,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,5,22]],"date-time":"2024-05-22T00:00:00Z","timestamp":1716336000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Neurosci."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>MRI is one of the commonly used diagnostic methods in clinical practice, especially in brain diseases. There are many sequences in MRI, but T1CE images can only be obtained by using contrast agents. Many patients (such as cancer patients) must undergo alignment of multiple MRI sequences for diagnosis, especially the contrast-enhanced magnetic resonance sequence. However, some patients such as pregnant women, children, etc. find it difficult to use contrast agents to obtain enhanced sequences, and contrast agents have many adverse reactions, which can pose a significant risk. With the continuous development of deep learning, the emergence of generative adversarial networks makes it possible to extract features from one type of image to generate another type of image.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We propose a generative adversarial network model with multimodal inputs and end-to-end decoding based on the pix2pix model. For the pix2pix model, we used four evaluation metrics: NMSE, RMSE, SSIM, and PNSR to assess the effectiveness of our generated model.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Through statistical analysis, we compared our proposed new model with pix2pix and found significant differences between the two. Our model outperformed pix2pix, with higher SSIM and PNSR, lower NMSE and RMSE. We also found that the input of T1W images and T2W images had better effects than other combinations, providing new ideas for subsequent work on generating magnetic resonance enhancement sequence images. By using our model, it is possible to generate magnetic resonance enhanced sequence images based on magnetic resonance non-enhanced sequence images.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>This has significant implications as it can greatly reduce the use of contrast agents to protect populations such as pregnant women and children who are contraindicated for contrast agents. Additionally, contrast agents are relatively expensive, and this generation method may bring about substantial economic benefits.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fncom.2024.1365238","type":"journal-article","created":{"date-parts":[[2024,5,22]],"date-time":"2024-05-22T13:51:25Z","timestamp":1716385885000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Multi-sequence generative adversarial network: better generation for enhanced magnetic resonance imaging images"],"prefix":"10.3389","volume":"18","author":[{"given":"Leizi","family":"Li","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingchun","family":"Yu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yijin","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinbo","family":"Wei","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruifang","family":"Fan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dieen","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yufeng","family":"Ye","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,5,22]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"430","DOI":"10.2214\/AJR.09.3099","article-title":"Acute adverse reactions to gadopentetate dimeglumine and gadobenate dimeglumine: Experience with 32,659 injections.","volume":"194","author":"Abujudeh","year":"2010","journal-title":"AJR Am. J Roentgenol."},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2107.02314","article-title":"The RSNA-ASNR-MICCAI BraTS 2021 benchmark on brain tumor segmentation and radiogenomic classification.","author":"Baid","year":"2021","journal-title":"arXiv [Preprint]."},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2017.117","article-title":"Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features.","volume":"4","author":"Bakas","year":"","journal-title":"Sci. Data"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.7937\/K9\/TCIA.2017.KLXWJJ1Q","article-title":"Segmentation labels and radiomic features for the pre-operative scans of the TCGA-GBM collection.","author":"Bakas","year":"","journal-title":"Cancer Imaging Arch."},{"key":"B5","author":"Bi","year":"2017","journal-title":"Synthesis of Positron Emission Tomography (PET) Images via Multi-channel Generative Adversarial Networks (GANs). Molecular Imaging, Reconstruction and Analysis of Moving Body Organs, and Stroke Imaging and Treatment."},{"key":"B6","doi-asserted-by":"publisher","first-page":"W307","DOI":"10.2214\/AJR.07.3951","article-title":"Assessment of adverse reaction rates to a newly approved MRI contrast agent: Review of 23,553 administrations of gadobenate dimeglumine.","volume":"191","author":"Bleicher","year":"2008","journal-title":"AJR Am. J. Roentgenol."},{"key":"B7","doi-asserted-by":"publisher","first-page":"803","DOI":"10.1109\/TMI.2017.2764326","article-title":"Multimodal MR synthesis via modality-invariant latent representation.","volume":"37","author":"Chartsias","year":"2018","journal-title":"IEEE Trans. Med. Imaging"},{"key":"B8","doi-asserted-by":"publisher","first-page":"2375","DOI":"10.1109\/TMI.2019.2901750","article-title":"Image synthesis in multi-contrast MRI with conditional generative adversarial networks.","volume":"38","author":"Dar","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"B9","doi-asserted-by":"publisher","first-page":"663","DOI":"10.1002\/mrm.28148","article-title":"A transfer-learning approach for accelerated MRI using deep neural networks.","volume":"84","author":"Dar","year":"","journal-title":"Magn. Reson. Med."},{"key":"B10","doi-asserted-by":"publisher","first-page":"1072","DOI":"10.1109\/JSTSP.2020.3001737","article-title":"Prior-guided image reconstruction for accelerated multi-contrast MRI via generative adversarial networks.","volume":"14","author":"Dar","year":"","journal-title":"IEEE J. Select. Top. Signal Proc."},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2023.1203104","article-title":"Generative AI for brain image computing and brain network computing: A review.","volume":"17","author":"Gong","year":"2023","journal-title":"Front. Neurosci."},{"key":"B12","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1145\/3422622","article-title":"Generative adversarial networks.","volume":"63","author":"Goodfellow","year":"2020","journal-title":"Commun. ACM"},{"key":"B13","doi-asserted-by":"publisher","first-page":"1060","DOI":"10.1002\/jmri.23725","article-title":"MRI contrast agents: Basic chemistry and safety.","volume":"36","author":"Hao","year":"2012","journal-title":"J. Magn. Reson. Imaging"},{"key":"B14","author":"Hiasa","year":"2018","journal-title":"Cross-Modality Image Synthesis from Unpaired Data Using CycleGAN. Simulation and Synthesis in Medical Imaging."},{"key":"B15","author":"Hong","year":"2021","journal-title":"3D-StyleGAN: A Style-Based Generative Adversarial Network for Generative Modeling of Three-Dimensional Medical Images. Deep Generative Models, and Data Augmentation, Labelling, and Imperfections."},{"key":"B16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TNNLS.2023.3266819","article-title":"3-D brain reconstruction by hierarchical shape-perception network from a single incomplete image.","volume":"99","author":"Hu","year":"2023","journal-title":"IEEE Trans Neural Netw. Learn. Syst."},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2021.108021","article-title":"Semi-supervised NPC segmentation with uncertainty and attention guided consistency.","volume":"239","author":"Hu","year":"2022","journal-title":"Knowledge-Based Systems"},{"key":"B18","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1109\/TMI.2021.3107013","article-title":"Bidirectional mapping generative adversarial networks for brain MR to PET synthesis.","volume":"41","author":"Hu","year":"2022","journal-title":"IEEE Trans. Med. Imaging"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1109\/NICS.2015.7302186","article-title":"Fast and formalized: Heuristics-based on-the-fly web service composition and verification","author":"Huynh","year":"2015","journal-title":"Proceedings of the 2nd National Foundation for Science and Technology Development Conference on Information and Computer Science (NICS)"},{"key":"B20","article-title":"Image-to-image translation with conditional adversarial networks","author":"Isola","year":"2017","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1412.6980","article-title":"Adam: A method for stochastic optimization.","author":"Kingma","year":"2014","journal-title":"arXiv [Preprint]."},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2022.108324","article-title":"Explainable attention guided adversarial deep network for 3D radiotherapy dose distribution prediction.","volume":"241","author":"Li","year":"2022","journal-title":"Knowl. Based Syst."},{"key":"B23","doi-asserted-by":"publisher","first-page":"884","DOI":"10.1002\/jmri.20955","article-title":"MR contrast agents: Physical and pharmacologic basics.","volume":"25","author":"Lin","year":"2007","journal-title":"J. Magn. Reson. Imaging"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.102335","article-title":"Adaptive rectification based adversarial network with spectrum constraint for high-quality PET image synthesis.","volume":"77","author":"Luo","year":"2022","journal-title":"Med. Image Anal."},{"key":"B25","doi-asserted-by":"publisher","first-page":"1993","DOI":"10.1109\/TMI.2014.2377694","article-title":"The multimodal brain tumor image segmentation benchmark (BRATS).","volume":"34","author":"Menze","year":"2015","journal-title":"IEEE Trans. Med. Imaging"},{"key":"B26","article-title":"Medical image synthesis with context-aware generative adversarial networks","author":"Nie","year":"2017","journal-title":"Medical Image Computing and Computer Assisted Intervention - MICCAI 2017"},{"key":"B27","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-00320-3_18","article-title":"Generative adversarial training for MRA image synthesis using multi-contrast MRI","author":"Olut","year":"2018","journal-title":"Predictive Intelligence in Medicine"},{"key":"B28","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1007\/978-3-030-88010-1_39","article-title":"Characterization multimodal connectivity of brain network by hypergraph GAN for Alzheimer\u2019s disease analysis.","volume":"13021","author":"Pan","year":"2021","journal-title":"Pattern Recogn. Comput. Vis."},{"key":"B29","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1007\/978-3-319-46630-9_15","article-title":"Patch based synthesis of whole head MR images: Application to EPI distortion correction.","volume":"9968","author":"Roy","year":"2016","journal-title":"Simul. Synth. Med. Imaging"},{"key":"B30","doi-asserted-by":"publisher","first-page":"944","DOI":"10.2214\/ajr.177.4.1770944","article-title":"Allergic reactions to gadolinium chelates.","volume":"177","author":"Runge","year":"2001","journal-title":"AJR Am. J. Roentgenol."},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2022.108566","article-title":"ASMFS: Adaptive-similarity-based multi-modality feature selection for classification of Alzheimer\u2019s disease.","volume":"126","author":"Shi","year":"2022","journal-title":"Pattern Recogn."},{"key":"B32","doi-asserted-by":"publisher","first-page":"291","DOI":"10.2174\/187152007780618135","article-title":"MRI contrast agents: Current status and future perspectives.","volume":"7","author":"Strijkers","year":"2007","journal-title":"Anti Cancer Agents Med. Chem."},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2022.102254","article-title":"ISSMF: Integrated semantic and spatial information of multi-level features for automatic segmentation in prenatal ultrasound images.","volume":"125","author":"Sun","year":"2022","journal-title":"Artif. Intell. Med."},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2022.108215","article-title":"Unified medical image segmentation by learning from uncertainty in an end-to-end manner.","volume":"241","author":"Tang","year":"2022","journal-title":"Knowl. Based Syst."},{"key":"B35","doi-asserted-by":"publisher","first-page":"2100","DOI":"10.1109\/TMI.2020.2964310","article-title":"Deep learning of imaging phenotype and genotype for predicting overall survival time of glioblastoma patients.","volume":"39","author":"Tang","year":"2020","journal-title":"IEEE Trans. Med. Imaging"},{"key":"B36","doi-asserted-by":"publisher","first-page":"2619","DOI":"10.1007\/s00330-006-0495-8","article-title":"Nephrogenic systemic fibrosis: A serious late adverse reaction to gadodiamide.","volume":"16","author":"Thomsen","year":"2006","journal-title":"Eur. Radiol."},{"key":"B37","doi-asserted-by":"publisher","first-page":"957","DOI":"10.1021\/acs.chemrev.8b00363","article-title":"Chemistry of MRI contrast agents: Current challenges and new frontiers.","volume":"119","author":"Wahsner","year":"2018","journal-title":"Chem. Rev."},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2022.102447","article-title":"Semi-supervised medical image segmentation via a tripled-uncertainty guided mean teacher model with contrastive learning.","volume":"79","author":"Wang","year":"2022","journal-title":"Med. Image Anal."},{"key":"B39","doi-asserted-by":"publisher","first-page":"550","DOI":"10.1016\/j.neuroimage.2018.03.045","article-title":"3D conditional generative adversarial networks for high-quality PET image estimation at low dose.","volume":"174","author":"Wang","year":"2018","journal-title":"NeuroImage"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.3390\/s19102361","article-title":"Deep MR to CT synthesis using unpaired data","author":"Wolterink","year":"2017","journal-title":"Simulation and Synthesis in Medical Imaging"},{"key":"B41","doi-asserted-by":"publisher","first-page":"406","DOI":"10.1016\/j.neucom.2017.06.048","article-title":"Deep auto-context convolutional neural networks for standard-dose PET image estimation from low-dose PET\/MRI.","volume":"267","author":"Xiang","year":"2017","journal-title":"Neurocomputing"},{"key":"B42","doi-asserted-by":"publisher","first-page":"1750","DOI":"10.1109\/TMI.2019.2895894","article-title":"Ea-GANs: Edge-aware generative adversarial networks for cross-modality MR image synthesis.","volume":"38","author":"Yu","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.102339","article-title":"Multi-constraint generative adversarial network for dose prediction in radiotherapy.","volume":"77","author":"Zhan","year":"","journal-title":"Med. Image Anal."},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2022.109362","article-title":"D2FE-GAN: Decoupled dual feature extraction based GAN for MRI image synthesis.","volume":"252","author":"Zhan","year":"","journal-title":"Knowl. Based Syst"}],"container-title":["Frontiers in Computational Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2024.1365238\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,22]],"date-time":"2024-05-22T13:51:37Z","timestamp":1716385897000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2024.1365238\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,22]]},"references-count":44,"alternative-id":["10.3389\/fncom.2024.1365238"],"URL":"https:\/\/doi.org\/10.3389\/fncom.2024.1365238","relation":{},"ISSN":["1662-5188"],"issn-type":[{"value":"1662-5188","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,22]]},"article-number":"1365238"}}