{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T09:55:06Z","timestamp":1760954106464,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2021,5,17]],"date-time":"2021-05-17T00:00:00Z","timestamp":1621209600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"FCT - Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","award":["SFRH\/BD\/135834\/2018"],"award-info":[{"award-number":["SFRH\/BD\/135834\/2018"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>The scarcity of balanced and annotated datasets has been a recurring problem in medical image analysis. Several researchers have tried to fill this gap employing dataset synthesis with adversarial networks (GANs). Breast magnetic resonance imaging (MRI) provides complex, texture-rich medical images, with the same annotation shortage issues, for which, to the best of our knowledge, no previous work tried synthesizing data. Within this context, our work addresses the problem of synthesizing breast MRI images from corresponding annotations and evaluate the impact of this data augmentation strategy on a semantic segmentation task. We explored variations of image-to-image translation using conditional GANs, namely fitting the generator\u2019s architecture with residual blocks and experimenting with cycle consistency approaches. We studied the impact of these changes on visual verisimilarity and how an U-Net segmentation model is affected by the usage of synthetic data. We achieved sufficiently realistic-looking breast MRI images and maintained a stable segmentation score even when completely replacing the dataset with the synthetic set. Our results were promising, especially when concerning to Pix2PixHD and Residual CycleGAN architectures.<\/jats:p>","DOI":"10.3390\/app11104554","type":"journal-article","created":{"date-parts":[[2021,5,17]],"date-time":"2021-05-17T12:19:57Z","timestamp":1621253997000},"page":"4554","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Adversarial Data Augmentation on Breast MRI Segmentation"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4132-635X","authenticated-orcid":false,"given":"Jo\u00e3o F.","family":"Teixeira","sequence":"first","affiliation":[{"name":"INESC TEC, 4200-465 Porto, Portugal"},{"name":"Faculty of Engineering, University of Porto, 4099-002 Porto, Portugal"}]},{"given":"Mariana","family":"Dias","sequence":"additional","affiliation":[{"name":"INESC TEC, 4200-465 Porto, Portugal"}]},{"given":"Eva","family":"Batista","sequence":"additional","affiliation":[{"name":"Breast Unit, Champalimaud Clinical Centre, Champalimaud Foundation, 1400-038 Lisbon, Portugal"}]},{"given":"Joana","family":"Costa","sequence":"additional","affiliation":[{"name":"Breast Unit, Champalimaud Clinical Centre, Champalimaud Foundation, 1400-038 Lisbon, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4050-7880","authenticated-orcid":false,"given":"Lu\u00eds F.","family":"Teixeira","sequence":"additional","affiliation":[{"name":"INESC TEC, 4200-465 Porto, Portugal"},{"name":"Faculty of Engineering, University of Porto, 4099-002 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6193-8540","authenticated-orcid":false,"given":"H\u00e9lder P.","family":"Oliveira","sequence":"additional","affiliation":[{"name":"INESC TEC, 4200-465 Porto, Portugal"},{"name":"Faculty of Sciences, University of Porto, 4099-002 Porto, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,17]]},"reference":[{"key":"ref_1","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative Adversarial Nets. Advances in Neural Information Processing Systems 27 (NIPS2014), MIT Press."},{"key":"ref_2","unstructured":"Radford, A., Metz, L., and Chintala, S. (2016, January 2\u20134). Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. Proceedings of the 4th International Conference on Learning Representations, San Juan, Puerto Rico."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ledig, C., Theis, L., Husz\u00e1r, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2017, January 21\u201326). Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.19"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2720","DOI":"10.1109\/TBME.2018.2814538","article-title":"Medical Image Synthesis with Deep Convolutional Adversarial Networks","volume":"65","author":"Nie","year":"2018","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_5","unstructured":"Kaiser, B., and Albarqouni, S. (2019). MRI to CT Translation with GANs. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Tsaftaris, S.A., Gooya, A., Frangi, A.F., and Prince, J.L. (2017). Deep MR to CT Synthesis Using Unpaired Data. Simulation and Synthesis in Medical Imaging, Springer.","DOI":"10.1007\/978-3-319-68127-6"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2375","DOI":"10.1109\/TMI.2019.2901750","article-title":"Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networks","volume":"38","author":"Dar","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Rekik, I., Unal, G., Adeli, E., and Park, S.H. (2018). Generative Adversarial Training for MRA Image Synthesis Using Multi-contrast MRI. Predictive Intelligence in MEdicine (PRIME2018), Springer.","DOI":"10.1007\/978-3-030-00320-3"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/j.neucom.2018.09.013","article-title":"GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification","volume":"321","author":"Diamant","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Han, C., Hayashi, H., Rundo, L., Araki, R., Shimoda, W., Muramatsu, S., Furukawa, Y., Mauri, G., and Nakayama, H. (2018, January 4\u20137). GAN-based synthetic brain MR image generation. Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), Washington, DC, USA.","DOI":"10.1109\/ISBI.2018.8363678"},{"key":"ref_11","unstructured":"Sanchez, I., and Vilaplana, V. (2018). Brain MRI super-resolution using 3D generative adversarial networks. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"101684","DOI":"10.1016\/j.compmedimag.2019.101684","article-title":"MedGAN: Medical image translation using GANs","volume":"79","author":"Armanious","year":"2020","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Shin, H.C., Tenenholtz, N.A., Rogers, J.K., Schwarz, C.G., Senjem, M.L., Gunter, J.L., Andriole, K.P., and Michalski, M. (2018). Medical Image Synthesis for Data Augmentation and Anonymization Using Generative Adversarial Networks. Simulation and Synthesis in Medical Imaging, Springer.","DOI":"10.1007\/978-3-030-00536-8_1"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1109\/TMI.2017.2759102","article-title":"End-to-End Adversarial Retinal Image Synthesis","volume":"37","author":"Costa","year":"2018","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Vedaldi, A., Bischof, H., Brox, T., and Frahm, J.M. (2020). Contrastive Learning for Unpaired Image-to-Image Translation. Computer Vision\u2014ECCV 2020, Springer.","DOI":"10.1007\/978-3-030-58592-1"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wang, T.C., Liu, M.Y., Zhu, J.Y., Tao, A., Kautz, J., and Catanzaro, B. (2018, January 23). High-resolution image synthesis and semantic manipulation with conditional gans. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00917"},{"key":"ref_18","unstructured":"Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., and Hochreiter, S. (2017, January 4\u20139). GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_19","unstructured":"Wang, Z., Simoncelli, E.P., and Bovik, A.C. (2003, January 9\u201312). Multiscale structural similarity for image quality assessment. Proceedings of the Thirty-Seventh Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Navab, N., Hornegger, J., Wells, W., and Frangi, A. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015, Springer.","DOI":"10.1007\/978-3-319-24571-3"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhu, J., Park, T., Isola, P., and Efros, A. (2017, January 22\u201329). Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_23","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1109\/TMI.2018.2858752","article-title":"Deep Generative Adversarial Neural Networks for Compressive Sensing MRI","volume":"38","author":"Mardani","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1109\/TMI.2017.2764326","article-title":"Multimodal MR Synthesis via Modality-Invariant Latent Representation","volume":"37","author":"Chartsias","year":"2018","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_26","unstructured":"Karras, T., Aila, T., Laine, S., and Lehtinen, J. (2018, January 30). Progressive growing of GANs for improved quality, stability and variation. Proceedings of the 6th International Conference on Learning Representations (ICLR2018), Vancouver, BC, Canada."},{"key":"ref_27","unstructured":"Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., and Chen, X. (2016, January 4\u20139). Improved Techniques for Training GANs. Proceedings of the 30th International Conference on Neural Information Processing Systems, Barcelona, Spain."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.cviu.2018.10.009","article-title":"Pros and cons of GAN evaluation measures","volume":"179","author":"Borji","year":"2019","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, Q., Shi, Y., Suk, H.I., and Suzuki, K. (2017). Tversky Loss Function for Image Segmentation Using 3D Fully Convolutional Deep Networks. Machine Learning in Medical Imaging, Springer.","DOI":"10.1007\/978-3-319-67389-9"},{"key":"ref_30","unstructured":"Cardoso, M., Arbel, T., Carneiro, G., Syeda-Mahmood, T., Tavares, J., Moradi, M., Bradley, A., Greenspan, H., Papa, J., and Madabhushi, A. (2017). Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Springer."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Crimi, A., and Bakas, S. (2020). Optimization with Soft Dice Can Lead to a Volumetric Bias. Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries, Springer.","DOI":"10.1007\/978-3-030-46640-4"},{"key":"ref_32","unstructured":"Teixeira, J.F. (2021, May 15). Anatomical Label Maps to Breast MRI-Repository. Available online: https:\/\/gitlab.inesctec.pt\/ippr-pub\/labels2breastmri."},{"key":"ref_33","unstructured":"Alexandre, M. (2020, November 03). UNet: Semantic Segmentation with PyTorch-Repository. Available online: https:\/\/github.com\/milesial\/Pytorch-U-Net."}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/11\/10\/4554\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:02:33Z","timestamp":1760162553000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/11\/10\/4554"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,17]]},"references-count":33,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["app11104554"],"URL":"https:\/\/doi.org\/10.3390\/app11104554","relation":{},"ISSN":["2076-3417"],"issn-type":[{"type":"electronic","value":"2076-3417"}],"subject":[],"published":{"date-parts":[[2021,5,17]]}}}