{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T16:50:04Z","timestamp":1780764604412,"version":"3.54.1"},"reference-count":39,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2023,10,20]],"date-time":"2023-10-20T00:00:00Z","timestamp":1697760000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100007614","name":"Jouf University","doi-asserted-by":"publisher","award":["IF_JU_2_205"],"award-info":[{"award-number":["IF_JU_2_205"]}],"id":[{"id":"10.13039\/501100007614","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>One of the most prevalent diseases affecting women in recent years is breast cancer. Early breast cancer detection can help in the treatment, lower the infection risk, and worsen the results. This paper presents a hybrid approach for augmentation and segmenting breast cancer. The framework contains two main stages: augmentation and segmentation of ultrasound images. The augmentation of the ultrasounds is applied using generative adversarial networks (GAN) with nonlinear identity block, label smoothing, and a new loss function. The segmentation of the ultrasounds applied a modified U-Net 3+. The hybrid approach achieves efficient results in the segmentation and augmentation steps compared with the other available methods for the same task. The modified version of the GAN with the nonlinear identity block overcomes different types of modified GAN in the ultrasound augmentation process, such as speckle GAN, UltraGAN, and deep convolutional GAN. The modified U-Net 3+ also overcomes the different architectures of U-Nets in the segmentation process. The GAN with nonlinear identity blocks achieved an inception score of 14.32 and a Fr\u00e9chet inception distance of 41.86 in the augmenting process. The GAN with identity achieves a smaller value in Fr\u00e9chet inception distance (FID) and a bigger value in inception score; these results prove the model\u2019s efficiency compared with other versions of GAN in the augmentation process. The modified U-Net 3+ architecture achieved a Dice Score of 95.49% and an Accuracy of 95.67%.<\/jats:p>","DOI":"10.3390\/s23208599","type":"journal-article","created":{"date-parts":[[2023,10,20]],"date-time":"2023-10-20T07:25:22Z","timestamp":1697786722000},"page":"8599","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Breast Ultrasound Images Augmentation and Segmentation Using GAN with Identity Block and Modified U-Net 3+"],"prefix":"10.3390","volume":"23","author":[{"given":"Meshrif","family":"Alruily","sequence":"first","affiliation":[{"name":"College of Computer and Information Sciences, Jouf University, Sakaka 72388, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8623-6847","authenticated-orcid":false,"given":"Wael","family":"Said","sequence":"additional","affiliation":[{"name":"Computer Science Department, Faculty of Computers and Informatics, Zagazig University, Zagazig 44511, Egypt"},{"name":"Computer Science Department, College of Computer Science and Engineering, Taibah University, Medina 42353, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8951-4096","authenticated-orcid":false,"given":"Ayman Mohamed","family":"Mostafa","sequence":"additional","affiliation":[{"name":"College of Computer and Information Sciences, Jouf University, Sakaka 72388, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8571-8828","authenticated-orcid":false,"given":"Mohamed","family":"Ezz","sequence":"additional","affiliation":[{"name":"College of Computer and Information Sciences, Jouf University, Sakaka 72388, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8750-1366","authenticated-orcid":false,"given":"Mahmoud","family":"Elmezain","sequence":"additional","affiliation":[{"name":"Computer Science Department, Faculty of Science, Tanta University, Tanta 31527, Egypt"},{"name":"Computer Science Department, College of Computer Science and Engineering, Taibah University, Yanbu 966144, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/j.ejmp.2021.05.003","article-title":"A review of deep learning based methods for medical image multi-organ segmentation","volume":"85","author":"Fu","year":"2021","journal-title":"Phys. Med."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Gheshlaghi, S.H., Kan, C.N.E., and Ye, D.H. (2021, January 1\u20135). Breast Cancer Histopathological Image Classification with Adversarial Image Synthesis. Proceedings of the 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Virtual.","DOI":"10.1109\/EMBC46164.2021.9630678"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1743","DOI":"10.1007\/s11042-021-11409-7","article-title":"Pneumonia classification using quaternion deep learning","volume":"81","author":"Singh","year":"2022","journal-title":"Multimed. Tools Appl."},{"key":"ref_4","unstructured":"Han, X., Wang, J., Zhou, W., Chang, C., Ying, S., and Shi, J. (2020). Medical Image Computing and Computer Assisted Intervention\u2014MICCAI 2020, Springer International Publishing."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"5023","DOI":"10.1007\/s11831-023-09968-z","article-title":"A Comprehensive Review on Breast Cancer Detection, Classification and Segmentation Using Deep Learning","volume":"30","author":"Abhisheka","year":"2023","journal-title":"Arch. Comput. Methods Eng."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Suh, Y.J., Jung, J., and Cho, B.-J. (2020). Automated Breast Cancer Detection in Digital Mammograms of Various Densities via Deep Learning. J. Pers. Med., 10.","DOI":"10.3390\/jpm10040211"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1148\/radiol.2021203758","article-title":"Deep Learning Predicts Interval and Screening-detected Cancer from Screening Mammograms: A Case-Case-Control Study in 6369 Women","volume":"301","author":"Zhu","year":"2021","journal-title":"Radiology"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.breast.2022.04.003","article-title":"Global guidelines for breast cancer screening: A systematic review","volume":"64","author":"Ren","year":"2022","journal-title":"Breast"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Jiang, Y., Chen, L., Zhang, H., and Xiao, X. (2019). Breast cancer histopathological image classification using convolutional neural networks with small SE-ResNet module. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0214587"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhu, C., Song, F., Wang, Y., Dong, H., Guo, Y., and Liu, J. (2019). Breast cancer histopathology image classification through assembling multiple compact CNNs. BMC Med. Inform. Decis. Mak., 19.","DOI":"10.1186\/s12911-019-0913-x"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chen, Z., Zeng, Z., Shen, H., Zheng, X., Dai, P., and Ouyang, P. (2020). DN-GAN: Denoising generative adversarial networks for speckle noise reduction in optical coherence tomography images. Biomed. Signal Process. Control, 55.","DOI":"10.1016\/j.bspc.2019.101632"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Meng, H., and Guo, F. (2021, January 3\u20135). Image Classification and Generation Based on GAN Model. Proceedings of the 2021 3rd International Conference on Machine Learning, Big Data and Business Intelligence (MLBDBI), Taiyuan, China.","DOI":"10.1109\/MLBDBI54094.2021.00042"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Abedi, M., Hempel, L., Sadeghi, S., and Kirsten, T. (2022). GAN-Based Approaches for Generating Structured Data in the Medical Domain. Appl. Sci., 12.","DOI":"10.3390\/app12147075"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1186\/s40537-019-0197-0","article-title":"A survey on Image Data Augmentation for Deep Learning","volume":"6","author":"Shorten","year":"2019","journal-title":"J. Big Data"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1007\/s10278-017-0033-z","article-title":"Application of Super-Resolution Convolutional Neural Network for Enhancing Image Resolution in Chest CT","volume":"31","author":"Umehara","year":"2018","journal-title":"J. Digit. Imaging"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.neunet.2019.08.025","article-title":"MultiResUNet: Rethinking the U-Net architecture for multimodal biomedical image segmentation","volume":"121","author":"Ibtehaz","year":"2020","journal-title":"Neural Netw."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Jayandhi, G., Jasmine, J.S.L., Seetharaman, R., Joans, S.M., and Joy, R.P. (2022, January 25\u201326). An Effective Segmentation of Breast Cancer Using Modified U-NET. Proceedings of the 2022 8th International Conference on Advanced Computing and Communication Systems (ICACCS), Coimbatore, India.","DOI":"10.1109\/ICACCS54159.2022.9785064"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/TMI.2021.3102622","article-title":"Dual Convolutional Neural Networks for Breast Mass Segmentation and Diagnosis in Mammography","volume":"41","author":"Li","year":"2022","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Huang, H., Lin, L., Tong, R., Hu, H., Zhang, Q., Iwamoto, Y., Han, X., Chen, Y.W., and Wu, J. (2020, January 4\u20138). UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation. Proceedings of the ICASSP 2020\u20132020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.","DOI":"10.1109\/ICASSP40776.2020.9053405"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Robin, M., John, J., and Ravikumar, A. (2021, January 8\u201310). Breast Tumor Segmentation using U-NET. Proceedings of the 2021 5th International Conference on Computing Methodologies and Communication (ICCMC), Erode, India.","DOI":"10.1109\/ICCMC51019.2021.9418447"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1856","DOI":"10.1109\/TMI.2019.2959609","article-title":"UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation","volume":"39","author":"Zhou","year":"2020","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"59037","DOI":"10.1109\/ACCESS.2019.2914873","article-title":"Attention Dense-U-Net for Automatic Breast Mass Segmentation in Digital Mammogram","volume":"7","author":"Li","year":"2019","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Deepak, S., and Ameer, P.M. (2020, January 2\u20134). MSG-GAN Based Synthesis of Brain MRI with Meningioma for Data Augmentation. Proceedings of the 2020 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), Bangalore, India.","DOI":"10.1109\/CONECCT50063.2020.9198672"},{"key":"ref_24","unstructured":"Angelini, E.D., and Landman, B.A. (2019). SPIE Medical Imaging, SPIE."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Gab Allah, A.M., Sarhan, A.M., and Elshennawy, N.M. (2021). Classification of Brain MRI Tumor Images Based on Deep Learning PGGAN Augmentation. Diagnostics, 11.","DOI":"10.3390\/diagnostics11122343"},{"key":"ref_26","unstructured":"Escobar, M., Castillo, A., Romero, A., and Arbel\u00e1ez, P. (2020). Simulation and Synthesis in Medical Imaging, Springer International Publishing."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Fujioka, T., Mori, M., Kubota, K., Kikuchi, Y., Katsuta, L., Adachi, M., Oda, G., Nakagawa, T., Kitazume, Y., and Tateishi, U. (2019). Breast Ultrasound Image Synthesis using Deep Convolutional Generative Adversarial Networks. Diagnostics, 9.","DOI":"10.3390\/diagnostics9040176"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lee, H., Kang, S., and Chung, K. (2023). Robust Data Augmentation Generative Adversarial Network for Object Detection. Sensors, 23.","DOI":"10.3390\/s23010157"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, H., Xu, T., Li, H., Zhang, S., Wang, X., Huang, X., and Metaxas, D. (2017, January 22\u201329). StackGAN: Text to Photo-Realistic Image Synthesis with Stacked Generative Adversarial Networks. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.629"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1007\/s11548-020-02203-1","article-title":"SpeckleGAN: A generative adversarial network with an adaptive speckle layer to augment limited training data for ultrasound image processing","volume":"15","author":"Bargsten","year":"2020","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"104863","DOI":"10.1016\/j.dib.2019.104863","article-title":"Dataset of breast ultrasound images","volume":"28","author":"Gomaa","year":"2020","journal-title":"Data Brief"},{"key":"ref_32","unstructured":"Shah, A. (2023, August 23). Breast Ultrasound Images Dataset. Available online: https:\/\/www.kaggle.com\/datasets\/aryashah2k\/breast-ultrasound-images-dataset."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Patil, A. (2021, January 21\u201322). DCGAN: Deep Convolutional GAN with Attention Module for Remote View Classification. Proceedings of the 2021 International Conference on Forensics, Analytics, Big Data, Security (FABS), Bengaluru, India.","DOI":"10.1109\/FABS52071.2021.9702655"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Piantadosi, G., Sansone, M., and Sansone, C. (2018, January 20\u201324). Breast Segmentation in MRI via U-Net Deep Convolutional Neural Networks. Proceedings of the 2018 24th International Conference on Pattern Recognition (ICPR), Beijing, China.","DOI":"10.1109\/ICPR.2018.8545327"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Alzahrani, Y., and Boufama, B. (2021, January 18\u201320). Breast Ultrasound Image Segmentation Model Based Residual Encoder. Proceedings of the 2021 4th International Conference on Intelligent Robotics and Control Engineering (IRCE), Lanzhou, China.","DOI":"10.1109\/IRCE53649.2021.9570898"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"125523","DOI":"10.1109\/ACCESS.2021.3111131","article-title":"Exploring the U-Net++ Model for Automatic Brain Tumor Segmentation","volume":"9","author":"Micallef","year":"2021","journal-title":"IEEE Access"},{"key":"ref_37","unstructured":"Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainz, B. (2018). Attention U-Net: Learning Where to Look for the Pancreas. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Kurian, N.C., Lehan, A., Verghese, G., Dharamshi, N., Meena, S., Li, M., Liu, F., Gillet, C., Rane, S., and Grigoriadis, A. (2022, January 7\u20139). Deep Multi-Scale U-Net Architecture and Label-Noise Robust Training Strategies for Histopathological Image Segmentation. Proceedings of the 2022 IEEE 22nd International Conference on Bioinformatics and Bioengineering (BIBE), Taichung, Taiwan.","DOI":"10.1109\/BIBE55377.2022.00027"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Wang, Z.H., Liu, Z., Song, Y.Q., and Zhu, Y. (2019, January 22\u201325). Densely connected deep U-Net for abdominal multi-organ segmentation. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8803103"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8599\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:09:01Z","timestamp":1760130541000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8599"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,20]]},"references-count":39,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["s23208599"],"URL":"https:\/\/doi.org\/10.3390\/s23208599","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,20]]}}}