{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T19:46:04Z","timestamp":1774727164336,"version":"3.50.1"},"reference-count":33,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2024,1,25]],"date-time":"2024-01-25T00:00:00Z","timestamp":1706140800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005357","name":"Slovak Research and Development Agency (APVV)","doi-asserted-by":"publisher","award":["APVV SK-IL-RD-23-0004"],"award-info":[{"award-number":["APVV SK-IL-RD-23-0004"]}],"id":[{"id":"10.13039\/501100005357","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Histological staining is the primary method for confirming cancer diagnoses, but certain types, such as p63 staining, can be expensive and potentially damaging to tissues. In our research, we innovate by generating p63-stained images from H&amp;E-stained slides for metaplastic breast cancer. This is a crucial development, considering the high costs and tissue risks associated with direct p63 staining. Our approach employs an advanced CycleGAN architecture, xAI-CycleGAN, enhanced with context-based loss to maintain structural integrity. The inclusion of convolutional attention in our model distinguishes between structural and color details more effectively, thus significantly enhancing the visual quality of the results. This approach shows a marked improvement over the base xAI-CycleGAN and standard CycleGAN models, offering the benefits of a more compact network and faster training even with the inclusion of attention.<\/jats:p>","DOI":"10.3390\/jimaging10020032","type":"journal-article","created":{"date-parts":[[2024,1,25]],"date-time":"2024-01-25T06:54:12Z","timestamp":1706165652000},"page":"32","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Attention-Enhanced Unpaired xAI-GANs for Transformation of Histological Stain Images"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6817-6297","authenticated-orcid":false,"given":"Tibor","family":"Sloboda","sequence":"first","affiliation":[{"name":"Faculty of Informatics and Information Technology, Slovak Technical University, Ilkovi\u010dova 2, 842 16 Bratislava, Slovakia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1659-0362","authenticated-orcid":false,"given":"Luk\u00e1\u0161","family":"Hudec","sequence":"additional","affiliation":[{"name":"Faculty of Informatics and Information Technology, Slovak Technical University, Ilkovi\u010dova 2, 842 16 Bratislava, Slovakia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8002-9887","authenticated-orcid":false,"given":"Matej","family":"Halinkovi\u010d","sequence":"additional","affiliation":[{"name":"Faculty of Informatics and Information Technology, Slovak Technical University, Ilkovi\u010dova 2, 842 16 Bratislava, Slovakia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6929-9694","authenticated-orcid":false,"given":"Wanda","family":"Benesova","sequence":"additional","affiliation":[{"name":"Faculty of Informatics and Information Technology, Slovak Technical University, Ilkovi\u010dova 2, 842 16 Bratislava, Slovakia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,1,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"E158","DOI":"10.5888\/pcd15.180151","article-title":"Peer Reviewed: Transitions From Heart Disease to Cancer as the Leading Cause of Death in US States, 1999\u20132016","volume":"15","author":"Harding","year":"2018","journal-title":"Prev. Chronic Dis."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"17","DOI":"10.3322\/caac.21763","article-title":"Cancer statistics, 2023","volume":"73","author":"Miller","year":"2023","journal-title":"CA Cancer J. Clin."},{"key":"ref_3","first-page":"118","article-title":"Morphometric Analysis In Benign, Atypical And Invasive Breast Lesions And Its Correlation With Histological Diagnosis, Tumour Grading And Her2 Overexpression","volume":"8","author":"Gahlaut","year":"2016","journal-title":"Diagn. Pathol."},{"key":"ref_4","first-page":"e48557","article-title":"Study of the Immunohistochemical Expression of p63 in Benign Lesions and Carcinoma of the Breast at a Tertiary Hospital in South India","volume":"15","author":"Prabhu","year":"2023","journal-title":"Cureus"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ahmad, I., and Islam, Z. (2021, January 8\u201310). Laryngeal Cancer Lesion Segmentation in p63 Immunohistochemically Stained Histology Images. Proceedings of the 2021 International Conference on BioSMART (BioSMART), Virtual.","DOI":"10.1109\/BioSMART54244.2021.9677811"},{"key":"ref_6","first-page":"139","article-title":"Audit of Prostate Cancer Diagnosis Using p63 and Prostate-Specific Antigen Immunostains at a Tertiary Care Hospital in South-East Nigeria","volume":"4","author":"Amadi","year":"2023","journal-title":"Ann. Int. Health Biomed. Res."},{"key":"ref_7","unstructured":"Kuracinov\u00e1, K.M. Formal In-Person Consultation Arranged for the Specific Purpose of Discussing AI-Based Transformation of Histopathological Images. Personal communication with a Histopathologist."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., Efros, A.A., and Research, B.A. (2017, January 22\u201329). Unpaired Image-To-Image Translation Using Cycle-Consistent Adversarial Networks. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sloboda, T., Hudec, L., and Bene\u0161ov\u00e1, W. (2023, January 11\u201315). Editable Stain Transformation Of Histological Images Using Unpaired GANs. Proceedings of the International Conference on Image Analysis and Processing, Udine, Italy. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-031-51026-7_3"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1038\/s41377-023-01104-7","article-title":"Deep Learning-enabled Virtual Histological Staining of Biological Samples","volume":"12","author":"Bai","year":"2023","journal-title":"Light Sci. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4884","DOI":"10.1038\/s41467-021-25221-2","article-title":"Deep Learning-based Transformation of H&E Stained Tissues Into Special Stains","volume":"12","author":"Zhang","year":"2021","journal-title":"Nat. Commun."},{"key":"ref_12","unstructured":"de Bel, T., Hermsen, M., Kers, J., van der Laak, J., and Litjens, G. (2019, January 8\u201310). Stain-Transforming Cycle-Consistent Generative Adversarial Networks for Improved Segmentation of Renal Histopathology. Proceedings of the International Conference on Medical Imaging with Deep Learning, London, UK."},{"key":"ref_13","unstructured":"Lee, D., Sugiyama, M., Luxburg, U., Guyon, I., and Garnett, R. (2016). Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Chen, H., Yan, S., Xie, M., and Huang, J. (2022). Application of cascaded GAN based on CT scan in the diagnosis of aortic dissection. Comput. Methods Programs Biomed., 226.","DOI":"10.1016\/j.cmpb.2022.107130"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Sloboda, T., Hudec, L., and Bene\u0161ov\u00e1, W. (2023). xAI-CycleGAN, a Cycle-Consistent Generative Assistive Network. arXiv.","DOI":"10.1007\/978-3-031-44137-0_33"},{"key":"ref_16","unstructured":"Nagisetty, V., Graves, L., Scott, J., and Ganesh, V. (2020). xAI-GAN: Enhancing Generative Adversarial Networks via Explainable AI Systems. arXiv."},{"key":"ref_17","unstructured":"Wang, M. (2022). Mask CycleGAN: Unpaired Multi-modal Domain Translation with Interpretable Latent Variable. arXiv."},{"key":"ref_18","unstructured":"Xu, Z., Huang, X., Moro, C.F., Boz\u00f3ky, B., and Zhang, Q. (2022). GAN-based Virtual Re-Staining: A Promising Solution for Whole Slide Image Analysis. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Alimanov, A., and Islam, M.B. (2022, January 22\u201325). Retinal Image Restoration using Transformer and Cycle-Consistent Generative Adversarial Network. Proceedings of the 2022 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS), Penang, Malaysia.","DOI":"10.1109\/ISPACS57703.2022.10082822"},{"key":"ref_20","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An Image is Worth 16 \u00d7 16 Words: Transformers for Image Recognition at Scale. arXiv."},{"key":"ref_21","first-page":"6000","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Shen, Y., and Zhou, B. (2021, January 20\u201325). Closed-Form Factorization of Latent Semantics in GANs. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00158"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Cheng, Y., Gan, Z., Li, Y., Liu, J., and Gao, J. (2020, January 12\u201316). Sequential attention GAN for interactive image editing. Proceedings of the 28th ACM International Conference on Multimedia, Seattle, WA, USA.","DOI":"10.1145\/3394171.3413551"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Pajouheshgar, E., Zhang, T., and S\u00fcsstrunk, S. (2022, January 22\u201327). Optimizing Latent Space Directions for Gan-based Local Image Editing. Proceedings of the ICASSP 2022\u20142022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore.","DOI":"10.1109\/ICASSP43922.2022.9747326"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Collins, E., Bala, R., Price, B., and Susstrunk, S. (2020, January 13\u201319). Editing in Style: Uncovering The Local Semantics of Gans. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00581"},{"key":"ref_26","unstructured":"Institute for Clinical and Experimental Medicine (2023, December 27). Breast Cancer Data. Available online: http:\/\/www.ikem.cz."},{"key":"ref_27","unstructured":"Olympus Corporation (2023, December 22). Olympus VS120 Virtual Slide Microscopy System. Available online: https:\/\/www.olympus-lifescience.com\/en\/solutions-based-systems\/vs120\/."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1145\/2980179.2982423","article-title":"Bilateral Guided Upsampling","volume":"35","author":"Chen","year":"2016","journal-title":"ACM Trans. Graph."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Riba, E., Mishkin, D., Ponsa, D., Rublee, E., and Bradski, G. (2020, January 1\u20135). Kornia: An Open Source Differentiable Computer Vision Library for Pytorch. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, Snowmass Village, CO, USA.","DOI":"10.1109\/WACV45572.2020.9093363"},{"key":"ref_30","unstructured":"Zhang, H., Goodfellow, I., Metaxas, D., and Odena, A. (2019, January 9\u201315). Self-Attention Generative Adversarial Networks. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_31","unstructured":"Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainz, B. (2018). Attention U-Net: Learning Where to Look for the Pancreas. arXiv."},{"key":"ref_32","first-page":"6629","article-title":"GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium","volume":"30","author":"Heusel","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_33","unstructured":"Streamlit (2023, December 10). A Faster Way to Build and Share Data Apps. Available online: https:\/\/streamlit.io\/."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/2\/32\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:49:07Z","timestamp":1760104147000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/2\/32"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,25]]},"references-count":33,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,2]]}},"alternative-id":["jimaging10020032"],"URL":"https:\/\/doi.org\/10.3390\/jimaging10020032","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,25]]}}}