{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T14:55:20Z","timestamp":1780066520075,"version":"3.54.0"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"19","license":[{"start":{"date-parts":[[2021,1,18]],"date-time":"2021-01-18T00:00:00Z","timestamp":1610928000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,1,18]],"date-time":"2021-01-18T00:00:00Z","timestamp":1610928000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["NRF-2019R1A2C1090713"],"award-info":[{"award-number":["NRF-2019R1A2C1090713"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2022,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We consider medical image transformation problems where a grayscale image is transformed into a color image. The colorized medical image should have the same features as the input image because extra synthesized features can increase the possibility of diagnostic errors. In this paper, to secure colorized medical images and improve the quality of synthesized images, as well as to leverage unpaired training image data, a colorization network is proposed based on the cycle generative adversarial network (CycleGAN) model, combining a perceptual loss function and a total variation (TV) loss function. Visual comparisons and experimental indicators from the NRMSE, PSNR, and SSIM metrics are used to evaluate the performance of the proposed method. The experimental results show that GAN-based style conversion can be applied to colorization of medical images. As well, the introduction of perceptual loss and TV loss can improve the quality of images produced as a result of colorization better than the result generated by only using the CycleGAN model.<\/jats:p>","DOI":"10.1007\/s11042-020-10468-6","type":"journal-article","created":{"date-parts":[[2021,1,19]],"date-time":"2021-01-19T00:04:24Z","timestamp":1611014664000},"page":"26669-26683","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Unpaired medical image colorization using generative adversarial network"],"prefix":"10.1007","volume":"81","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6254-9969","authenticated-orcid":false,"given":"Yihuai","family":"Liang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dongho","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3950-4575","authenticated-orcid":false,"given":"Yan","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7742-4846","authenticated-orcid":false,"given":"Byeong-Seok","family":"Shin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,1,18]]},"reference":[{"key":"10468_CR1","unstructured":"Anwar S, Tahir M, Li C, Mian A, Khan FS, Muzaffar AW (Nov. 2020) Image colorization: a survey and dataset, arXiv:2008.10774 [cs, eess]. Accessed: Nov. 09, 2020. [Online]. Available: http:\/\/arxiv.org\/abs\/2008.10774."},{"key":"10468_CR2","doi-asserted-by":"crossref","unstructured":"Charpiat G, Hofmann M, Sch\u00f6lkopf B (2008) Automatic image colorization via multimodal predictions. in European conference on computer vision:126\u2013139","DOI":"10.1007\/978-3-540-88690-7_10"},{"key":"10468_CR3","doi-asserted-by":"crossref","unstructured":"Cheng Z, Yang Q, Sheng B (2015) Deep colorization. in Proceedings of the IEEE International Conference on Computer Vision:415\u2013423","DOI":"10.1109\/ICCV.2015.55"},{"key":"10468_CR4","unstructured":"Chetlur S et al. (2014) cudnn: Efficient primitives for deep learning. arXiv preprint arXiv:1410.0759"},{"issue":"6","key":"10468_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2070781.2024190","volume":"30","author":"AY-S Chia","year":"2011","unstructured":"Chia AY-S, Zhuo S, Gupta RK, Tai YW, Cho SY, Tan P, Lin S (Dec. 2011) Semantic colorization with internet images. ACM Trans Graph 30(6):1\u20138. https:\/\/doi.org\/10.1145\/2070781.2024190","journal-title":"ACM Trans Graph"},{"key":"10468_CR6","unstructured":"DRIVE - Grand Challenge, grand-challenge.org. https:\/\/drive.grand-challenge.org\/ (accessed Jul. 27, 2020)."},{"issue":"6","key":"10468_CR7","doi-asserted-by":"publisher","first-page":"645","DOI":"10.1016\/j.jacc.2007.10.030","volume":"51","author":"Y Fukumoto","year":"2008","unstructured":"Fukumoto Y, Hiro T, Fujii T, Hashimoto G, Fujimura T, Yamada J, Okamura T, Matsuzaki M (2008) Localized elevation of shear stress is related to coronary plaque rupture: a 3-dimensional intravascular ultrasound study with in-vivo color mapping of shear stress distribution. J Am Coll Cardiol 51(6):645\u2013650","journal-title":"J Am Coll Cardiol"},{"key":"10468_CR8","doi-asserted-by":"crossref","unstructured":"Furusawa C, Hiroshiba K, Ogaki K, Odagiri Y (2017) Comicolorization: semi-automatic manga colorization. in SIGGRAPH Asia 2017 Technical Briefs:1\u20134","DOI":"10.1145\/3145749.3149430"},{"key":"10468_CR9","unstructured":"Goodfellow I et al (2014) Generative adversarial nets. Adv Neural Inf Proces Syst:2672\u20132680"},{"key":"10468_CR10","unstructured":"G\u00f3rriz M, Mrak M, Smeaton AF, O\u2019Connor NE (2019) End-to-end conditional GAN-based architectures for image colourisation. In: 2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP), 27\u201329 Sept 2019, Kuala Lumpur, Malaysia, pp 1\u20136"},{"key":"10468_CR11","doi-asserted-by":"crossref","unstructured":"Huang Y-C, Tung Y-S, Chen J-C, Wang S-W, Wu J-L (2005) An adaptive edge detection based colorization algorithm and its applications. in Proceedings of the 13th annual ACM international conference on Multimedia:351\u2013354","DOI":"10.1145\/1101149.1101223"},{"issue":"4","key":"10468_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2897824.2925974","volume":"35","author":"S Iizuka","year":"2016","unstructured":"Iizuka S, Simo-Serra E, Ishikawa H (2016) Let there be color! Joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification. ACM Transactions on Graphics (ToG) 35(4):1\u201311","journal-title":"ACM Transactions on Graphics (ToG)"},{"key":"10468_CR13","unstructured":"Image-to-Image Translation in PyTorch, https:\/\/github.com\/junyanz\/pytorch-CycleGAN-and-pix2pix, Accessed 26 July, 2020"},{"key":"10468_CR14","unstructured":"Ironi R, Cohen-Or D, Lischinski D (2005) Colorization by example. in Rendering Techniques:201\u2013210"},{"key":"10468_CR15","doi-asserted-by":"crossref","unstructured":"Isola P, Zhu J-Y, Zhou T, Efros AA (2017) Image-to-image translation with conditional adversarial networks. in Proceedings of the IEEE conference on computer vision and pattern recognition:1125\u20131134","DOI":"10.1109\/CVPR.2017.632"},{"key":"10468_CR16","doi-asserted-by":"crossref","unstructured":"Jing Y, Yang Y, Feng Z, Ye J, Yu Y, Song M (2019) Neural style transfer: a review. IEEE transactions on visualization and computer graphics","DOI":"10.1109\/TVCG.2019.2921336"},{"key":"10468_CR17","doi-asserted-by":"crossref","unstructured":"Johnson J, Alahi A, Fei-Fei L (2016) Perceptual losses for real-time style transfer and super-resolution. in European conference on computer vision:694\u2013711","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"10468_CR18","unstructured":"Kingma DP, Ba J (2014) Adam: A method for stochastic optimization, arXiv preprint arXiv:1412.6980"},{"key":"10468_CR19","doi-asserted-by":"crossref","unstructured":"Larsson G, Maire M, Shakhnarovich G (2016) Learning representations for automatic colorization. in European conference on computer vision:577\u2013593","DOI":"10.1007\/978-3-319-46493-0_35"},{"key":"10468_CR20","doi-asserted-by":"crossref","unstructured":"Ledig C et al (2017) Photo-realistic single image super-resolution using a generative adversarial network. in Proceedings of the IEEE conference on computer vision and pattern recognition:4681\u20134690","DOI":"10.1109\/CVPR.2017.19"},{"issue":"1","key":"10468_CR21","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1186\/s13673-020-00220-2","volume":"10","author":"D-H Lee","year":"2020","unstructured":"Lee D-H, Li Y, Shin B-S (Apr. 2020) Generalization of intensity distribution of medical images using GANs. Human-centric Computing and Information Sciences 10(1):17. https:\/\/doi.org\/10.1186\/s13673-020-00220-2","journal-title":"Human-centric Computing and Information Sciences"},{"key":"10468_CR22","doi-asserted-by":"crossref","unstructured":"Levin A, Lischinski D, Weiss Y (2004) Colorization using optimization. in ACM SIGGRAPH 2004 Papers:689\u2013694","DOI":"10.1145\/1015706.1015780"},{"issue":"9","key":"10468_CR23","doi-asserted-by":"publisher","first-page":"4606","DOI":"10.1109\/TIP.2019.2912291","volume":"28","author":"B Li","year":"2019","unstructured":"Li B, Lai Y, John M, Rosin PL (Sep. 2019) Automatic example-based image colorization using location-aware cross-scale matching. IEEE Trans Image Process 28(9):4606\u20134619. https:\/\/doi.org\/10.1109\/TIP.2019.2912291","journal-title":"IEEE Trans Image Process"},{"key":"10468_CR24","unstructured":"Luan Q, Wen F, Cohen-Or D, Liang L, Xu Y-Q, Shum H-Y (2007) Natural image colorization. in Proceedings of the 18th Eurographics conference on Rendering Techniques:309\u2013320"},{"key":"10468_CR25","doi-asserted-by":"publisher","unstructured":"Mehri A, Sappa AD (Jun. 2019) Colorizing near infrared images through a cyclic adversarial approach of unpaired samples, in 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Long Beach, CA, USA, pp. 971\u2013979. https:\/\/doi.org\/10.1109\/CVPRW.2019.00128.","DOI":"10.1109\/CVPRW.2019.00128"},{"key":"10468_CR26","unstructured":"Mirza M, Osindero S (2014) Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784"},{"key":"10468_CR27","doi-asserted-by":"crossref","unstructured":"Morimoto Y, Taguchi Y, Naemura T (2009) Automatic colorization of grayscale images using multiple images on the web. in SIGGRAPH 2009: Talks:1\u20131","DOI":"10.1145\/1597990.1598049"},{"key":"10468_CR28","doi-asserted-by":"crossref","unstructured":"Nazeri K, Ng E, Ebrahimi M (2018) Image colorization using generative adversarial networks. in International conference on articulated motion and deformable objects:85\u201394","DOI":"10.1007\/978-3-319-94544-6_9"},{"issue":"1","key":"10468_CR29","first-page":"171","volume":"16","author":"Y-S Park","year":"2020","unstructured":"Park Y-S, Lee J-W (2020) Class-labeling method for designing a deep neural network of capsule endoscopic images using a lesion-focused knowledge model. J Inf Process Syst 16(1):171\u2013183","journal-title":"J Inf Process Syst"},{"key":"10468_CR30","unstructured":"PyTorch. https:\/\/www.pytorch.org (accessed Jul. 27, 2020)."},{"issue":"3","key":"10468_CR31","doi-asserted-by":"publisher","first-page":"1214","DOI":"10.1145\/1141911.1142017","volume":"25","author":"Y Qu","year":"2006","unstructured":"Qu Y, Wong T-T, Heng P-A (2006) Manga colorization. ACM Transactions on Graphics (TOG) 25(3):1214\u20131220","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"10468_CR32","doi-asserted-by":"crossref","unstructured":"Sharma M et al (2019) Robust image colorization using self attention based progressive generative adversarial network. in 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW):2188\u20132196","DOI":"10.1109\/CVPRW.2019.00272"},{"key":"10468_CR33","doi-asserted-by":"publisher","first-page":"1647","DOI":"10.1109\/ACCESS.2017.2779875","volume":"6","author":"Q Song","year":"2017","unstructured":"Song Q, Xu F, Jin Y-Q (2017) Radar image colorization: converting single-polarization to fully polarimetric using deep neural networks. IEEE Access 6:1647\u20131661","journal-title":"IEEE Access"},{"key":"10468_CR34","doi-asserted-by":"crossref","unstructured":"Su J-W, Chu H-K, Huang J-B (2020) Instance-aware image colorization. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","DOI":"10.1109\/CVPR42600.2020.00799"},{"key":"10468_CR35","unstructured":"Taigman Y, Polyak A, Wolf L (2016) Unsupervised cross-domain image generation. arXiv preprint arXiv:1611.02200"},{"issue":"7","key":"10468_CR36","doi-asserted-by":"publisher","first-page":"1756","DOI":"10.1109\/TMM.2020.2976573","volume":"22","author":"S Wan","year":"2020","unstructured":"Wan S, Xia Y, Qi L, Yang Y, Atiquzzaman M (Jul. 2020) Automated colorization of a Grayscale image with seed points propagation. IEEE Transactions on Multimedia 22(7):1756\u20131768. https:\/\/doi.org\/10.1109\/TMM.2020.2976573","journal-title":"IEEE Transactions on Multimedia"},{"key":"10468_CR37","doi-asserted-by":"crossref","unstructured":"Welsh T, Ashikhmin M, Mueller K (2002) Transferring color to greyscale images. in Proceedings of the 29th annual conference on Computer graphics and interactive techniques:277\u2013280","DOI":"10.1145\/566654.566576"},{"issue":"5","key":"10468_CR38","doi-asserted-by":"publisher","first-page":"1120","DOI":"10.1109\/TIP.2005.864231","volume":"15","author":"L Yatziv","year":"2006","unstructured":"Yatziv L, Sapiro G (2006) Fast image and video colorization using chrominance blending. IEEE Trans Image Process 15(5):1120\u20131129","journal-title":"IEEE Trans Image Process"},{"key":"10468_CR39","doi-asserted-by":"publisher","first-page":"101552","DOI":"10.1016\/j.media.2019.101552","volume":"58","author":"X Yi","year":"2019","unstructured":"Yi X, Walia E, Babyn P (2019) Generative adversarial network in medical imaging: a review. Med Image Anal 58:101552","journal-title":"Med Image Anal"},{"issue":"1","key":"10468_CR40","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1186\/s13673-018-0158-1","volume":"8","author":"SD You","year":"2018","unstructured":"You SD, Liu C-H, Chen W-K (Nov. 2018) Comparative study of singing voice detection based on deep neural networks and ensemble learning. Human-centric Computing and Information Sciences 8(1):34. https:\/\/doi.org\/10.1186\/s13673-018-0158-1","journal-title":"Human-centric Computing and Information Sciences"},{"issue":"2","key":"10468_CR41","first-page":"204","volume":"13","author":"N Yu","year":"2017","unstructured":"Yu N, Yu Z, Gu F, Li T, Tian X, Pan Y (Apr. 2017) Deep learning in genomic and medical image data analysis: challenges and approaches. Journal of Information Processing Systems 13(2):204\u2013214","journal-title":"Journal of Information Processing Systems"},{"key":"10468_CR42","doi-asserted-by":"crossref","unstructured":"Zhang R, Isola P, Efros AA (2016) Colorful image colorization. in European conference on computer vision:649\u2013666","DOI":"10.1007\/978-3-319-46487-9_40"},{"key":"10468_CR43","doi-asserted-by":"crossref","unstructured":"Zhang R, et al. (2017) Real-time user-guided image colorization with learned deep priors. arXiv preprint arXiv:1705.02999","DOI":"10.1145\/3072959.3073703"},{"key":"10468_CR44","doi-asserted-by":"crossref","unstructured":"Zhu J-Y, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. in Proceedings of the IEEE international conference on computer vision:2223\u20132232","DOI":"10.1109\/ICCV.2017.244"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-10468-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-020-10468-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-10468-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,19]],"date-time":"2022-07-19T07:10:15Z","timestamp":1658214615000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-020-10468-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,18]]},"references-count":44,"journal-issue":{"issue":"19","published-print":{"date-parts":[[2022,8]]}},"alternative-id":["10468"],"URL":"https:\/\/doi.org\/10.1007\/s11042-020-10468-6","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"value":"1380-7501","type":"print"},{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,18]]},"assertion":[{"value":"31 March 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 November 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 December 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 January 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}