{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T02:16:39Z","timestamp":1777428999109,"version":"3.51.4"},"reference-count":24,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,11,10]],"date-time":"2020-11-10T00:00:00Z","timestamp":1604966400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,11,10]],"date-time":"2020-11-10T00:00:00Z","timestamp":1604966400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Hum. Cent. Comput. Inf. Sci."],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>With recent advances in deep learning research, generative models have achieved great achievements and play an increasingly important role in current industrial applications. At the same time, technologies derived from generative methods are also under a wide discussion with researches, such as style transfer, image synthesis and so on. In this work, we treat generative methods as a possible solution to medical image augmentation. We proposed a context-aware generative framework, which can successfully change the gray scale of CT scans but almost without any semantic loss. By producing target images that with specific style \/ distribution, we greatly increased the robustness of segmentation model after adding generations into training set. Besides, we improved 2\u2013\u20094% pixel segmentation accuracy over original U-NET in terms of spine segmentation. Lastly, we compared generations produced by networks when using different feature extractors (Vgg, ResNet and DenseNet) and made a detailed analysis on their performances over style transfer.<\/jats:p>","DOI":"10.1186\/s13673-020-00251-9","type":"journal-article","created":{"date-parts":[[2020,11,10]],"date-time":"2020-11-10T13:09:58Z","timestamp":1605013798000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Medical image processing with contextual style transfer"],"prefix":"10.1186","volume":"10","author":[{"given":"Yin","family":"Xu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yan","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Byeong-Seok","family":"Shin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,11,10]]},"reference":[{"key":"251_CR1","doi-asserted-by":"publisher","first-page":"649","DOI":"10.1007\/978-3-319-46487-9_40","volume-title":"Computer Vision\u2014ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part III","author":"R Zhang","year":"2016","unstructured":"Zhang R, Isola P, Efros AA (2016) Colorful image colorization. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer Vision\u2014ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part III. Springer, Cham, pp 649\u2013666"},{"key":"251_CR2","doi-asserted-by":"publisher","DOI":"10.1101\/507780","author":"F Galkin","year":"2018","unstructured":"Galkin F, Aliper A, Putin E et al (2018) Human microbiome aging clocks based on deep learning and tandem of permutation feature importance and accumulated local effects. bioRxiv. https:\/\/doi.org\/10.1101\/507780","journal-title":"bioRxiv"},{"key":"251_CR3","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In\u00a0Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"251_CR4","doi-asserted-by":"crossref","unstructured":"Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In\u00a0Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700\u20134708","DOI":"10.1109\/CVPR.2017.243"},{"key":"251_CR5","unstructured":"Nam H, Kim H-E (2018) Batch-instance normalization for adaptively style-invariant neural networks.\u00a0Advances in Neural Information Processing Systems"},{"issue":"13","key":"251_CR6","doi-asserted-by":"publisher","first-page":"2919","DOI":"10.3390\/s19132919","volume":"19","author":"W He","year":"2019","unstructured":"He W, Xie Z, Li Y, Wang X, Cai W (2019) Synthesizing depth hand images with GANs and style transfer for hand pose estimation. Sensors 19(13):2919","journal-title":"Sensors"},{"key":"251_CR7","doi-asserted-by":"crossref","unstructured":"Chang B, Zhang Q, Pan S, Meng L (2018) Generating handwritten chinese characters using cyclegan. In\u00a02018 IEEE Winter Conference on Applications of Computer Vision (WACV), IEEE, pp 199\u2013207","DOI":"10.1109\/WACV.2018.00028"},{"key":"251_CR8","doi-asserted-by":"crossref","unstructured":"Gatys LA, Ecker AS, Bethge M (2016) Image style transfer using convolutional neural networks. In\u00a0Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2414\u20132423","DOI":"10.1109\/CVPR.2016.265"},{"key":"251_CR9","doi-asserted-by":"crossref","unstructured":"Huang X, Belongie S (2017) Arbitrary style transfer in real-time with adaptive instance normalization. In\u00a0Proceedings of the IEEE International Conference on Computer Vision, pp 1501\u20131510","DOI":"10.1109\/ICCV.2017.167"},{"key":"251_CR10","doi-asserted-by":"crossref","unstructured":"Zhu J-Y, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In\u00a0Proceedings of the IEEE international conference on computer vision, pp 2223\u20132232","DOI":"10.1109\/ICCV.2017.244"},{"key":"251_CR11","unstructured":"Liu M-Y, Breuel T, Kautz J (2017) Unsupervised image-to-image translation networks. In\u00a0Advances in neural information processing systems, pp 700\u2013708"},{"key":"251_CR12","doi-asserted-by":"crossref","unstructured":"Wolterink JM, Dinkla AM, Savenije MHF, Seevinck PR, van den Berg CAT, I\u0161gum I (2017) Deep MR to CT synthesis using unpaired data. In\u00a0International workshop on simulation and synthesis in medical imaging, Springer, Cham, pp 14\u201323","DOI":"10.1007\/978-3-319-68127-6_2"},{"key":"251_CR13","doi-asserted-by":"crossref","unstructured":"Huang X, Liu M-Y, Belongie S, Kautz J (2018) Multimodal unsupervised image-to-image translation. In\u00a0Proceedings of the European Conference on Computer Vision (ECCV), pp 172\u2013189","DOI":"10.1007\/978-3-030-01219-9_11"},{"key":"251_CR14","unstructured":"Zhu J-Y, Zhang R, Pathak D, Darrell T, Efros AA, Wang O, Shechtman E (2017) Toward multimodal image-to-image translation. In\u00a0Advances in neural information processing systems, pp 465\u2013476"},{"key":"251_CR15","doi-asserted-by":"crossref","unstructured":"Frid-Adar M, Klang E, Amitai M, Goldberger J, Greenspan H (2018) Synthetic data augmentation using GAN for improved liver lesion classification. In\u00a02018 IEEE 15th international symposium on biomedical imaging (ISBI 2018), IEEE, pp 289\u2013293","DOI":"10.1109\/ISBI.2018.8363576"},{"key":"251_CR16","doi-asserted-by":"publisher","first-page":"1348","DOI":"10.1109\/TMI.2018.2827462","volume":"37","author":"Q Yang","year":"2018","unstructured":"Yang Q, Yan P, Zhang Y, Yu H, Shi Y, Mou X, Kalra MK, Zhang Y, Sun L, Wang G (2018) Low-dose CT image denoising using a generative adversarial network with Wasserstein distance and perceptual loss. IEEE Trans Med Imag 37:1348\u20131357","journal-title":"IEEE Trans Med Imag"},{"key":"251_CR17","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1007\/978-3-319-24574-4_28","volume-title":"Medical Image Computing and Computer-Assisted Intervention\u2013MICCAI 2015: 18th International Conference, Munich, Germany, October 5\u20139, 2015 Proceedings, Part III","author":"O Ronneberger","year":"2015","unstructured":"Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells WM, Frangi AF (eds) Medical Image Computing and Computer-Assisted Intervention\u2013MICCAI 2015: 18th International Conference, Munich, Germany, October 5\u20139, 2015 Proceedings, Part III. Springer, Cham, pp 234\u2013241"},{"key":"251_CR18","unstructured":"Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition.\u00a0arXiv preprint arXiv:1409.1556"},{"key":"251_CR19","first-page":"768","volume-title":"Computer Vision\u2014ECCV 2018: 15th European Conference, Munich, Germany, September 8\u201314, 2018, Proceedings, Part XIV","author":"R Mechrez","year":"2018","unstructured":"Mechrez R, Talmi I, Zelnik-Manor L (2018) The contextual loss for image transformation with non-aligned data. In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y (eds) Computer Vision\u2014ECCV 2018: 15th European Conference, Munich, Germany, September 8\u201314, 2018, Proceedings, Part XIV. Springer, Cham, pp 768\u2013783"},{"issue":"2","key":"251_CR20","doi-asserted-by":"publisher","first-page":"1056","DOI":"10.1021\/acs.nanolett.5b04190","volume":"16","author":"C Zhao","year":"2016","unstructured":"Zhao C, Ng TK, Wei N, Prabaswara A, Alias MS, Janjua B, Shen C, Ooi BS (2016) Facile formation of high-quality InGaN\/GaN quantum-disks-in-nanowires on bulk-metal substrates for high-power light-emitters. Nano Lett 16(2):1056\u20131063","journal-title":"Nano Lett"},{"key":"251_CR21","unstructured":"Li Y, Fang C, Yang J, Wang Z, Lu X, Yang M-H (2017) Universal style transfer via feature transforms. In\u00a0Advances in neural information processing systems, pp 386\u2013396"},{"key":"251_CR22","doi-asserted-by":"publisher","first-page":"5328","DOI":"10.1016\/j.eswa.2015.02.017","volume":"42","author":"H Liao","year":"2015","unstructured":"Liao H, Xu Z (2015) Approaches to manage hesitant fuzzy linguistic information based on the cosine distance and similarity measures for HFLTSs and their application in qualitative decision making. Expert Syst Appl 42:5328\u20135336","journal-title":"Expert Syst Appl"},{"key":"251_CR23","doi-asserted-by":"crossref","unstructured":"Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In\u00a0Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2818\u20132826","DOI":"10.1109\/CVPR.2016.308"},{"key":"251_CR24","unstructured":"Chu C, Zhmoginov A, Sandler M (2017) Cyclegan, a master of steganography.\u00a0arXiv preprint arXiv:1712.02950"}],"container-title":["Human-centric Computing and Information Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13673-020-00251-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13673-020-00251-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13673-020-00251-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T12:27:42Z","timestamp":1627648062000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s13673-020-00251-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,10]]},"references-count":24,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["251"],"URL":"https:\/\/doi.org\/10.1186\/s13673-020-00251-9","relation":{},"ISSN":["2192-1962"],"issn-type":[{"value":"2192-1962","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,10]]},"assertion":[{"value":"4 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 October 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 November 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Agree.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Agree.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"46"}}