{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T15:54:25Z","timestamp":1778169265390,"version":"3.51.4"},"reference-count":54,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2021,7,9]],"date-time":"2021-07-09T00:00:00Z","timestamp":1625788800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,9]],"date-time":"2021-07-09T00:00:00Z","timestamp":1625788800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"National Science Foundation","award":["CAREER 1149783"],"award-info":[{"award-number":["CAREER 1149783"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Vis"],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Caricature is an artistic drawing created to abstract or exaggerate facial features of a person. Rendering visually pleasing caricatures is a difficult task that requires professional skills, and thus it is of great interest to design a method to automatically generate such drawings. To deal with large shape changes, we propose an algorithm based on a semantic shape transform to produce diverse and plausible shape exaggerations. Specifically, we predict pixel-wise semantic correspondences and perform image warping on the input photo to achieve dense shape transformation. We show that the proposed framework is able to render visually pleasing shape exaggerations while maintaining their facial structures. In addition, our model allows users to manipulate the shape via the semantic map. We demonstrate the effectiveness of our approach on a large photograph-caricature benchmark dataset with comparisons to the state-of-the-art methods.<\/jats:p>","DOI":"10.1007\/s11263-021-01489-1","type":"journal-article","created":{"date-parts":[[2021,7,9]],"date-time":"2021-07-09T06:02:40Z","timestamp":1625810560000},"page":"2663-2679","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Learning to Caricature via Semantic Shape Transform"],"prefix":"10.1007","volume":"129","author":[{"given":"Wenqing","family":"Chu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei-Chih","family":"Hung","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yi-Hsuan","family":"Tsai","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu-Ting","family":"Chang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yijun","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Deng","family":"Cai","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4848-2304","authenticated-orcid":false,"given":"Ming-Hsuan","family":"Yang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,7,9]]},"reference":[{"key":"1489_CR1","doi-asserted-by":"crossref","unstructured":"Aberman, K,. Liao, J., Shi, M., Lischinski, D., Chen, B., & Cohen-Or, D. (2018). Neural best-buddies: Sparse cross-domain correspondence. ACM TOG.","DOI":"10.1145\/3197517.3201332"},{"key":"1489_CR2","doi-asserted-by":"crossref","unstructured":"Akleman, E. (1997). Making caricatures with morphing. In ACM SIGGRAPH (p. 145).","DOI":"10.1145\/259081.259231"},{"key":"1489_CR3","unstructured":"Akleman, E., Palmer, J., & Logan, R. (2000). Making extreme caricatures with a new interactive 2d deformation technique with simplicial complexes. In Proceedings of visual."},{"key":"1489_CR4","unstructured":"Arjovsky, M., Chintala, S., & Bottou, L. (2017). Wasserstein generative adversarial networks. In ICML."},{"key":"1489_CR5","first-page":"324","volume":"39","author":"RA Bradley","year":"1952","unstructured":"Bradley, R. A., & Terry, M. E. (1952). Rank analysis of incomplete block designs: I. The method of paired comparisons. Biometrika, 39, 324\u2013345.","journal-title":"Biometrika"},{"issue":"4","key":"1489_CR6","doi-asserted-by":"publisher","first-page":"392","DOI":"10.1162\/leon.2007.40.4.392","volume":"40","author":"SE Brennan","year":"2007","unstructured":"Brennan, S. E. (2007). Caricature generator: The dynamic exaggeration of faces by computer. Leonardo, 40(4), 392\u2013400.","journal-title":"Leonardo"},{"key":"1489_CR7","doi-asserted-by":"crossref","unstructured":"Cao, K., Liao, J., & Yuan, L. (2018). Carigans: Unpaired photo-to-caricature translation. ACM TOG","DOI":"10.1145\/3272127.3275046"},{"key":"1489_CR8","doi-asserted-by":"crossref","unstructured":"Chang, H., Lu, J., Yu, F., & Finkelstein, A. (2018). Pairedcyclegan: Asymmetric style transfer for applying and removing makeup. In CVPR.","DOI":"10.1109\/CVPR.2018.00012"},{"key":"1489_CR9","doi-asserted-by":"crossref","unstructured":"Chen, D., Yuan, L., Liao, J., Yu, N., & Hua, G. (2017). Stylebank: An explicit representation for neural image style transfer. In CVPR.","DOI":"10.1109\/CVPR.2017.296"},{"key":"1489_CR10","doi-asserted-by":"crossref","unstructured":"Chen, K., Zheng, J., Cai, J., & Zhang, J. (2020). Modeling caricature expressions by 3d blendshape and dynamic texture. In Proceedings of the 28th ACM international conference on multimedia (pp. 3228\u20133236).","DOI":"10.1145\/3394171.3413643"},{"key":"1489_CR11","doi-asserted-by":"crossref","unstructured":"Chopra, S., Hadsell, R., & LeCun, Y. (2005). Learning a similarity discriminatively, with application to face verification. In CVPR.","DOI":"10.1109\/CVPR.2005.202"},{"key":"1489_CR12","doi-asserted-by":"crossref","unstructured":"Chu, W., Hung, W.C., Tsai, Y.H., Cai, D., & Yang, M.H. (2019). Weakly-supervised caricature face parsing through domain adaptation. In ICIP.","DOI":"10.1109\/ICIP.2019.8803517"},{"issue":"5","key":"1489_CR13","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1109\/34.1000236","volume":"24","author":"D Comaniciu","year":"2002","unstructured":"Comaniciu, D., & Meer, P. (2002). Mean shift: A robust approach toward feature space analysis. PAMI, 24(5), 603\u2013619.","journal-title":"PAMI"},{"key":"1489_CR14","doi-asserted-by":"crossref","unstructured":"Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017). Deformable convolutional networks. In ICCV.","DOI":"10.1109\/ICCV.2017.89"},{"key":"1489_CR15","doi-asserted-by":"crossref","unstructured":"Ganin, Y., Kononenko, D., Sungatullina, D., & Lempitsky, V. (2016). Deepwarp: Photorealistic image resynthesis for gaze manipulation. In ECCV.","DOI":"10.1007\/978-3-319-46475-6_20"},{"key":"1489_CR16","doi-asserted-by":"crossref","unstructured":"Gatys, L., Ecker, A. S., & Bethge, M. (2015). Texture synthesis using convolutional neural networks. In NIPS.","DOI":"10.1109\/CVPR.2016.265"},{"key":"1489_CR17","doi-asserted-by":"crossref","unstructured":"Gatys, L. A., Ecker, A. S., & Bethge, M. (2016). Image style transfer using convolutional neural networks. In CVPR.","DOI":"10.1109\/CVPR.2016.265"},{"key":"1489_CR18","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014). Generative adversarial nets. In NIPS."},{"key":"1489_CR19","doi-asserted-by":"crossref","unstructured":"Guenter, B., Grimm, C., Wood, D., Malvar, H., & Pighin, F. (1998). Making faces. In Proceedings of the 25th annual conference on computer graphics and interactive techniques (pp. 55\u201366).","DOI":"10.1145\/280814.280822"},{"key":"1489_CR20","unstructured":"Han, X., Hou, K., Du, D., Qiu, Y., Cui, S., Zhou, K., & Yu, Y. (2018). Caricatureshop: Personalized and photorealistic caricature sketching. IEEE Transactions on Visualization and Computer Graphics."},{"key":"1489_CR21","unstructured":"Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., & Hochreiter, S. (2017). Gans trained by a two time-scale update rule converge to a local nash equilibrium. In NIPS (pp. 6626\u20136637)."},{"key":"1489_CR22","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der\u00a0Maaten, L., & Weinberger, K. Q. (2017). Densely connected convolutional networks. In CVPR.","DOI":"10.1109\/CVPR.2017.243"},{"key":"1489_CR23","doi-asserted-by":"crossref","unstructured":"Huang, X., & Belongie, S. J. (2017). Arbitrary style transfer in real-time with adaptive instance normalization. In ICCV.","DOI":"10.1109\/ICCV.2017.167"},{"key":"1489_CR24","doi-asserted-by":"crossref","unstructured":"Huang, X., Liu, M. Y., Belongie, S., & Kautz, J. (2018). Multimodal unsupervised image-to-image translation. In ECCV.","DOI":"10.1007\/978-3-030-01219-9_11"},{"key":"1489_CR25","unstructured":"Huo, J., Li, W., Shi, Y., Gao, Y., & Yin, H. (2018). Webcaricature: A benchmark for caricature recognition. In BMVC."},{"key":"1489_CR26","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., & Efros, A. A. (2017). Image-to-image translation with conditional adversarial networks. In CVPR.","DOI":"10.1109\/CVPR.2017.632"},{"key":"1489_CR27","unstructured":"Jaderberg, M., Simonyan, K., Zisserman, A., & kavukcuoglu, K. (2015). Spatial transformer networks. In NIPS."},{"key":"1489_CR28","unstructured":"Jian, B., & Vemuri, B. C. (2010). Robust point set registration using gaussian mixture models. PAMI."},{"key":"1489_CR29","doi-asserted-by":"crossref","unstructured":"Johnson, J., Alahi, A., & Fei-Fei, L. (2016). Perceptual losses for real-time style transfer and super-resolution. In ECCV.","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"1489_CR30","unstructured":"Kim, T., Cha, M., Kim, H., Lee, J. K., & Kim, J. (2017). Learning to discover cross-domain relations with generative adversarial networks. In ICML."},{"key":"1489_CR31","unstructured":"Kingma, D. P., & Ba, J. (2015). Adam: A method for stochastic optimization. In ICLR"},{"key":"1489_CR32","doi-asserted-by":"crossref","unstructured":"Lee, H. Y., Tseng, H. Y., Huang, J. B., Singh, M. K., & Yang, M. H. (2018). Diverse image-to-image translation via disentangled representations. In ECCV.","DOI":"10.1007\/978-3-030-01246-5_3"},{"key":"1489_CR33","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/j.neunet.2020.08.011","volume":"132","author":"W Li","year":"2020","unstructured":"Li, W., Xiong, W., Liao, H., Huo, J., Gao, Y., & Luo, J. (2020). Carigan: Caricature generation through weakly paired adversarial learning. Neural Networks, 132, 66\u201374.","journal-title":"Neural Networks"},{"key":"1489_CR34","doi-asserted-by":"crossref","unstructured":"Li, Y., Fang, C., Yang, J., Wang, Z., Lu, X., & Yang, M. H. (2017a). Diversified texture synthesis with feed-forward networks. In CVPR.","DOI":"10.1109\/CVPR.2017.36"},{"key":"1489_CR35","unstructured":"Li, Y., Fang, C., Yang, J., Wang, Z., Lu, X., & Yang, M. H. (2017b). Universal style transfer via feature transforms. In NIPS."},{"key":"1489_CR36","doi-asserted-by":"crossref","unstructured":"Li, Y., Wang, N., Liu, J., & Hou, X. (2017c). Demystifying neural style transfer. In IJCAI.","DOI":"10.24963\/ijcai.2017\/310"},{"key":"1489_CR37","doi-asserted-by":"crossref","unstructured":"Li, Y., Liu, M. Y., Li, X., Yang, M. H., & Kautz, J. (2018). A closed-form solution to photorealistic image stylization. In ECCV.","DOI":"10.1007\/978-3-030-01219-9_28"},{"key":"1489_CR38","doi-asserted-by":"crossref","unstructured":"Liao, J., Yao, Y., Yuan, L., Hua, G., & Kang, S. B. (2017). Visual attribute transfer through deep image analogy. ACM TOG.","DOI":"10.1145\/3072959.3073683"},{"key":"1489_CR39","unstructured":"Liao, P. Y., Chiang, W. H., & Li, T. Y. (2004). Automatic caricature generation by analyzing facial features. In ACCV."},{"key":"1489_CR40","doi-asserted-by":"crossref","unstructured":"Lin, C. H., Yumer, E., Wang, O., Shechtman, E., & Lucey, S. (2018). St-gan: Spatial transformer generative adversarial networks for image compositing. In CVPR.","DOI":"10.1109\/CVPR.2018.00985"},{"key":"1489_CR41","unstructured":"Liu, M. Y., Breuel, T., & Kautz, J. (2017). Unsupervised image-to-image translation networks. In NIPS."},{"key":"1489_CR42","unstructured":"Luo, W. C., Liu, P. C., & Ouhyoung, M. (2002). Exaggeration of facial features in caricaturing. In Proc. int. computer symposium."},{"key":"1489_CR43","doi-asserted-by":"crossref","unstructured":"Park, E., Yang, J., Yumer, E., Ceylan, D., & Berg, A. C. (2017). Transformation-grounded image generation network for novel 3d view synthesis. InCVPR.","DOI":"10.1109\/CVPR.2017.82"},{"key":"1489_CR44","doi-asserted-by":"crossref","unstructured":"Parke, F. I. (1972). Computer generated animation of faces. In Proceedings of the ACM annual conference (Vol. 1, pp. 451\u2013457).","DOI":"10.1145\/800193.569955"},{"key":"1489_CR45","doi-asserted-by":"crossref","unstructured":"Shi, Y., Deb, D., & Jain, A. K. (2019). Warpgan: Automatic caricature generation. In CVPR.","DOI":"10.1109\/CVPR.2019.01102"},{"key":"1489_CR46","doi-asserted-by":"crossref","unstructured":"Shu, Z., Sahasrabudhe, M., Alp\u00a0Guler, R., Samaras, D., Paragios, N., & Kokkinos, I. (2018). Deforming autoencoders: Unsupervised disentangling of shape and appearance. In ECCV.","DOI":"10.1007\/978-3-030-01249-6_40"},{"key":"1489_CR47","first-page":"2579","volume":"9","author":"LJP van der Maaten","year":"2008","unstructured":"van der Maaten, L. J. P., & Hinton, G. E. (2008). Visualizing high-dimensional data using t-SNE. JMLR, 9, 2579\u20132605.","journal-title":"JMLR"},{"key":"1489_CR48","doi-asserted-by":"crossref","unstructured":"Wang, X., Shrivastava, A., & Gupta, A. (2017). A-fast-rcnn: Hard positive generation via adversary for object detection. In CVPR.","DOI":"10.1109\/CVPR.2017.324"},{"key":"1489_CR49","doi-asserted-by":"crossref","unstructured":"Wu, Q., Zhang, J., Lai, Y. K., Zheng, J., & Cai, J. (2018). Alive caricature from 2d to 3d. In CVPR (pp. 7336\u20137345).","DOI":"10.1109\/CVPR.2018.00766"},{"key":"1489_CR50","doi-asserted-by":"crossref","unstructured":"Wu, W., Kan, M., Liu, X., Yang, Y., Shan, S., & Chen, X. (2017). Recursive spatial transformer (rest) for alignment-free face recognition. In CVPR.","DOI":"10.1109\/ICCV.2017.407"},{"key":"1489_CR51","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1016\/j.neucom.2019.04.032","volume":"355","author":"Z Zheng","year":"2019","unstructured":"Zheng, Z., Wang, C., Yu, Z., Wang, N., Zheng, H., & Zheng, B. (2019). Unpaired photo-to-caricature translation on faces in the wild. Neurocomputing, 355, 71\u201381.","journal-title":"Neurocomputing"},{"key":"1489_CR52","doi-asserted-by":"crossref","unstructured":"Zhou, E., Cao, Z., & Sun, J. (2018). Gridface: Face rectification via learning local homography transformations. In ECCV.","DOI":"10.1007\/978-3-030-01270-0_1"},{"key":"1489_CR53","doi-asserted-by":"crossref","unstructured":"Zhu, J. Y., Park, T., Isola, P., & Efros, A. A. (2017a). Unpaired image-to-image translation using cycle-consistent adversarial networks. In ICCV.","DOI":"10.1109\/ICCV.2017.244"},{"key":"1489_CR54","unstructured":"Zhu, J. Y., Zhang, R., Pathak, D., Darrell, T., Efros, A. A., Wang, O., & Shechtman, E. (2017b). Toward multimodal image-to-image translation. In NIPS."}],"container-title":["International Journal of Computer Vision"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-021-01489-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11263-021-01489-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-021-01489-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T03:52:37Z","timestamp":1627617157000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11263-021-01489-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,9]]},"references-count":54,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["1489"],"URL":"https:\/\/doi.org\/10.1007\/s11263-021-01489-1","relation":{},"ISSN":["0920-5691","1573-1405"],"issn-type":[{"value":"0920-5691","type":"print"},{"value":"1573-1405","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,9]]},"assertion":[{"value":"10 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 June 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 July 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}