{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:50:48Z","timestamp":1760241048258,"version":"build-2065373602"},"reference-count":41,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2019,11,18]],"date-time":"2019-11-18T00:00:00Z","timestamp":1574035200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003696","name":"Electronics and Telecommunications Research Institute","doi-asserted-by":"publisher","award":["R2018030391"],"award-info":[{"award-number":["R2018030391"]}],"id":[{"id":"10.13039\/501100003696","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>In this paper, we address the problem of synthesizing continuous variations with the appearance of makeup by taking a linear combination of the examples. Makeup usually shows a vague boundary and does not form a clear shape, which makes this problem unique from the existing image interpolation problems. We approach this problem as an interpolation between semi-transparent image layers and tackle this by presenting new parametrization schemes for the color and for the shape separately in order to achieve an effective interpolation. For the color parametrization, our main idea is based on the observation of the symmetric relation between the color and transparency of the makeup; we provide an optimization framework for extracting a representative palette of colors associated with the transparent values, which enables us to easily set up the color correspondence among the multiple makeup samples. For the shape parametrization, we exploit a polar coordinate system, that creates the in-between shapes effectively, without ghosting artifacts.<\/jats:p>","DOI":"10.3390\/sym11111422","type":"journal-article","created":{"date-parts":[[2019,11,18]],"date-time":"2019-11-18T11:18:48Z","timestamp":1574075928000},"page":"1422","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Makeup Interpolation Based on Color and Shape Parametrization"],"prefix":"10.3390","volume":"11","author":[{"given":"Jieun","family":"Cho","sequence":"first","affiliation":[{"name":"Global Information and Telecommunication Institute, Waseda University, Tokyo 169-8050, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Ohya","sequence":"additional","affiliation":[{"name":"Department of Modern Mechanical Engineering, Waseda University, Tokyo 169-8050, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sang Il","family":"Park","sequence":"additional","affiliation":[{"name":"Department of Software, Sejong University, Seoul 05006, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,18]]},"reference":[{"key":"ref_1","unstructured":"Tong, W., Tang, C.K., Brown, M., and Xu, Y.Q. (November, January 29). Example-based cosmetic transfer. Proceedings of the 15th Pacific Conference on Computer Graphics and Applications, Maui, HI, USA."},{"key":"ref_2","unstructured":"Guo, D., and Sim, T. (2009, January 20\u201325). Digital face makeup by example. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1111\/j.1467-8659.2011.01874.x","article-title":"Computer-suggested Facial Makeup","volume":"30","author":"Scherbaum","year":"2011","journal-title":"Comput. Graph. Forum"},{"key":"ref_4","unstructured":"Angelopoulou, E., Molana, R., and Danilidis, K. (2001, January 8\u201314). Multispectral skin color modeling. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Tsumura, N., Ojima, N., Sato, K., Shiraishi, M., Shimizu, H., Nabeshima, H., Akazaki, S., Hori, K., and Miyake, Y. (2003, January 27\u201331). Image-based skin color and texture analysis\/synthesis by extracting hemoglobin and melanin information in the skin. Proceedings of the ACM SIGGRAPH \u201903, San Diego, CA, USA.","DOI":"10.1145\/1201775.882344"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"574","DOI":"10.2352\/J.ImagingSci.Technol.2005.49.6.art00005","article-title":"Spectral reflectance estimation of human skin and its application to image rendering","volume":"49","author":"Doi","year":"2005","journal-title":"J. Imaging Sci. Technol."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Moriuchi, Y., Tominaga, S., and Horiuchi, T. (2009, January 15\u201318). Precise Analysis of Spectral Reflectance Properties of Cosmetic Foundation. Proceedings of the SCIA 2009, Oslo, Norway.","DOI":"10.1007\/978-3-642-02230-2_15"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Doi, M., Ohtsuki, R., and Tominaga, S. (2005, January 19\u201322). Spectral Estimation of Skin Color with Foundation Makeup. Proceedings of the SCIA 2005, Joensuu, Finland.","DOI":"10.1007\/11499145_11"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Huang, C.G., Huan, T.S., Lin, W.C., and Chuang, J.H. (2013, January 21\u201323). Physically based cosmetic rendering. Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, Orlando, FL, USA.","DOI":"10.1145\/2448196.2448238"},{"key":"ref_10","unstructured":"Ojima, N., Yoshida, K., Osanai, O., and Akazaki, S. (2002, January 13\u201317). Image Synthesis of Cosmetic Applied Skin Based on Optical Properties of Foundation Layers. Proceedings of the International Congress of Imaging Science, Ichigaya, Tokyo."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, C., Zhou, K., and Lin, S. (2015, January 7\u201312). Simulating makeup through physics-based manipulation of intrinsic image layers. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299093"},{"key":"ref_12","unstructured":"Kay, M. (2019, November 01). Mary Kay Virtual Makeover. Available online: http:\/\/www.marykay.com."},{"key":"ref_13","unstructured":"Stylecaster (2019, November 01). Stylecaster Online Virtual Makeover. Available online: http:\/\/stylecaster.com\/virtual-makeover."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Rahman, A.S.M.M., Tran, T.T., Hossain, S.A., and Saddik, A.E. (2010, January 17\u201320). Augmented Rendering of Makeup Features in a Smart Interactive Mirror System for Decision Support in Cosmetic Products Selection. Proceedings of the IEEE\/ACM 14th International Symposium on Distributed Simulation and Real Time Applications (DS-RT), Fairfax, VA, USA.","DOI":"10.1109\/DS-RT.2010.30"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1007\/978-3-642-02583-9_54","article-title":"Smart Makeup Mirror: Computer-Augmented Mirror to Aid Makeup Application","volume":"5613","author":"Iwabuchi","year":"2009","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1007\/s003710050148","article-title":"Image morphing: A survey","volume":"14","author":"Wolberg","year":"1998","journal-title":"Vis. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Beier, T., and Neely, S. (1992, January 26\u201331). Feature-based Image Metamorphosis. Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH \u201992), Chicago, IL, USA.","DOI":"10.1145\/133994.134003"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Alexa, M., Cohen-Or, D., and Levin, D. (2000, January 23\u201328). As-rigid-as-possible Shape Interpolation. Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH \u201900), New Orleans, LA, USA.","DOI":"10.1145\/344779.344859"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1145\/1141911.1141920","article-title":"Image Deformation Using Moving Least Squares","volume":"25","author":"Schaefer","year":"2006","journal-title":"ACM Trans. Graph."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1023\/B:VISI.0000036836.66311.97","article-title":"Optimal Mass Transport for Registration and Warping","volume":"60","author":"Haker","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_21","first-page":"295","article-title":"Multigrid optimal mass transport for image registration and morphing","volume":"6498","author":"Rehman","year":"2007","journal-title":"Comput. Imaging V"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1682","DOI":"10.1137\/17M1130897","article-title":"Vector-Valued Optimal Mass Transport","volume":"78","author":"Chen","year":"2018","journal-title":"SIAM J. Appl. Math."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1109\/TVCG.2014.2356196","article-title":"Space-Time Transfinite Interpolation of Volumetric Material Properties","volume":"21","author":"Sanchez","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_24","unstructured":"Liu, S., Ou, X., Qian, R., Wang, W., and Cao, X. (2016, January 9\u201315). Makeup Like a Superstar: Deep Localized Makeup Transfer Network. Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence (IJCAI\u201916), New York, NY, USA."},{"key":"ref_25","unstructured":"Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8\u201313). Generative Adversarial Nets. Proceedings of the 27th International Conference on Neural Information Processing Systems (NIPS\u201914), Montreal, QC, Canada."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks. Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201917), Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_27","unstructured":"Liu, M.Y., Breuel, T., and Kautz, J. (2017, January 4\u20139). Unsupervised Image-to-image Translation Networks. Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS\u201917), Long Beach, CA, USA."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Chang, H., Lu, J., Yu, F., and Finkelstein, A. (2018, January 18\u201323). PairedCycleGAN: Asymmetric Style Transfer for Applying and Removing Makeup. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201918), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00012"},{"key":"ref_29","unstructured":"Bars, F., and Baron, F. (2001). Makeup Your Mind, powerHouse Books."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1006\/cviu.1995.1004","article-title":"Active shape models\u2014Their traning and application","volume":"61","author":"Cootes","year":"1995","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1109\/34.24792","article-title":"Principal warps: Thin-plate splines and the decomposition of deformations","volume":"11","author":"Bookstein","year":"1989","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1113","DOI":"10.1109\/TPAMI.2014.2366127","article-title":"Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition","volume":"37","author":"Sariyanidi","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1561\/0600000019","article-title":"Image and Video Matting: A Survey","volume":"3","author":"Wang","year":"2007","journal-title":"Found. Trends. Comput. Graph. Vis."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Shahrian, E., Rajan, D., Price, B., and Cohen, S. (2013, January 23\u201328). Improving Image Matting using Comprehensive Sampling Sets. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.88"},{"key":"ref_35","unstructured":"Gonzalez, R.C., and Woods, R.E. (2008). Digital Image Processing, Prentice Hall. [3rd ed.]."},{"key":"ref_36","unstructured":"(2019, November 01). Wikipedia. Image Moment\u2014Wikipedia The Free Encyclopedia. Available online: http:\/\/en.wikipedia.org\/wiki\/image_moment."},{"key":"ref_37","unstructured":"Woodland, A., and Labrosse, F. (2005, January 7\u20138). On the separation of luminance from colour in images. Proceedings of the International Conference on Vision, Video and Graphics, Edinburgh, UK."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Hertzmann, A., Jacobs, C.E., Oliver, N., Curless, B., and Salesin, D.H. (2001, January 12\u201317). Image Analogies. Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH \u201901), Los Angeles, CA, USA.","DOI":"10.1145\/383259.383295"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"24:1","DOI":"10.1145\/1531326.1531330","article-title":"PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing","volume":"28","author":"Barnes","year":"2009","journal-title":"ACM Trans. Graph."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1145\/3306346.3323023","article-title":"Semantic Photo Manipulation with a Generative Image Prior","volume":"38","author":"Bau","year":"2019","journal-title":"ACM Trans. Graph."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/11\/1422\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:35:24Z","timestamp":1760189724000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/11\/1422"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,18]]},"references-count":41,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["sym11111422"],"URL":"https:\/\/doi.org\/10.3390\/sym11111422","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2019,11,18]]}}}