{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,8]],"date-time":"2025-09-08T05:37:07Z","timestamp":1757309827144,"version":"3.41.0"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2019,2,13]],"date-time":"2019-02-13T00:00:00Z","timestamp":1550016000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Science and Technology Program of Guangzhou, China","award":["201704020180"],"award-info":[{"award-number":["201704020180"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities of China","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003453","name":"Natural Science Foundation of Guangdong Province","doi-asserted-by":"crossref","award":["2017A030311029 and 2016B010109002"],"award-info":[{"award-number":["2017A030311029 and 2016B010109002"]}],"id":[{"id":"10.13039\/501100003453","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61673402"],"award-info":[{"award-number":["61673402"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2019,2,28]]},"abstract":"<jats:p>Tremendous progress on deep learning has shown exciting potential for a variety of face completion tasks. However, most learning-based methods are limited to handle general or structure specified face images (e.g., well-aligned faces). In this article, we propose a novel face completion algorithm, called Learning and Preserving Face Completion Network (LP-FCN), which simultaneously parses face images and extracts face identity-preserving (FIP) features. By tackling these two tasks in a mutually boosting way, the LP-FCN can guide an identity preserving inference and ensure pixel faithfulness of completed faces. In addition, we adopt a global discriminator and a local discriminator to distinguish real images from synthesized ones. By training with a combined identity preserving, semantic parsing and adversarial loss, the LP-FCN encourages the completion results to be semantically valid and visually consistent for more complicated image completion tasks. Experiments show that our approach obtains similar visual quality, but achieves better performance on unaligned faces completion and fine detailed synthesis against the state-of-the-art methods.<\/jats:p>","DOI":"10.1145\/3300940","type":"journal-article","created":{"date-parts":[[2019,2,14]],"date-time":"2019-02-14T19:36:17Z","timestamp":1550172977000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Photorealistic Face Completion with Semantic Parsing and Face Identity-Preserving Features"],"prefix":"10.1145","volume":"15","author":[{"given":"Ruijun","family":"Ma","sequence":"first","affiliation":[{"name":"Sun Yat-sen University, Guangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4884-323X","authenticated-orcid":false,"given":"Haifeng","family":"Hu","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University, Guangzhou, China"}]},{"given":"Weixuan","family":"Wang","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University, Guangzhou, China"}]},{"given":"Jia","family":"Xu","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University, Guangzhou, China"}]},{"given":"Zhengming","family":"Li","sequence":"additional","affiliation":[{"name":"Guangdong Polytechnic Normal University, Guangzhou, China"}]}],"member":"320","published-online":{"date-parts":[[2019,2,13]]},"reference":[{"volume-title":"Proceedings of IEEE International Conference on Operating Systems Design and Implementation. 265--283","year":"2016","author":"Abadi Mart\u00edn","key":"e_1_2_1_1_1"},{"key":"e_1_2_1_2_1","unstructured":"Brandon Amos Bartosz Ludwiczuk and Mahadev Satyanarayanan. 2016. OpenFace: A general-purpose face recognition library with mobile applications. In Technical report CMU-CS-16-118. CMU School of Computer Science.  Brandon Amos Bartosz Ludwiczuk and Mahadev Satyanarayanan. 2016. OpenFace: A general-purpose face recognition library with mobile applications. In Technical report CMU-CS-16-118. CMU School of Computer Science."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/83.935036"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531330"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1927006.1927010"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553380"},{"volume-title":"Conference on Neural Information Processing Systems. 2672--2680","year":"2015","author":"Denton Emily","key":"e_1_2_1_7_1"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.522"},{"volume-title":"Conference on Neural Information Processing Systems. 2672--2680","year":"2014","author":"Goodfellow Ian J.","key":"e_1_2_1_9_1"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46487-9_6"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDSP.2013.6622760"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276382"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Rui Huang Shu Zhang Tianyu Li and Ran He. 2017. Beyond face rotation: Global and local perception GAN for photorealistic and identity preserving frontal view synthesis. arXiv preprint arXiv:1704.04086 2.  Rui Huang Shu Zhang Tianyu Li and Ran He. 2017. Beyond face rotation: Global and local perception GAN for photorealistic and identity preserving frontal view synthesis. arXiv preprint arXiv:1704.04086 2.","DOI":"10.1109\/ICCV.2017.267"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073659"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/1965841.1965925"},{"volume-title":"Conference on Neural Information Processing Systems. 2672--2680","year":"2017","author":"Jin Xiaojie","key":"e_1_2_1_17_1"},{"volume-title":"Adam: A method for stochastic optimization. arXiv:1412.6980.","year":"2015","author":"Kingma Diederik","key":"e_1_2_1_18_1"},{"volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Diederik","key":"e_1_2_1_19_1"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-11752-2_43"},{"volume-title":"IEEE International Conference on Image Processing. 2374--2378","author":"Kundu D.","key":"e_1_2_1_21_1"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073263"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33712-3_49"},{"key":"e_1_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Christian Ledig Lucas Theis Ferenc Husz\u00e1r Jose Caballero Andrew Cunningham Alejandro Acosta Andrew Aitken Alykhan Tejani Johannes Totz Zehan Wang and Wenzhe Shi. 2016. Photorealistic single image super-resolution using a genrative adversarial network. arXiv preprint arXiv:1609.04802.  Christian Ledig Lucas Theis Ferenc Husz\u00e1r Jose Caballero Andrew Cunningham Alejandro Acosta Andrew Aitken Alykhan Tejani Johannes Totz Zehan Wang and Wenzhe Shi. 2016. Photorealistic single image super-resolution using a genrative adversarial network. arXiv preprint arXiv:1609.04802.","DOI":"10.1109\/CVPR.2017.19"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.211"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.624"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.272"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10443-0_39"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.425"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46493-0_34"},{"volume-title":"IEEE Conference on Computer Vision and Pattern Recognition. 3451--3459","year":"2015","author":"Liu Sifei","key":"e_1_2_1_31_1"},{"key":"e_1_2_1_32_1","unstructured":"L. van der Maaten and G. E. Hinton. 2008. Visualizing high dimensional data using T-SNE. In Journal of Machine Learning Research. 2579--2605.  L. van der Maaten and G. E. Hinton. 2008. Visualizing high dimensional data using T-SNE. In Journal of Machine Learning Research. 2579--2605."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2007.911828"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.278"},{"key":"e_1_2_1_35_1","unstructured":"Alec Radford Luke Metz and Soumith Chintala. 2015. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434.  Alec Radford Luke Metz and Soumith Chintala. 2015. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434."},{"volume-title":"Conference on Neural Information Processing Systems.","year":"2015","author":"Ren Jimmy SJ","key":"e_1_2_1_36_1"},{"volume-title":"IEEE Winter Conference on Applications of Computer Vision.","year":"2018","author":"Shiri Fatemeh","key":"e_1_2_1_37_1"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.447"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.5244\/C.23.116"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.79"},{"key":"e_1_2_1_41_1","article-title":"A light CNN for deep face representation with noisy labels","author":"Wu Xiang","year":"2016","journal-title":"IEEE Transactions on Information Forensics 8 Security."},{"volume-title":"Conference on Neural Information Processing Systems. 341--349","year":"2012","author":"Xie Junyuan","key":"e_1_2_1_42_1"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.434"},{"volume-title":"IEEE Conference on Computer Vision and Pattern Recognition. 676--684","author":"Yim J.","key":"e_1_2_1_44_1"},{"volume-title":"Face hallucination with tiny unaligned images by transformative discriminative neural networks","author":"Yu Xin","key":"e_1_2_1_45_1"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.21"},{"volume-title":"International Conference on Neural Information. 217--225","year":"2014","author":"Zhu Zhenyao","key":"e_1_2_1_47_1"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3300940","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3300940","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:25:23Z","timestamp":1750206323000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3300940"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,13]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,2,28]]}},"alternative-id":["10.1145\/3300940"],"URL":"https:\/\/doi.org\/10.1145\/3300940","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2019,2,13]]},"assertion":[{"value":"2018-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-02-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}