{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T06:49:59Z","timestamp":1769150999014,"version":"3.49.0"},"publisher-location":"Cham","reference-count":46,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783031730009","type":"print"},{"value":"9783031730016","type":"electronic"}],"license":[{"start":{"date-parts":[[2024,11,27]],"date-time":"2024-11-27T00:00:00Z","timestamp":1732665600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2024,11,27]],"date-time":"2024-11-27T00:00:00Z","timestamp":1732665600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025]]},"DOI":"10.1007\/978-3-031-73001-6_22","type":"book-chapter","created":{"date-parts":[[2024,11,26]],"date-time":"2024-11-26T10:23:18Z","timestamp":1732616598000},"page":"383-400","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["SelfSwapper: Self-supervised Face Swapping via\u00a0Shape Agnostic Masked AutoEncoder"],"prefix":"10.1007","author":[{"given":"Jaeseong","family":"Lee","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junha","family":"Hyung","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sohyun","family":"Jung","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jaegul","family":"Choo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,11,27]]},"reference":[{"key":"22_CR1","doi-asserted-by":"crossref","unstructured":"B\u00fchler, M.C., Meka, A., Li, G., Beeler, T., Hilliges, O.: Varitex: variational neural face textures. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp. 13890\u201313899 (2021)","DOI":"10.1109\/ICCV48922.2021.01363"},{"key":"22_CR2","doi-asserted-by":"crossref","unstructured":"Cao, Q., Shen, L., Xie, W., Parkhi, O.M., Zisserman, A.: VGGFace2: a dataset for recognising faces across pose and age. In: 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), pp. 67\u201374. IEEE (2018)","DOI":"10.1109\/FG.2018.00020"},{"key":"22_CR3","doi-asserted-by":"crossref","unstructured":"Chen, R., Chen, X., Ni, B., Ge, Y.: Simswap: an efficient framework for high fidelity face swapping. In: Proceedings of the 28th ACM International Conference on Multimedia, pp. 2003\u20132011 (2020)","DOI":"10.1145\/3394171.3413630"},{"key":"22_CR4","unstructured":"Digital-nomad cheng: Dense iris landmarks. https:\/\/github.com\/digital-nomad-cheng\/Iris_Landmarks_PyTorch. Accessed 07 Mar 2024"},{"key":"22_CR5","unstructured":"Deepfakes: Deepfakes. https:\/\/github.com\/deepfakes\/faceswap. Accessed 07 Mar 2024"},{"key":"22_CR6","doi-asserted-by":"crossref","unstructured":"Deng, J., Guo, J., Xue, N., Zafeiriou, S.: Arcface: additive angular margin loss for deep face recognition. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 4690\u20134699 (2019)","DOI":"10.1109\/CVPR.2019.00482"},{"key":"22_CR7","doi-asserted-by":"crossref","unstructured":"Deng, Y., Yang, J., Chen, D., Wen, F., Tong, X.: Disentangled and controllable face image generation via 3D imitative-contrastive learning. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 5154\u20135163 (2020)","DOI":"10.1109\/CVPR42600.2020.00520"},{"key":"22_CR8","doi-asserted-by":"crossref","unstructured":"Deng, Y., Yang, J., Xu, S., Chen, D., Jia, Y., Tong, X.: Accurate 3D face reconstruction with weakly-supervised learning: from single image to image set. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (2019)","DOI":"10.1109\/CVPRW.2019.00038"},{"key":"22_CR9","unstructured":"Dhariwal, P., Nichol, A.: Diffusion models beat GANs on image synthesis. In: Advances in Neural Information Processing Systems, vol. 34, pp. 8780\u20138794 (2021)"},{"issue":"4","key":"22_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3450626.3459936","volume":"40","author":"Y Feng","year":"2021","unstructured":"Feng, Y., Feng, H., Black, M.J., Bolkart, T.: Learning an animatable detailed 3D face model from in-the-wild images. ACM Trans. Graph. (ToG) 40(4), 1\u201313 (2021)","journal-title":"ACM Trans. Graph. (ToG)"},{"key":"22_CR11","doi-asserted-by":"crossref","unstructured":"Gao, G., Huang, H., Fu, C., Li, Z., He, R.: Information bottleneck disentanglement for identity swapping. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 3404\u20133413 (2021)","DOI":"10.1109\/CVPR46437.2021.00341"},{"key":"22_CR12","doi-asserted-by":"crossref","unstructured":"Ghosh, P., Gupta, P.S., Uziel, R., Ranjan, A., Black, M.J., Bolkart, T.: GIF: generative interpretable faces. In: 2020 International Conference on 3D Vision (3DV), pp. 868\u2013878. IEEE (2020)","DOI":"10.1109\/3DV50981.2020.00097"},{"key":"22_CR13","unstructured":"Goodfellow, I., et al.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, vol. 27 (2014)"},{"key":"22_CR14","unstructured":"Ho, J., Jain, A., Abbeel, P.: Denoising diffusion probabilistic models. In: Advances in Neural Information Processing Systems, vol. 33, pp. 6840\u20136851 (2020)"},{"key":"22_CR15","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"694","DOI":"10.1007\/978-3-319-46475-6_43","volume-title":"Computer Vision \u2013 ECCV 2016","author":"J Johnson","year":"2016","unstructured":"Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9906, pp. 694\u2013711. Springer, Cham (2016). https:\/\/doi.org\/10.1007\/978-3-319-46475-6_43"},{"key":"22_CR16","doi-asserted-by":"crossref","unstructured":"Karras, T., Laine, S., Aila, T.: A style-based generator architecture for generative adversarial networks. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 4401\u20134410 (2019)","DOI":"10.1109\/CVPR.2019.00453"},{"key":"22_CR17","doi-asserted-by":"crossref","unstructured":"Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., Aila, T.: Analyzing and improving the image quality of styleGAN. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 8110\u20138119 (2020)","DOI":"10.1109\/CVPR42600.2020.00813"},{"key":"22_CR18","doi-asserted-by":"crossref","unstructured":"Kim, J., Lee, J., Zhang, B.T.: Smooth-swap: a simple enhancement for face-swapping with smoothness. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 10779\u201310788 (2022)","DOI":"10.1109\/CVPR52688.2022.01051"},{"key":"22_CR19","unstructured":"Kingma, D.P., Welling, M.: Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013)"},{"key":"22_CR20","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1007\/978-3-030-58621-8_18","volume-title":"Computer Vision \u2013 ECCV 2020","author":"M Kowalski","year":"2020","unstructured":"Kowalski, M., Garbin, S.J., Estellers, V., Baltru\u0161aitis, T., Johnson, M., Shotton, J.: CONFIG: controllable neural face image generation. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12356, pp. 299\u2013315. Springer, Cham (2020). https:\/\/doi.org\/10.1007\/978-3-030-58621-8_18"},{"key":"22_CR21","unstructured":"Lee, J., Kim, T., Park, S., Lee, Y., Choo, J.: Robustswap: a simple yet robust face swapping model against attribute leakage. arXiv preprint arXiv:2303.15768 (2023)"},{"key":"22_CR22","unstructured":"Li, L., Bao, J., Yang, H., Chen, D., Wen, F.: Faceshifter: towards high fidelity and occlusion aware face swapping. arXiv preprint arXiv:1912.13457 (2019)"},{"key":"22_CR23","doi-asserted-by":"crossref","unstructured":"Li, T., Bolkart, T., Black, M.J., Li, H., Romero, J.: Learning a model of facial shape and expression from 4D scans. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 36(6), 194:1\u2013194:17 (2017). https:\/\/doi.org\/10.1145\/3130800.3130813","DOI":"10.1145\/3130800.3130813"},{"key":"22_CR24","series-title":"LNCS","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1007\/978-3-031-19784-0_7","volume-title":"ECCV 2022","author":"Y Liu","year":"2022","unstructured":"Liu, Y., Shu, Z., Li, Y., Lin, Z., Zhang, R., Kung, S.Y.: 3D-FM GAN: towards 3D-controllable face manipulation. In: Avidan, S., Brostow, G., Ciss\u00e9, M., Farinella, G.M., Hassner, T. (eds.) ECCV 2022. LNCS, vol. 13675, pp. 107\u2013125. Springer, Cham (2022). https:\/\/doi.org\/10.1007\/978-3-031-19784-0_7"},{"key":"22_CR25","doi-asserted-by":"crossref","unstructured":"Liu, Z., et al.: Fine-grained face swapping via regional GAN inversion. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 8578\u20138587 (2023)","DOI":"10.1109\/CVPR52729.2023.00829"},{"key":"22_CR26","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2019.101027","volume":"60","author":"A Nagrani","year":"2020","unstructured":"Nagrani, A., Chung, J.S., Xie, W., Zisserman, A.: Voxceleb: large-scale speaker verification in the wild. Comput. Speech Lang. 60, 101027 (2020)","journal-title":"Comput. Speech Lang."},{"key":"22_CR27","doi-asserted-by":"crossref","unstructured":"Nirkin, Y., Keller, Y., Hassner, T.: FSGAN: subject agnostic face swapping and reenactment. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp. 7184\u20137193 (2019)","DOI":"10.1109\/ICCV.2019.00728"},{"key":"22_CR28","doi-asserted-by":"crossref","unstructured":"Paysan, P., Knothe, R., Amberg, B., Romdhani, S., Vetter, T.: A 3D face model for pose and illumination invariant face recognition. In: 2009 sixth IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 296\u2013301. IEEE (2009)","DOI":"10.1109\/AVSS.2009.58"},{"key":"22_CR29","unstructured":"Perov, I., et\u00a0al.: Deepfacelab: integrated, flexible and extensible face-swapping framework. arXiv preprint arXiv:2005.05535 (2020)"},{"key":"22_CR30","doi-asserted-by":"crossref","unstructured":"Ren, X., Chen, X., Yao, P., Shum, H.Y., Wang, B.: Reinforced disentanglement for face swapping without skip connection. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp. 20665\u201320675 (2023)","DOI":"10.1109\/ICCV51070.2023.01889"},{"key":"22_CR31","doi-asserted-by":"crossref","unstructured":"Rombach, R., Blattmann, A., Lorenz, D., Esser, P., Ommer, B.: High-resolution image synthesis with latent diffusion models. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 10684\u201310695 (2022)","DOI":"10.1109\/CVPR52688.2022.01042"},{"key":"22_CR32","doi-asserted-by":"crossref","unstructured":"Shiohara, K., Yang, X., Taketomi, T.: Blendface: re-designing identity encoders for face-swapping. arXiv preprint arXiv:2307.10854 (2023)","DOI":"10.1109\/ICCV51070.2023.00702"},{"key":"22_CR33","unstructured":"Siarohin, A., Lathuili\u00e8re, S., Tulyakov, S., Ricci, E., Sebe, N.: First order motion model for image animation. In: Advances in Neural Information Processing Systems, vol. 32 (2019)"},{"issue":"4","key":"22_CR34","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1109\/34.88573","volume":"13","author":"S Umeyama","year":"1991","unstructured":"Umeyama, S.: Least-squares estimation of transformation parameters between two point patterns. IEEE Trans. Pattern Anal. Mach. Intell. 13(4), 376\u2013380 (1991). https:\/\/doi.org\/10.1109\/34.88573","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"22_CR35","unstructured":"Vu, T., Do, K., Nguyen, K., Than, K.: Face swapping as a simple arithmetic operation. arXiv preprint arXiv:2211.10812 (2022)"},{"key":"22_CR36","doi-asserted-by":"crossref","unstructured":"Wang, T.C., Mallya, A., Liu, M.Y.: One-shot free-view neural talking-head synthesis for video conferencing. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 10039\u201310049 (2021)","DOI":"10.1109\/CVPR46437.2021.00991"},{"key":"22_CR37","unstructured":"Wang, Y., Yang, D., Bremond, F., Dantcheva, A.: Latent image animator: learning to animate images via latent space navigation. arXiv preprint arXiv:2203.09043 (2022)"},{"key":"22_CR38","doi-asserted-by":"crossref","unstructured":"Wang, Y., et al.: Hififace: 3D shape and semantic prior guided high fidelity face swapping. arXiv preprint arXiv:2106.09965 (2021)","DOI":"10.24963\/ijcai.2021\/157"},{"key":"22_CR39","doi-asserted-by":"crossref","unstructured":"Wang, Z., Zhang, J., Chen, R., Wang, W., Luo, P.: Restoreformer: high-quality blind face restoration from undegraded key-value pairs. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 17512\u201317521 (2022)","DOI":"10.1109\/CVPR52688.2022.01699"},{"key":"22_CR40","doi-asserted-by":"crossref","unstructured":"Xu, Y., Deng, B., Wang, J., Jing, Y., Pan, J., He, S.: High-resolution face swapping via latent semantics disentanglement. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 7642\u20137651 (2022)","DOI":"10.1109\/CVPR52688.2022.00749"},{"key":"22_CR41","series-title":"LNCS","doi-asserted-by":"publisher","first-page":"661","DOI":"10.1007\/978-3-031-19781-9_38","volume-title":"ECCV 2022","author":"Z Xu","year":"2022","unstructured":"Xu, Z., et al.: StyleSwap: style-based generator empowers robust face swapping. In: Avidan, S., Brostow, G., Ciss\u00e9, M., Farinella, G.M., Hassner, T. (eds.) ECCV 2022. LNCS, vol. 13674, pp. 661\u2013677. Springer, Cham (2022). https:\/\/doi.org\/10.1007\/978-3-031-19781-9_38"},{"key":"22_CR42","doi-asserted-by":"crossref","unstructured":"Yu, C., Wang, J., Peng, C., Gao, C., Yu, G., Sang, N.: Bisenet: bilateral segmentation network for real-time semantic segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 325\u2013341 (2018)","DOI":"10.1007\/978-3-030-01261-8_20"},{"key":"22_CR43","unstructured":"Yuan, G., Li, M., Zhang, Y., Zheng, H.: Reliableswap: boosting general face swapping via reliable supervision. arXiv preprint arXiv:2306.05356 (2023)"},{"key":"22_CR44","doi-asserted-by":"crossref","unstructured":"Zakharov, E., Shysheya, A., Burkov, E., Lempitsky, V.: Few-shot adversarial learning of realistic neural talking head models. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp. 9459\u20139468 (2019)","DOI":"10.1109\/ICCV.2019.00955"},{"key":"22_CR45","doi-asserted-by":"crossref","unstructured":"Zhao, W., Rao, Y., Shi, W., Liu, Z., Zhou, J., Lu, J.: Diffswap: high-fidelity and controllable face swapping via 3D-aware masked diffusion. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 8568\u20138577 (2023)","DOI":"10.1109\/CVPR52729.2023.00828"},{"key":"22_CR46","doi-asserted-by":"crossref","unstructured":"Zhu, Y., Li, Q., Wang, J., Xu, C.Z., Sun, Z.: One shot face swapping on megapixels. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 4834\u20134844 (2021)","DOI":"10.1109\/CVPR46437.2021.00480"}],"container-title":["Lecture Notes in Computer Science","Computer Vision \u2013 ECCV 2024"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-73001-6_22","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,26]],"date-time":"2024-11-26T11:13:54Z","timestamp":1732619634000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-73001-6_22"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,27]]},"ISBN":["9783031730009","9783031730016"],"references-count":46,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-73001-6_22","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,27]]},"assertion":[{"value":"27 November 2024","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"Face swapping is useful in areas like digital resurrection and telepresence but also poses risks of privacy invasion and misinformation. We are dedicated to prevent the potential misuse our model, and plan to release our model exclusively for research purposes. Additionally, we will provide a benchmark dataset to support research in face forensics and privacy protection.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Considerations"}},{"value":"ECCV","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"European Conference on Computer Vision","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Milan","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Italy","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2024","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"29 September 2024","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"4 October 2024","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"18","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"eccv2024","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/eccv2024.ecva.net\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}