{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T18:35:09Z","timestamp":1779215709289,"version":"3.51.4"},"reference-count":38,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,3,31]],"date-time":"2023-03-31T00:00:00Z","timestamp":1680220800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006245","name":"Ministry of Science and Technology","doi-asserted-by":"publisher","award":["MOST-109-2221-E-153-003"],"award-info":[{"award-number":["MOST-109-2221-E-153-003"]}],"id":[{"id":"10.13039\/501100006245","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The technology for detecting forged images is good at detecting known forgery methods. It trains neural networks using many original and corresponding forged images created with known methods. However, when encountering unseen forgery methods, the technology performs poorly. Recently, one suggested approach to tackle this problem is to use a hand-crafted generator of forged images to create a range of fake images, which can then be used to train the neural network. However, the aforementioned method has limited detection performance when encountering unseen forging techniques that the hand-craft generator has not accounted for. To overcome the limitations of existing methods, in this paper, we adopt a meta-learning approach to develop a highly adaptive detector for identifying new forging techniques. The proposed method trains a forged image detector using meta-learning techniques, making it possible to fine-tune the detector with only a few new forged samples. The proposed method inputs a small number of the forged images to the detector and enables the detector to adjust its weights based on the statistical features of the input forged images, allowing the detection of forged images with similar characteristics. The proposed method achieves significant improvement in detecting forgery methods, with IoU improvements ranging from 35.4% to 127.2% and AUC improvements ranging from 2.0% to 48.9%, depending on the forgery method. These results show that the proposed method significantly improves detection performance with only a small number of samples and demonstrates better performance compared to current state-of-the-art methods in most scenarios.<\/jats:p>","DOI":"10.3390\/s23073647","type":"journal-article","created":{"date-parts":[[2023,3,31]],"date-time":"2023-03-31T08:27:27Z","timestamp":1680251247000},"page":"3647","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A Meta-Learning Approach for Few-Shot Face Forgery Segmentation and Classification"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6509-0017","authenticated-orcid":false,"given":"Yih-Kai","family":"Lin","sequence":"first","affiliation":[{"name":"Department of Computer Science and Artificial Intelligence, National Pingtung University, No. 4-18 Minsheng Road, Pingtung City 90003, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ting-Yu","family":"Yen","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Artificial Intelligence, National Pingtung University, No. 4-18 Minsheng Road, Pingtung City 90003, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Shiohara, K., and Yamasaki, T. (2022, January 19\u201320). Detecting Deepfakes with Self-Blended Images. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01816"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3306346.3323035","article-title":"Deferred neural rendering: Image synthesis using neural textures","volume":"38","author":"Thies","year":"2019","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., and Nie\u00dfner, M. (2016, January 26\u201330). Face2face: Real-time face capture and reenactment of rgb videos. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.262"},{"key":"ref_4","first-page":"143","article-title":"Face2Face: Real-time facial reenactment","volume":"61","author":"Thies","year":"2019","journal-title":"IT-Inf. Technol."},{"key":"ref_5","unstructured":"(2023, February 03). Faceswap. Available online: https:\/\/github.com\/MarekKowalski\/FaceSwap."},{"key":"ref_6","unstructured":"(2023, February 03). Deepfakes. Available online: https:\/\/github.com\/deepfakes\/faceswap."},{"key":"ref_7","unstructured":"R\u00f6ssler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., and Nie\u00dfner, M. (November, January 27). Faceforensics++: Learning to detect manipulated facial images. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bayar, B., and Stamm, M.C. (2016, January 20\u201322). A deep learning approach to universal image manipulation detection using a new convolutional layer. Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security, Vigo, Spain.","DOI":"10.1145\/2909827.2930786"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Cozzolino, D., Poggi, G., and Verdoliva, L. (2017, January 20\u201322). Recasting residual-based local descriptors as convolutional neural networks: An application to image forgery detection. Proceedings of the 5th ACM Workshop on Information Hiding and Multimedia Security, Philadelphia, PA, USA.","DOI":"10.1145\/3082031.3083247"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Nguyen, H.H., Fang, F., Yamagishi, J., and Echizen, I. (2019). Multi-task learning for detecting and segmenting manipulated facial images and videos. arXiv.","DOI":"10.1109\/BTAS46853.2019.9185974"},{"key":"ref_11","unstructured":"Zhou, Z., Rahman Siddiquee, M.M., Tajbakhsh, N., and Liang, J. (2018). Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 20, 2018, Proceedings 4, Springer."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Feng, S., Fan, Y., Tang, Y., Cheng, H., Zhao, C., Zhu, Y., and Cheng, C. (2022). A Change Detection Method Based on Multi-Scale Adaptive Convolution Kernel Network and Multimodal Conditional Random Field for Multi-Temporal Multispectral Images. Remote Sens., 14.","DOI":"10.3390\/rs14215368"},{"key":"ref_13","first-page":"669","article-title":"A patchmatch-based dense-field algorithm for video copy\u2013move detection and localization","volume":"29","author":"Cozzolino","year":"2018","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bestagini, P., Milani, S., Tagliasacchi, M., and Tubaro, S. (October, January 30). Local tampering detection in video sequences. Proceedings of the 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP), Pula, Italy.","DOI":"10.1109\/MMSP.2013.6659337"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Gironi, A., Fontani, M., Bianchi, T., Piva, A., and Barni, M. (2014, January 4\u20139). A video forensic technique for detecting frame deletion and insertion. Proceedings of the 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy.","DOI":"10.1109\/ICASSP.2014.6854801"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, Y., Yang, X., Sun, P., Qi, H., and Lyu, S. (2020, January 13\u201319). Celeb-df: A large-scale challenging dataset for deepfake forensics. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00327"},{"key":"ref_17","unstructured":"Nick, D., and Andrew, J. (Google AI Blog, 2019). Contributing Data to Deepfake Detection Research, Google AI Blog."},{"key":"ref_18","unstructured":"Dolhansky, B., Howes, R., Pflaum, B., Baram, N., and Ferrer, C.C. (2019). The deepfake detection challenge (dfdc) preview dataset. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhou, T., Wang, W., Liang, Z., and Shen, J. (2021, January 20\u201325). Face forensics in the wild. Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00572"},{"key":"ref_20","unstructured":"Ravi, S., and Larochelle, H. (2017, January 24\u201326). Optimization as a model for few-shot learning. Proceedings of the International Conference on Learning Representations, Toulon, France."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1109\/TBIOM.2022.3143404","article-title":"Improving Generalization of Deepfake Detection With Data Farming and Few-Shot Learning","volume":"4","author":"Korshunov","year":"2022","journal-title":"IEEE Trans. Biom. Behav. Identity Sci."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Thrun, S., and Pratt, L. (1998). Learning to Learn, Springer.","DOI":"10.1007\/978-1-4615-5529-2"},{"key":"ref_23","unstructured":"Zakharov, E., Shysheya, A., Burkov, E., and Lempitsky, V. (November, January 27). Few-shot adversarial learning of realistic neural talking head models. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhang, H., Zhang, Y., Zhan, L.M., Chen, J., Shi, G., Wu, X.M., and Lam, A. (2021). Effectiveness of Pre-training for Few-shot Intent Classification. arXiv.","DOI":"10.18653\/v1\/2021.findings-emnlp.96"},{"key":"ref_25","unstructured":"Flennerhag, S., Schroecker, Y., Zahavy, T., van Hasselt, H., Silver, D., and Singh, S. (2021). Bootstrapped meta-learning. arXiv."},{"key":"ref_26","unstructured":"Finn, C., Abbeel, P., and Levine, S. (2017, January 6\u201311). Model-agnostic meta-learning for fast adaptation of deep networks. Proceedings of the International Conference on Machine Learning, Sydney, NSW, Australia."},{"key":"ref_27","unstructured":"Alet, F., Schneider, M.F., Lozano-Perez, T., and Kaelbling, L.P. (2020). Meta-learning curiosity algorithms. arXiv."},{"key":"ref_28","unstructured":"Flennerhag, S., Rusu, A.A., Pascanu, R., Visin, F., Yin, H., and Hadsell, R. (2019). Meta-learning with warped gradient descent. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhong, Q., Chen, L., and Qian, Y. (2020, January 25\u201328). Few-shot learning for remote sensing image retrieval with maml. Proceedings of the 2020 IEEE International Conference on Image Processing (ICIP), Abu Dhabi, United Arab Emirates.","DOI":"10.1109\/ICIP40778.2020.9191042"},{"key":"ref_30","unstructured":"Jamal, M.A., and Qi, G.J. (November, January 27). Task agnostic meta-learning for few-shot learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seoul, Republic of Korea."},{"key":"ref_31","unstructured":"Li, Z., Zhou, F., Chen, F., and Li, H. (2017). Meta-sgd: Learning to learn quickly for few-shot learning. arXiv."},{"key":"ref_32","unstructured":"Antoniou, A., Edwards, H., and Storkey, A. (2018). How to train your MAML. arXiv."},{"key":"ref_33","unstructured":"Raghu, A., Raghu, M., Bengio, S., and Vinyals, O. (2019). Rapid learning or feature reuse? towards understanding the effectiveness of maml. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Li, W., Zhang, M., Wang, S., Tao, R., and Du, Q. (2022). Graph information aggregation cross-domain few-shot learning for hyperspectral image classification. IEEE Trans. Neural Netw. Learn. Syst.","DOI":"10.1109\/TNNLS.2022.3185795"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Gao, N., Ziesche, H., Vien, N.A., Volpp, M., and Neumann, G. (2022, January 21\u201324). What Matters For Meta-Learning Vision Regression Tasks?. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01436"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Rahman, M.A., and Wang, Y. (2016, January 12\u201314). Optimizing intersection-over-union in deep neural networks for image segmentation. Proceedings of the International Symposium on Visual Computing, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-319-50835-1_22"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12880-015-0068-x","article-title":"Metrics for evaluating 3D medical image segmentation: Analysis, selection, and tool","volume":"15","author":"Taha","year":"2015","journal-title":"BMC Med. Imaging"},{"key":"ref_38","unstructured":"Cozzolino, D., Thies, J., R\u00f6ssler, A., Riess, C., Nie\u00dfner, M., and Verdoliva, L. (2018). Forensictransfer: Weakly-supervised domain adaptation for forgery detection. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3647\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:07:33Z","timestamp":1760123253000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3647"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,31]]},"references-count":38,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["s23073647"],"URL":"https:\/\/doi.org\/10.3390\/s23073647","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,31]]}}}