{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T05:49:09Z","timestamp":1773726549989,"version":"3.50.1"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2020,9,30]],"date-time":"2020-09-30T00:00:00Z","timestamp":1601424000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,30]],"date-time":"2020-09-30T00:00:00Z","timestamp":1601424000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61703363"],"award-info":[{"award-number":["61703363"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Scientific and Technological Innovation Programs of Higher Education Institutions in Shanxi","award":["2019L0855"],"award-info":[{"award-number":["2019L0855"]}]},{"name":"Scientific Research Project of Yuncheng University","award":["YQ-2017027"],"award-info":[{"award-number":["YQ-2017027"]}]},{"name":"Scientific Research Project of Yuncheng University","award":["XK-2018034"],"award-info":[{"award-number":["XK-2018034"]}]},{"name":"Scientific Research Project of Yuncheng University","award":["CY-2019025"],"award-info":[{"award-number":["CY-2019025"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In the inpainting method for object removal, SSD (Sum of Squared Differences) is commonly used to measure the degree of similarity between the exemplar patch and the target patch, which has a very important impact on the restoration results. Although the matching rule is relatively simple, it is likely to lead to the occurrence of mismatch error. Even worse, the error may be accumulated along with the process continues. Finally some unexpected objects may be introduced into the target region, making the result unable to meet the requirements of visual consistency. In view of these problems, we propose an inpainting method for object removal based on difference degree constraint. Firstly, we define the MSD (Mean of Squared Differences) and use it to measure the degree of differences between corresponding pixels at known positions in the target patch and the exemplar patch. Secondly, we define the SMD (Square of Mean Differences) and use it to measure the degree of differences between the pixels at known positions in the target patch and the pixels at unknown positions in the exemplar patch. Thirdly, based on MSD and SMD, we define a new matching rule and use it to find the most similar exemplar patch in the source region. Finally, we use the exemplar patch to restore the target patch. Experimental results show that the proposed method can effectively prevent the occurrence of mismatch error and improve the restoration effect.<\/jats:p>","DOI":"10.1007\/s11042-020-09835-0","type":"journal-article","created":{"date-parts":[[2020,9,30]],"date-time":"2020-09-30T22:37:36Z","timestamp":1601505456000},"page":"4607-4626","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["An image inpainting method for object removal based on difference degree constraint"],"prefix":"10.1007","volume":"80","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9554-1824","authenticated-orcid":false,"given":"Lei","family":"Zhang","sequence":"first","affiliation":[]},{"given":"Minhui","family":"Chang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,9,30]]},"reference":[{"issue":"11","key":"9835_CR1","doi-asserted-by":"publisher","first-page":"4311","DOI":"10.1109\/TSP.2006.881199","volume":"54","author":"M Aharon","year":"2006","unstructured":"Aharon M, Elad M, Bruckstein A (2006) K-SVD: an algorithm for designing over-complete dictionaries for sparse representation. IEEE Trans Signal Process 54(11):4311\u20134322","journal-title":"IEEE Trans Signal Process"},{"issue":"5","key":"9835_CR2","doi-asserted-by":"publisher","first-page":"898","DOI":"10.1109\/TPAMI.2010.161","volume":"33","author":"P Arbelaez","year":"2011","unstructured":"Arbelaez P, Maire M, Fowlkes C, Malik J (2011) Contour eetection and hierarchical image segmentation. IEEE Trans Pattern Anal Mach Intell 33(5):898\u2013916","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"9835_CR3","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1016\/j.sigpro.2014.11.023","volume":"111","author":"Y Bahat","year":"2015","unstructured":"Bahat Y, Schechner YY, Elad M (2015) Self-content-based audio inpainting. Signal Process 111:61\u201372","journal-title":"Signal Process"},{"issue":"5","key":"9835_CR4","first-page":"3532","volume":"4","author":"M Banday","year":"2014","unstructured":"Banday M, Sharma A (2014) A comparative study of existing exemplar based region filling algorithms. Int J Current Eng Technol 4(5):3532\u20133539","journal-title":"Int J Current Eng Technol"},{"key":"9835_CR5","doi-asserted-by":"crossref","unstructured":"Bertalmio M, Sapiro G, Caselles V, Ballester C (2000) Image inpainting. In: Proceedings of the 27th annual conference on computer graphics and interactive techniques, pp 417\u2013424","DOI":"10.1145\/344779.344972"},{"issue":"4","key":"9835_CR6","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1006\/jvci.2001.0487","volume":"12","author":"TF Chan","year":"2001","unstructured":"Chan TF, Shen J (2001) Nontexture inpainting by curvature-driven diffusions. J Vis Commun Image Represent 12(4):436\u2013449","journal-title":"J Vis Commun Image Represent"},{"issue":"3","key":"9835_CR7","doi-asserted-by":"publisher","first-page":"1019","DOI":"10.1137\/S0036139900368844","volume":"62","author":"TF Chan","year":"2002","unstructured":"Chan TF, Shen J (2002) Mathematical models for local nontexture inpaintings. SIAM J Appl Math 62(3):1019\u20131043","journal-title":"SIAM J Appl Math"},{"issue":"3","key":"9835_CR8","first-page":"121","volume":"29","author":"IC Chang","year":"2019","unstructured":"Chang IC, Wun ZS, Yeh HY (2019) An image inpainting technique on chinese paintings. J Comput (Taiwan) 29(3):121\u2013135","journal-title":"J Comput (Taiwan)"},{"issue":"9","key":"9835_CR9","doi-asserted-by":"publisher","first-page":"1200","DOI":"10.1109\/TIP.2004.833105","volume":"13","author":"A Criminisi","year":"2004","unstructured":"Criminisi A, Prez P, Toyama K (2004) Region filling and object removal by exemplar-based image inpainting. IEEE Trans Image Process 13 (9):1200\u20131212","journal-title":"IEEE Trans Image Process"},{"issue":"10","key":"9835_CR10","first-page":"1","volume":"10","author":"LJ Deng","year":"2015","unstructured":"Deng LJ, Huang TZ, Zhao XL (2015) Exemplar-based image inpainting using a modified priority definition. PLOS one 10(10):1\u201318","journal-title":"PLOS one"},{"issue":"6","key":"9835_CR11","doi-asserted-by":"publisher","first-page":"4777","DOI":"10.1109\/TIE.2018.2866043","volume":"66","author":"X Dong","year":"2019","unstructured":"Dong X, Dong J, Sun G, Duan Y, Qi L, Yu H (2019) Learning-Based Texture synthesis and automatic inpainting using support vector machines. IEEE Trans Ind Electron 66(6):4777\u20134787","journal-title":"IEEE Trans Ind Electron"},{"key":"9835_CR12","doi-asserted-by":"crossref","unstructured":"Efros AA, Leung TK (1999) Texture synthesis by non-parametric sampling. In: The Proceedings of the Seventh IEEE international conference on computer vision, (2), pp 1033\u20131038","DOI":"10.1109\/ICCV.1999.790383"},{"issue":"3","key":"9835_CR13","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1016\/j.acha.2005.03.005","volume":"19","author":"M Elad","year":"2005","unstructured":"Elad M, Starck JL, Querre P, Donoho DL (2005) Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA). Appl Comput Harmon Anal 19(3):340\u2013358","journal-title":"Appl Comput Harmon Anal"},{"issue":"4","key":"9835_CR14","first-page":"176","volume":"2","author":"SR Gaonkar","year":"2014","unstructured":"Gaonkar SR, Hire PD, Pimple PS, Kotwal YR (2014) Image inpainting using robust exemplar-based technique. Int J Comput Sci Eng 2(4):176\u2013179","journal-title":"Int J Comput Sci Eng"},{"issue":"2","key":"9835_CR15","doi-asserted-by":"publisher","first-page":"556","DOI":"10.1109\/TIP.2017.2768180","volume":"27","author":"M Ghorai","year":"2018","unstructured":"Ghorai M, Mandal S, Chanda B (2018) A group-based image inpainting using patch refinement in mrf framework. IEEE Trans Image Process 27 (2):556\u2013567","journal-title":"IEEE Trans Image Process"},{"key":"9835_CR16","first-page":"1","volume":"6","author":"IJ Goodfellow","year":"2014","unstructured":"Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial networks. Adv Neural Inform Process Syst 6:1\u20139","journal-title":"Adv Neural Inform Process Syst"},{"issue":"6","key":"9835_CR17","doi-asserted-by":"publisher","first-page":"2023","DOI":"10.1109\/TVCG.2017.2702738","volume":"24","author":"Q Guo","year":"2018","unstructured":"Guo Q, Gao S, Zhang X, Yin Y, Zhang C (2018) Patch-based image inpainting via two-stage low rank approximation. IEEE Trans Vis Comput Graph 24(6):2023\u20132036","journal-title":"IEEE Trans Vis Comput Graph"},{"issue":"7","key":"9835_CR18","first-page":"1067","volume":"26","author":"W Hu","year":"2014","unstructured":"Hu W, Li Z, Liu Z (2014) Fast morphological component analysis Tangka image inpainting based on nonlocal mean filter. J Comput-Aided Design and Comput Graph 26(7):1067\u20131074","journal-title":"J Comput-Aided Design and Comput Graph"},{"key":"9835_CR19","doi-asserted-by":"crossref","unstructured":"Hu G, Xiong L (2017) Criminisi-based sparse representation for image inpainting. In: 2017 IEEE third international conference on multimedia big data, pp 389\u2013393","DOI":"10.1109\/BigMM.2017.43"},{"issue":"6","key":"9835_CR20","doi-asserted-by":"publisher","first-page":"8","DOI":"10.9790\/0661-1360813","volume":"13","author":"MS Ishi","year":"2013","unstructured":"Ishi MS, Singh L, Agrawal M (2013) A review on image inpainting to restore image. IOSR J Comput Eng 13(6):8\u201313","journal-title":"IOSR J Comput Eng"},{"key":"9835_CR21","doi-asserted-by":"publisher","first-page":"69728","DOI":"10.1109\/ACCESS.2018.2877401","volume":"6","author":"M Isogawa","year":"2018","unstructured":"Isogawa M, Mikami D, Iwai D, Kimata H, Sato K (2018) Mask optimization for image inpainting. IEEE Access 6:69728\u201369741","journal-title":"IEEE Access"},{"key":"9835_CR22","doi-asserted-by":"publisher","first-page":"22884","DOI":"10.1109\/ACCESS.2020.2970169","volume":"8","author":"Y Jiang","year":"2020","unstructured":"Jiang Y, Xu J, Yang B, Xu J, Zhu J (2020) Image inpainting based on generative adversarial networks. IEEE Access 8:22884\u201322892","journal-title":"IEEE Access"},{"key":"9835_CR23","doi-asserted-by":"publisher","first-page":"61761","DOI":"10.1109\/ACCESS.2018.2876161","volume":"6","author":"H Liu","year":"2019","unstructured":"Liu H, Bi X, Lu G, Wang W (2019) Screen window propagating for image inpainting. IEEE Access 6:61761\u201361772","journal-title":"IEEE Access"},{"issue":"12","key":"9835_CR24","first-page":"2754","volume":"35","author":"Y Liu","year":"2014","unstructured":"Liu Y, Wang F, Xi X, Liu Z (2014) Improved algorithm for image inpainting based on texture synthesis. J Chinese Comput Syst 35(12):2754\u20132758","journal-title":"J Chinese Comput Syst"},{"key":"9835_CR25","doi-asserted-by":"crossref","unstructured":"Lu X, Wang W, Ma C, Shen J, Shao L, Porikli F (2019) See more, know more: unsupervised video object segmentation with co-attention siamese networks. CVPR pp 3623\u20133632","DOI":"10.1109\/CVPR.2019.00374"},{"key":"9835_CR26","doi-asserted-by":"crossref","unstructured":"Lu X, Wang W, Shen J, Tai YW, Crandall D, Steven CH (2020) Hoi, learning video object segmentation from unlabeled videos CVPR","DOI":"10.1109\/CVPR42600.2020.00898"},{"issue":"3","key":"9835_CR27","doi-asserted-by":"publisher","first-page":"7593","DOI":"10.1007\/s10586-018-2323-8","volume":"22","author":"J Mo","year":"2019","unstructured":"Mo J, Zhou Y (2019) The research of image inpainting algorithm using self-adaptive group structure and sparse representation. Clust Comput 22(3):7593\u20137601","journal-title":"Clust Comput"},{"issue":"1","key":"9835_CR28","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1007\/s40314-019-0761-4","volume":"38","author":"P Mousavi","year":"2019","unstructured":"Mousavi P, Tavakoli A (2019) A new algorithm for image inpainting in fourier transform domain. Comput Appl Math 38(1):22\u201330","journal-title":"Comput Appl Math"},{"key":"9835_CR29","doi-asserted-by":"crossref","unstructured":"Nan A, XI X (2014) An improved criminisi algorithm based on a new priority function and updating confidence. In: International conference on biomedical engineering and informatics, pp 885\u2013889","DOI":"10.1109\/BMEI.2014.7002897"},{"key":"9835_CR30","doi-asserted-by":"crossref","unstructured":"Ogawa T, Haseyama M (2017) Exemplar-based image completion via new quality measure based on phaseless texture features. In: IEEE International conference on acoustics speech and signal processing, pp 1827\u20131831","DOI":"10.1109\/ICASSP.2017.7952472"},{"issue":"6","key":"9835_CR31","first-page":"1","volume":"38","author":"BV Rathish Kumar","year":"2019","unstructured":"Rathish Kumar BV, Halim A (2019) A linear fourth-order pde-based gray-scale image inpainting model. Comput Appl Math 38(6):1\u201321","journal-title":"Comput Appl Math"},{"key":"9835_CR32","doi-asserted-by":"crossref","unstructured":"Sagong M, Shin Y, Kim S, Park S, Ko S (2019) PEPSI:Fast image inpainting with parallel decoding network. CVPR pp 11360\u201311368","DOI":"10.1109\/CVPR.2019.01162"},{"key":"9835_CR33","doi-asserted-by":"crossref","unstructured":"Sangeetha K, Sengottuvelan P, Balamurugan E (2013) Performance analysis of exemplar based image inpainting algorithms for natural scene image completion. In: 2013 7th international conference on intelligent systems and control, pp 276\u2013279","DOI":"10.1109\/ISCO.2013.6481162"},{"key":"9835_CR34","doi-asserted-by":"crossref","unstructured":"Shen B, Hu W, Zhang Y, Zhang YJ (2009) Image inpainting via sparse representation. In: IEEE international conference on acoustics, speech and signal processing, pp 697\u2013700","DOI":"10.1109\/ICASSP.2009.4959679"},{"issue":"3","key":"9835_CR35","doi-asserted-by":"publisher","first-page":"308","DOI":"10.14429\/dsj.67.10665","volume":"67","author":"G Sridevi","year":"2017","unstructured":"Sridevi G, Kumar SS (2017) Image inpainting and enhancement using fractional order variational model. Def Sci J 67(3):308\u2013315","journal-title":"Def Sci J"},{"issue":"10","key":"9835_CR36","doi-asserted-by":"publisher","first-page":"3637","DOI":"10.1002\/mma.4250","volume":"40","author":"A Theljani","year":"2017","unstructured":"Theljani A, Belhachmi Z, Kallel M, Moakher M (2017) A multiscale fourth-order model for the image inpainting and low-dimensional sets recovery. Math Meth Appl Sci 40(10):3637\u20133650","journal-title":"Math Meth Appl Sci"},{"key":"9835_CR37","doi-asserted-by":"crossref","unstructured":"Wagh PD, Patil DR (2015) Text detection and removal from image using inpainting with smoothing. In: 2015 international conference on pervasive computing, pp 1\u20134","DOI":"10.1109\/PERVASIVE.2015.7087154"},{"key":"9835_CR38","doi-asserted-by":"crossref","unstructured":"Wong A, Orchard J (2008) A nonlocal-means approach to exemplar-based inpainting. In: 15th international conference on image processing, pp 2600\u20132603","DOI":"10.1109\/ICIP.2008.4712326"},{"issue":"5","key":"9835_CR39","doi-asserted-by":"publisher","first-page":"1153","DOI":"10.1109\/TIP.2010.2042098","volume":"19","author":"Z Xu","year":"2010","unstructured":"Xu Z, Sun J (2010) Image inpainting by patch propagation using patch sparsity. IEEE Trans Image Process 19(5):1153\u20131165","journal-title":"IEEE Trans Image Process"},{"issue":"9","key":"9835_CR40","doi-asserted-by":"publisher","first-page":"734","DOI":"10.1049\/iet-ipr.2016.1004","volume":"11","author":"X Yang","year":"2017","unstructured":"Yang X, Guo B (2017) Fractional-order tensor regularization for image inpainting. IET Image Process 11(9):734\u2013745","journal-title":"IET Image Process"},{"issue":"6","key":"9835_CR41","doi-asserted-by":"publisher","first-page":"13683","DOI":"10.1007\/s10586-018-2068-4","volume":"22","author":"F Yao","year":"2019","unstructured":"Yao F (2019) Damaged region filling by improved criminisi image inpainting algorithm for thangka. Clust Comput 22(6):13683\u201313691","journal-title":"Clust Comput"},{"key":"9835_CR42","doi-asserted-by":"crossref","unstructured":"Zeng Y, Fu J, Chao H, Guo B (2019) Learning pyramid-context encoder network for high-quality image inpainting. CVPR pp 1486\u20131494","DOI":"10.1109\/CVPR.2019.00158"},{"key":"9835_CR43","first-page":"1","volume":"70","author":"N Zhang","year":"2019","unstructured":"Zhang N, Ji H, Liu L, Wang G (2019) Exemplar-based image inpainting using angle-aware patch matching. EURASIP J Image Video Process 70:1\u201313","journal-title":"EURASIP J Image Video Process"},{"issue":"1","key":"9835_CR44","first-page":"113","volume":"12","author":"L Zhang","year":"2016","unstructured":"Zhang L, Kang B, Liu B, Bao Z (2016) A new inpainting method for object removal based on patch local feature and sparse representation. Int J Innovat Comput Inf Control 12(1):113\u2013124","journal-title":"Int J Innovat Comput Inf Control"},{"issue":"9","key":"9835_CR45","first-page":"177","volume":"9","author":"L Zhang","year":"2016","unstructured":"Zhang L, Kang B, Liu B, Zhang F (2016) Image inpainting based on exemplar and sparse representation, international journal of signal processing. Image Process Pattern Recog 9(9):177\u2013188","journal-title":"Image Process Pattern Recog"},{"issue":"11","key":"9835_CR46","first-page":"2983","volume":"6","author":"L Zhang","year":"2015","unstructured":"Zhang L, Kang B, Zhang F, Li X (2015) Exemplar-based image inpainting using local feature constraints, ICIC express letters. Part B: Appl 6(11):2983\u20132988","journal-title":"Part B: Appl"},{"issue":"8","key":"9835_CR47","first-page":"127","volume":"50","author":"S Zhang","year":"2014","unstructured":"Zhang S, Wang K, Zhu X (2014) Improved criminisi algorithm constrained by local feature. Comput Eng Appl 50(8):127\u2013130","journal-title":"Comput Eng Appl"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-09835-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-020-09835-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-09835-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,21]],"date-time":"2022-11-21T12:39:37Z","timestamp":1669034377000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-020-09835-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,30]]},"references-count":47,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["9835"],"URL":"https:\/\/doi.org\/10.1007\/s11042-020-09835-0","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"value":"1380-7501","type":"print"},{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,30]]},"assertion":[{"value":"21 February 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 August 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 September 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 September 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with Ethical Standards"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Conflict of interests"}}]}}