{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T13:49:49Z","timestamp":1740145789331,"version":"3.37.3"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,10,8]],"date-time":"2020-10-08T00:00:00Z","timestamp":1602115200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,10,8]],"date-time":"2020-10-08T00:00:00Z","timestamp":1602115200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61771346"],"award-info":[{"award-number":["61771346"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Image Video Proc."],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Image completion is an approach to fill a damaged region (hole) in an image. In this study, we adopt a novel method which can repair a target region with structural constraints in an architectural scene. An objective function that consists of three terms is proposed to solve the image completion problem. In color term, we compute a parameterized transformation model using detected plane parameters and measure the distance between the target patch and transformed source patch. This model helps to extend the patch search space and find an optimal solution. To improve the patch matching accuracy, we add a guide term that includes structure term and consistency term. The structure term encourages sampling patches along the structural direction, and the consistency term is used to maintain the texture consistency. Considering the color deviation between patches, we add a gradient term into a framework that can solve more challenging problems. Compared with previous methods, the proposed method has good performance in preserving global structure and reasonably estimating perspective distortions. Moreover, we obtain acceptable results in natural scenes. The experimental results illustrate that this novel method is a potential tool for image completion.<\/jats:p>","DOI":"10.1186\/s13640-020-00533-3","type":"journal-article","created":{"date-parts":[[2020,10,8]],"date-time":"2020-10-08T15:04:55Z","timestamp":1602169495000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Image completion via transformation and structural constraints"],"prefix":"10.1186","volume":"2020","author":[{"given":"Qiaochuan","family":"Chen","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guangyao","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qingguo","family":"Xiao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Li","family":"Xie","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mang","family":"Xiao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,10,8]]},"reference":[{"key":"533_CR1","doi-asserted-by":"publisher","first-page":"3389","DOI":"10.1109\/TMM.2018.2838320","volume":"20","author":"C Yan","year":"2018","unstructured":"C. Yan, H. Xie, J. Chen, et al., A fast Uyghur text detector for complex background images. IEEE Transactions on Multimedia. 20, 3389 (2018)","journal-title":"IEEE Transactions on Multimedia."},{"key":"533_CR2","doi-asserted-by":"crossref","unstructured":"C. Yan, L. Li, C. Zhang, et al., Cross-modality bridging and knowledge transferring for image understanding. IEEE Transactions on Multimedia (2019)","DOI":"10.1109\/TMM.2019.2903448"},{"key":"533_CR3","doi-asserted-by":"crossref","unstructured":"C. Yan, Y. Tu, X. Wang, et al., STAT: spatial-temporal attention mechanism for video captioning. IEEE Transactions on Multimedia (2019)","DOI":"10.1109\/TMM.2020.2966830"},{"key":"533_CR4","doi-asserted-by":"crossref","unstructured":"M. Bertalmio, G. Sapiro, V. Caselles et al. Image inpainting, in Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (ACM Press\/Addison-Wesley Publishing Co., 2000), pp. 417.","DOI":"10.1145\/344779.344972"},{"key":"533_CR5","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1007\/s10851-007-0017-6","volume":"28","author":"F Bornemann","year":"2007","unstructured":"F. Bornemann, T. M\u00e4rz, Fast image inpainting based on coherence transport. Journal of Mathematical Imaging and Vision. 28, 259 (2007)","journal-title":"Journal of Mathematical Imaging and Vision."},{"key":"533_CR6","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1007\/s11263-006-5631-z","volume":"68","author":"D Tschumperl\u00e9","year":"2006","unstructured":"D. Tschumperl\u00e9, Fast anisotropic smoothing of multi-valued images using curvature-preserving PDE's. Int. J. Comput. Vis. 68, 65 (2006)","journal-title":"Int. J. Comput. Vis."},{"key":"533_CR7","doi-asserted-by":"crossref","unstructured":"A. A. Efros and T. K. Leung, Texture synthesis by non-parametric sampling, in Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on (IEEE, 1999), pp. 1033.","DOI":"10.1109\/ICCV.1999.790383"},{"key":"533_CR8","doi-asserted-by":"publisher","first-page":"1200","DOI":"10.1109\/TIP.2004.833105","volume":"13","author":"A Criminisi","year":"2004","unstructured":"A. Criminisi, P. P\u00e9rez, K. Toyama, Region filling and object removal by exemplar-based image inpainting. IEEE Trans. Image Process. 13, 1200 (2004)","journal-title":"IEEE Trans. Image Process."},{"key":"533_CR9","doi-asserted-by":"crossref","unstructured":"J. Sun, L. Yuan, J. Jia et al., Image completion with structure propagation, in ACM Trans. Graph. (ACM, 2005), pp. 861.","DOI":"10.1145\/1073204.1073274"},{"key":"533_CR10","doi-asserted-by":"publisher","first-page":"2649","DOI":"10.1109\/TIP.2007.906269","volume":"16","author":"N Komodakis","year":"2007","unstructured":"N. Komodakis, G. Tziritas, Image completion using efficient belief propagation via priority scheduling and dynamic pruning. IEEE Trans. Image Process. 16, 2649 (2007)","journal-title":"IEEE Trans. Image Process."},{"key":"533_CR11","doi-asserted-by":"crossref","unstructured":"Y. Wexler, E. Shechtman, and M. Irani, Space-time completion of video. IEEE Trans. Pattern Anal. Mach. Intell. 29 (2007).","DOI":"10.1109\/TPAMI.2007.60"},{"key":"533_CR12","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1145\/1531326.1531330","volume":"28","author":"C Barnes","year":"2009","unstructured":"C. Barnes, E. Shechtman, A. Finkelstein, et al., PatchMatch: a randomized correspondence algorithm for structural image editing. ACM Trans. Graph. 28, 24 (2009)","journal-title":"ACM Trans. Graph."},{"key":"533_CR13","doi-asserted-by":"crossref","unstructured":"A. Mansfield, M. Prasad, C. Rother et al. Transforming image completion, in BMVC 2011), pp. 1.","DOI":"10.5244\/C.25.121"},{"key":"533_CR14","doi-asserted-by":"crossref","unstructured":"S. Darabi, E. Shechtman, C. Barnes et al., Image melding: combining inconsistent images using patch-based synthesis. ACM Trans. Graph. 31, 82:1 (2012).","DOI":"10.1145\/2185520.2185578"},{"key":"533_CR15","doi-asserted-by":"crossref","unstructured":"J.-B. Huang, J. Kopf, N. Ahuja et al., Transformation guided image completion, in Computational Photography (ICCP), 2013 IEEE International Conference on (IEEE, 2013), pp. 1.","DOI":"10.1109\/ICCPhot.2013.6528313"},{"key":"533_CR16","first-page":"129","volume":"33","author":"J-B Huang","year":"2014","unstructured":"J.-B. Huang, S.B. Kang, N. Ahuja, et al., Image completion using planar structure guidance. ACM Trans. Graph. 33, 129 (2014)","journal-title":"ACM Trans. Graph."},{"key":"533_CR17","doi-asserted-by":"crossref","unstructured":"J.-B. Huang, A. Singh, and N. Ahuja, Single image super-resolution from transformed self-exemplars, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2015), pp. 5197.","DOI":"10.1109\/CVPR.2015.7299156"},{"key":"533_CR18","doi-asserted-by":"publisher","first-page":"396","DOI":"10.1016\/j.ijleo.2015.10.002","volume":"127","author":"M Xiao","year":"2016","unstructured":"M. Xiao, G. Li, L. Peng, et al., Completion of images of historical artifacts based on salient shapes. Optik-International Journal for Light and Electron Optics. 127, 396 (2016)","journal-title":"Optik-International Journal for Light and Electron Optics."},{"key":"533_CR19","doi-asserted-by":"publisher","first-page":"3779","DOI":"10.1109\/TIP.2013.2261308","volume":"22","author":"O Le Meur","year":"2013","unstructured":"O. Le Meur, M. Ebdelli, C. Guillemot, Hierarchical super-resolution-based inpainting. IEEE Trans. Image Process. 22, 3779 (2013)","journal-title":"IEEE Trans. Image Process."},{"key":"533_CR20","first-page":"131","volume":"31","author":"J Kopf","year":"2012","unstructured":"J. Kopf, W. Kienzle, S. Drucker, et al., Quality prediction for image completion. ACM Trans. Graph. 31, 131 (2012)","journal-title":"ACM Trans. Graph."},{"key":"533_CR21","doi-asserted-by":"crossref","unstructured":"Y. Pritch, E. Kav-Venaki, and S. Peleg, Shift-map image editing, in Computer Vision, 2009 IEEE 12th International Conference on (IEEE, 2009), pp. 151.","DOI":"10.1109\/ICCV.2009.5459159"},{"key":"533_CR22","doi-asserted-by":"crossref","unstructured":"K. He and J. Sun, Statistics of patch offsets for image completion, in Computer Vision\u2013ECCV 2012 (Springer, 2012), pp. 16.","DOI":"10.1007\/978-3-642-33709-3_2"},{"key":"533_CR23","doi-asserted-by":"crossref","unstructured":"D. Pathak, P. Krahenbuhl, J. Donahue et al., Context encoders: Feature learning by inpainting, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2016), pp. 2536.","DOI":"10.1109\/CVPR.2016.278"},{"key":"533_CR24","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1145\/3072959.3073659","volume":"36","author":"S Iizuka","year":"2017","unstructured":"S. Iizuka, E. Simo-Serra, H. Ishikawa, Globally and locally consistent image completion. ACM Trans. Graph. 36, 107 (2017)","journal-title":"ACM Trans. Graph."},{"key":"533_CR25","doi-asserted-by":"crossref","unstructured":"M. Xiao, G. Li, Y. Jiang et al., Image completion using belief propagation based on planar priorities. KSII Transactions on Internet & Information Systems. 10 (2016).","DOI":"10.3837\/tiis.2016.09.021"},{"key":"533_CR26","volume-title":"Multiple view geometry in computer vision Cambridge University Press","author":"R Hartley","year":"2003","unstructured":"R. Hartley, A. Zisserman, Multiple view geometry in computer vision Cambridge University Press (2003)"},{"key":"533_CR27","doi-asserted-by":"crossref","unstructured":"A. Hertzmann, C. E. Jacobs, N. Oliver et al. Image analogies, in Proceedings of the 28th Annual Conference on Computer graphics and interactive techniques (ACM, 2001), pp. 327.","DOI":"10.1145\/383259.383295"},{"key":"533_CR28","doi-asserted-by":"publisher","DOI":"10.1117\/1.JEI.24.1.013032","volume":"24","author":"S Zarif","year":"2015","unstructured":"S. Zarif, I. Faye, D. Rohaya, Image completion based on statistical texture analysis. Journal of Electronic Imaging. 24, 013032 (2015)","journal-title":"Journal of Electronic Imaging."},{"key":"533_CR29","doi-asserted-by":"crossref","unstructured":"O. Chum and J. Matas, Planar affine rectification from change of scale, in Asian Conference on Computer Vision (Springer, 2010), pp. 347.","DOI":"10.1007\/978-3-642-19282-1_28"},{"key":"533_CR30","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1145\/2010324.1964965","volume":"30","author":"Y HaCohen","year":"2011","unstructured":"Y. HaCohen, E. Shechtman, D.B. Goldman, et al., Non-rigid dense correspondence with applications for image enhancement. ACM Trans. Graph. 30, 70 (2011)","journal-title":"ACM Trans. Graph."},{"key":"533_CR31","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1109\/LSP.2012.2227726","volume":"20","author":"A Mittal","year":"2013","unstructured":"A. Mittal, R. Soundararajan, A.C. Bovik, Making a \u201ccompletely blind\u201d image quality analyzer. IEEE Signal Processing Letters. 20, 209 (2013)","journal-title":"IEEE Signal Processing Letters."}],"container-title":["EURASIP Journal on Image and Video Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13640-020-00533-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13640-020-00533-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13640-020-00533-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,7]],"date-time":"2021-10-07T23:55:50Z","timestamp":1633650950000},"score":1,"resource":{"primary":{"URL":"https:\/\/jivp-eurasipjournals.springeropen.com\/articles\/10.1186\/s13640-020-00533-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,8]]},"references-count":31,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["533"],"URL":"https:\/\/doi.org\/10.1186\/s13640-020-00533-3","relation":{},"ISSN":["1687-5281"],"issn-type":[{"type":"electronic","value":"1687-5281"}],"subject":[],"published":{"date-parts":[[2020,10,8]]},"assertion":[{"value":"4 December 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 September 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 October 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"44"}}