{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T06:34:00Z","timestamp":1781246040904,"version":"3.54.1"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2014,11,19]],"date-time":"2014-11-19T00:00:00Z","timestamp":1416355200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100002920","name":"Research Grants Council, University Grants Committee, Hong Kong","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002920","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61120106007, 61133008"],"award-info":[{"award-number":["61120106007, 61133008"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004147","name":"Tsinghua University","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004147","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002855","name":"Ministry of Science and Technology of the People's Republic of China","doi-asserted-by":"publisher","award":["2011CB302205"],"award-info":[{"award-number":["2011CB302205"]}],"id":[{"id":"10.13039\/501100002855","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002855","name":"Ministry of Science and Technology of the People's Republic of China","doi-asserted-by":"publisher","award":["2012AA011801"],"award-info":[{"award-number":["2012AA011801"]}],"id":[{"id":"10.13039\/501100002855","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2014,11,19]]},"abstract":"<jats:p>Filling a small hole in an image with plausible content is well studied. Extrapolating an image to give a distinctly larger one is much more challenging---a significant amount of additional content is needed which matches the original image, especially near its boundaries. We propose a data-driven approach to this problem. Given a source image, and the amount and direction(s) in which it is to be extrapolated, our system determines visually consistent content for the extrapolated regions using library images. As well as considering low-level matching, we achieve consistency at a higher level by using graph proxies for regions of source and library images. Treating images as graphs allows us to find candidates for image extrapolation in a feasible time. Consistency of subgraphs in source and library images is used to find good candidates for the additional content; these are then further filtered. Region boundary curves are aligned to ensure consistency where image parts are joined using a photomontage method. We demonstrate the power of our method in image editing applications.<\/jats:p>","DOI":"10.1145\/2661229.2661278","type":"journal-article","created":{"date-parts":[[2014,11,18]],"date-time":"2014-11-18T14:21:03Z","timestamp":1416320463000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":48,"title":["BiggerPicture"],"prefix":"10.1145","volume":"33","author":[{"given":"Miao","family":"Wang","sequence":"first","affiliation":[{"name":"Tsinghua University, Beijing"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu-Kun","family":"Lai","sequence":"additional","affiliation":[{"name":"Cardiff University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuan","family":"Liang","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ralph R.","family":"Martin","sequence":"additional","affiliation":[{"name":"Cardiff University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shi-Min","family":"Hu","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2014,11,19]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.161"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276390"},{"key":"e_1_2_1_3_1","volume-title":"Proc. IEEE Symp. String Processing and Information Retrieval, 28--38","author":"Baeza-Yates R.","unstructured":"Baeza-Yates , R. , and Valiente , G . 2000. An image similarity measure based on graph matching . In Proc. IEEE Symp. String Processing and Information Retrieval, 28--38 . Baeza-Yates, R., and Valiente, G. 2000. An image similarity measure based on graph matching. In Proc. IEEE Symp. String Processing and Information Retrieval, 28--38."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531330"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618470"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.148"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024190"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0218001404003228"},{"key":"e_1_2_1_9_1","first-page":"721","article-title":"Object removal by exemplar-based inpainting","volume":"2","author":"Criminisi A.","year":"2003","unstructured":"Criminisi , A. , Perez , P. , and Toyama , K. 2003 . Object removal by exemplar-based inpainting . In Proc. CVPR , vol. 2 , 721 -- 728 . Criminisi, A., Perez, P., and Toyama, K. 2003. Object removal by exemplar-based inpainting. In Proc. CVPR, vol. 2, 721--728.","journal-title":"Proc. CVPR"},{"key":"e_1_2_1_10_1","volume-title":"Proc. ICCV, 2217--2224","author":"Dale K.","unstructured":"Dale , K. , Johnson , M. K. , Sunkavalli , K. , Matusik , W. , and Pfister , H . 2009. Image restoration using online photo collections . In Proc. ICCV, 2217--2224 . Dale, K., Johnson, M. K., Sunkavalli, K., Matusik, W., and Pfister, H. 2009. Image restoration using online photo collections. In Proc. ICCV, 2217--2224."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185578"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531373"},{"key":"e_1_2_1_13_1","volume-title":"Proc. ICCV, 1--8.","author":"Gould S.","unstructured":"Gould , S. , Fulton , R. , and Koller , D . 2009. Decomposing a scene into geometric and semantically consistent regions . In Proc. ICCV, 1--8. Gould, S., Fulton, R., and Koller, D. 2009. Decomposing a scene into geometric and semantically consistent regions. In Proc. ICCV, 1--8."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461997"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276382"},{"key":"e_1_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Hlaoui A. and Wang S. 2002. A new algorithm for graph matching with application to content-based image retrieval. In Structural Syntactic and Statistical Pattern Recognition. 291--300.   Hlaoui A. and Wang S. 2002. A new algorithm for graph matching with application to content-based image retrieval. In Structural Syntactic and Statistical Pattern Recognition . 291--300.","DOI":"10.1007\/3-540-70659-3_30"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-013-0792-6"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508381"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508373"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.70729"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.233"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the IEEE.","author":"Kaneva B.","unstructured":"Kaneva , B. , Sivic , J. , Torralba , A. , Avidan , S. , and Freeman , W. T . 2010. Infinite images: Creating and exploring a large photorealistic virtual space . In Proceedings of the IEEE. Kaneva, B., Sivic, J., Torralba, A., Avidan, S., and Freeman, W. T. 2010. Infinite images: Creating and exploring a large photorealistic virtual space. In Proceedings of the IEEE."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409069"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366150"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882264"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.68"},{"key":"e_1_2_1_27_1","volume-title":"Proc. CVPR, 1--8.","author":"Lee Y. J.","unstructured":"Lee , Y. J. , and Grauman , K . 2010. Object-graphs for context-aware category discovery . In Proc. CVPR, 1--8. Lee, Y. J., and Grauman, K. 2010. Object-graphs for context-aware category discovery. In Proc. CVPR, 1--8."},{"key":"e_1_2_1_28_1","volume-title":"Proc. ICCV, 305--312","author":"Levin A.","unstructured":"Levin , A. , Zomet , A. , and Weiss , Y . 2003. Learning how to inpaint from global image statistics . In Proc. ICCV, 305--312 . Levin, A., Zomet, A., and Weiss, Y. 2003. Learning how to inpaint from global image statistics. In Proc. ICCV, 305--312."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.16"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.77"},{"key":"e_1_2_1_31_1","volume-title":"Proc. CVPR","author":"Liu C.","unstructured":"Liu , C. , Yuen , J. , and Torralba , A . 2009. Nonparametric scene parsing: Label transfer via dense scene alignment . In Proc. CVPR , 1972--1979. Liu, C., Yuen, J., and Torralba, A. 2009. Nonparametric scene parsing: Label transfer via dense scene alignment. In Proc. CVPR, 1972--1979."},{"key":"e_1_2_1_32_1","volume-title":"Proc. NIPS, 1222--1230","author":"Malisiewicz T.","unstructured":"Malisiewicz , T. , and Efros , A . 2009. Beyond categories: The visual memex model for reasoning about object relationships . In Proc. NIPS, 1222--1230 . Malisiewicz, T., and Efros, A. 2009. Beyond categories: The visual memex model for reasoning about object relationships. In Proc. NIPS, 1222--1230."},{"key":"e_1_2_1_33_1","first-page":"416","article-title":"A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics","volume":"2","author":"Martin D.","year":"2001","unstructured":"Martin , D. , Fowlkes , C. , Tal , D. , and Malik , J. 2001 . A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics . In Proc. ICCV , vol. 2 , 416 -- 423 . Martin, D., Fowlkes, C., Tal, D., and Malik, J. 2001. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In Proc. ICCV, vol. 2, 416--423.","journal-title":"Proc. ICCV"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1011139631724"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882269"},{"key":"e_1_2_1_36_1","volume-title":"Proc. ICCP, IEEE, 1--8.","author":"Poleg Y.","unstructured":"Poleg , Y. , and Peleg , S . 2012. Alignment and mosaicing of non-overlapping images . In Proc. ICCP, IEEE, 1--8. Poleg, Y., and Peleg, S. 2012. Alignment and mosaicing of non-overlapping images. In Proc. ICCP, IEEE, 1--8."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508419"},{"key":"e_1_2_1_38_1","volume-title":"Proc. ICCV, 1470--1477","author":"Sivic J.","unstructured":"Sivic , J. , and Zisserman , A . 2003. Video google: A text retrieval approach to object matching in videos . In Proc. ICCV, 1470--1477 . Sivic, J., and Zisserman, A. 2003. Video google: A text retrieval approach to object matching in videos. In Proc. ICCV, 1470--1477."},{"key":"e_1_2_1_39_1","volume-title":"Proc. CVPR Workshop, 1--8.","author":"Sivic J.","unstructured":"Sivic , J. , Kaneva , B. , Torralba , A. , Avidan , S. , and Freeman , W. T . 2008. Creating and exploring a large photorealistic virtual space . In Proc. CVPR Workshop, 1--8. Sivic, J., Kaneva, B., Torralba, A., Avidan, S., and Freeman, W. T. 2008. Creating and exploring a large photorealistic virtual space. In Proc. CVPR Workshop, 1--8."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-012-0574-z"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.128"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.60"},{"key":"e_1_2_1_43_1","volume-title":"Proc. CVPR, IEEE, 3485--3492","author":"Xiao J.","unstructured":"Xiao , J. , Hays , J. , Ehinger , K. A. , Oliva , A. , and Torralba , A . 2010. Sun database: Large-scale scene recognition from abbey to zoo . In Proc. CVPR, IEEE, 3485--3492 . Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., and Torralba, A. 2010. Sun database: Large-scale scene recognition from abbey to zoo. In Proc. CVPR, IEEE, 3485--3492."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-011-0616-5"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.155"},{"key":"e_1_2_1_46_1","volume-title":"Proc. CVPR, 127--134","author":"Zhou F.","year":"2012","unstructured":"Zhou , F. , and De la Torre , F. 2012 . Factorized graph matching . In Proc. CVPR, 127--134 . Zhou, F., and De la Torre, F. 2012. Factorized graph matching. In Proc. CVPR, 127--134."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2661229.2661278","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2661229.2661278","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:13:05Z","timestamp":1750227185000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2661229.2661278"}},"subtitle":["data-driven image extrapolation using graph matching"],"short-title":[],"issued":{"date-parts":[[2014,11,19]]},"references-count":46,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2014,11,19]]}},"alternative-id":["10.1145\/2661229.2661278"],"URL":"https:\/\/doi.org\/10.1145\/2661229.2661278","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,11,19]]},"assertion":[{"value":"2014-11-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}