{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T18:17:01Z","timestamp":1758824221395,"version":"3.41.0"},"reference-count":64,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2011,1,1]],"date-time":"2011-01-01T00:00:00Z","timestamp":1293840000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2011,1]]},"abstract":"<jats:p>We present a method for image interpolation that is able to create high-quality, perceptually convincing transitions between recorded images. By implementing concepts derived from human vision, the problem of a physically correct image interpolation is relaxed to that of image interpolation which is perceived as visually correct by human observers. We find that it suffices to focus on exact edge correspondences, homogeneous regions and coherent motion to compute convincing results. A user study confirms the visual quality of the proposed image interpolation approach. We show how each aspect of our approach increases perceived quality of the result. We compare the results to other methods and assess achievable quality for different types of scenes.<\/jats:p>","DOI":"10.1145\/1870076.1870079","type":"journal-article","created":{"date-parts":[[2011,1,25]],"date-time":"2011-01-25T19:12:52Z","timestamp":1295982772000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":28,"title":["Perception-motivated interpolation of image sequences"],"prefix":"10.1145","volume":"8","author":[{"given":"Timo","family":"Stich","sequence":"first","affiliation":[{"name":"TU Braunschweig"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian","family":"Linz","sequence":"additional","affiliation":[{"name":"TU Braunschweig"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian","family":"Wallraven","sequence":"additional","affiliation":[{"name":"Max Planck Institute Biological Cybernetics"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Douglas","family":"Cunningham","sequence":"additional","affiliation":[{"name":"University of T\u00fcbingen"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marcus","family":"Magnor","sequence":"additional","affiliation":[{"name":"TU Braunschweig"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2011,2,2]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Adelson E. and Bergen J. 1991. The plenoptic function and the elements of early vision. In Computational Models of Visual Processing M. Landy and J. Movshon Eds. MIT Press Cambridge MA 3--20. Adelson E. and Bergen J. 1991. The plenoptic function and the elements of early vision. In Computational Models of Visual Processing M. Landy and J. Movshon Eds. MIT Press Cambridge MA 3--20.","DOI":"10.7551\/mitpress\/2002.003.0004"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000011205.11775.fd"},{"volume-title":"Proceedings of the International Conference on Computer Vision (ICCV '07)","author":"Baker S.","key":"e_1_2_1_3_1","unstructured":"Baker , S. , Scharstein , D. , Lewis , J. , th, S. R., Black , M. , and Szeliski , R . 2007. A database and evaluation methodology for optical flow . In Proceedings of the International Conference on Computer Vision (ICCV '07) . IEEE, Los Alamitos, CA, 1--8. Baker, S., Scharstein, D., Lewis, J., th, S. R., Black, M., and Szeliski, R. 2007. A database and evaluation methodology for optical flow. In Proceedings of the International Conference on Computer Vision (ICCV '07). IEEE, Los Alamitos, CA, 1--8."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01420984"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/133994.134003"},{"volume-title":"Proceedings of the International Conference on Computer Vision (ICCV'01)","author":"Belongie S.","key":"e_1_2_1_6_1","unstructured":"Belongie , S. , Malik , J. , and Puzicha , J . 2001. Matching shapes . In Proceedings of the International Conference on Computer Vision (ICCV'01) . IEEE, Los Alamitos, CA, 454--461. Belongie, S., Malik, J., and Puzicha, J. 2001. Matching shapes. In Proceedings of the International Conference on Computer Vision (ICCV'01). IEEE, Los Alamitos, CA, 454--461."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00247653"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1006\/cviu.1996.0006"},{"key":"e_1_2_1_9_1","unstructured":"Bouguet J. Y. 2000. Pyramidal implementation of the lucas-kanade feature tracker: Description of the algorithm. Tech. rep. Intel Microprocessor Research Labs. Bouguet J. Y. 2000. Pyramidal implementation of the lucas-kanade feature tracker: Description of the algorithm. Tech. rep. Intel Microprocessor Research Labs."},{"volume-title":"Proceedings of the European Conference on Computer Vision (ECCV'04)","author":"Brox T.","key":"e_1_2_1_10_1","unstructured":"Brox , T. , Bruhn , A. , Papenberg , N. , and Weickert , J . 2004. High accuracy optical flow estimation based on a theory for warping . In Proceedings of the European Conference on Computer Vision (ECCV'04) . Springer-Verlag, Berlin, 25--36. Brox, T., Bruhn, A., Papenberg, N., and Weickert, J. 2004. High accuracy optical flow estimation based on a theory for warping. In Proceedings of the European Conference on Computer Vision (ECCV'04). Springer-Verlag, Berlin, 25--36."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/1028916.1035417"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383309"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1986.4767851"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1201775.882309"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/166117.166153"},{"volume-title":"Proceedings of the 26th DAGM Symposium on Pattern Recognition. Springer-Verlag","author":"Cooke T.","key":"e_1_2_1_16_1","unstructured":"Cooke , T. , Cunningham , D. , and B\u00fclthoff , H . 2004. The perceptual influence of spatiotemporal noise on the reconstruction of shape from dynamic occlusion . In Proceedings of the 26th DAGM Symposium on Pattern Recognition. Springer-Verlag , Berlin, 407--414. Cooke, T., Cunningham, D., and B\u00fclthoff, H. 2004. The perceptual influence of spatiotemporal noise on the reconstruction of shape from dynamic occlusion. In Proceedings of the 26th DAGM Symposium on Pattern Recognition. Springer-Verlag, Berlin, 407--414."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1068\/p270403"},{"volume-title":"Proceedings of the Eurographics Rendering Workshop (EGRW '98)","author":"Debevec P.","key":"e_1_2_1_18_1","unstructured":"Debevec , P. , Borshukov , G. , and Yu , Y . 1998. Efficient view-dependent image-based rendering with projective texture-mapping . In Proceedings of the Eurographics Rendering Workshop (EGRW '98) . Springer-Verlag, Berlin, 105--116. Debevec, P., Borshukov, G., and Yu, Y. 1998. Efficient view-dependent image-based rendering with projective texture-mapping. In Proceedings of the Eurographics Rendering Workshop (EGRW '98). Springer-Verlag, Berlin, 105--116."},{"key":"e_1_2_1_19_1","unstructured":"Exner S. 1894. Entwurf zu einer physiologischen Erkl\u00e4rung der psychischen Erscheinungen. F. Deuticke Leipzig Wien. Exner S. 1894. Entwurf zu einer physiologischen Erkl\u00e4rung der psychischen Erscheinungen. F. Deuticke Leipzig Wien."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000022288.19776.77"},{"volume-title":"Proceedings of the International Conference on Image Processing (ICIP \u201802)","author":"Fu M. F.","key":"e_1_2_1_21_1","unstructured":"Fu , M. F. , Au , O. , and Chan , W. C . 2002. Temporal interpolation using wavelet domain motion estimation and motion compensation . In Proceedings of the International Conference on Image Processing (ICIP \u201802) . IEEE, Los Alamtios, CA, 393--396. Fu, M. F., Au, O., and Chan, W. C. 2002. Temporal interpolation using wavelet domain motion estimation and motion compensation. In Proceedings of the International Conference on Image Processing (ICIP \u201802). IEEE, Los Alamtios, CA, 393--396."},{"volume-title":"The Perception of the Visual World","author":"Gibson J.","key":"e_1_2_1_22_1","unstructured":"Gibson , J. 1955. The Perception of the Visual World . Cambridge University Press , Cambridg, UK . Gibson, J. 1955. The Perception of the Visual World. Cambridge University Press, Cambridg, UK."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03210533"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237200"},{"key":"e_1_2_1_25_1","unstructured":"Hartley R. and Zisserman H. 2000. Multiple View Geometry in Computer Vision. Cambridge University Press Cambridge UK. Hartley R. and Zisserman H. 2000. Multiple View Geometry in Computer Vision. Cambridge University Press Cambridge UK."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.19-16-07162.1999"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(81)90024-2"},{"edition":"2","volume-title":"Hubel, D. 1995. Eye, Brain, and Vision","key":"e_1_2_1_28_1","unstructured":"Hubel, D. 1995. Eye, Brain, and Vision 2 nd Ed. W. H. Freeman , New York . Hubel, D. 1995. Eye, Brain, and Vision 2nd Ed. W. H. Freeman, New York."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344929"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCOM.1981.1094950"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8721.ep10770407"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237199"},{"volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence. 674--679","author":"Lucas B.","key":"e_1_2_1_33_1","unstructured":"Lucas , B. and Kanade , T. 1981. \u201can iterative image registration technique with an application to stereo vision \u201d. In Proceedings of the International Joint Conference on Artificial Intelligence. 674--679 . Lucas, B. and Kanade, T. 1981. \u201can iterative image registration technique with an application to stereo vision\u201d. In Proceedings of the International Joint Conference on Artificial Intelligence. 674--679."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/253284.253292"},{"key":"e_1_2_1_35_1","volume-title":"Vision: A Computational Investigation into the Human Representation and Processing of Visual Information","author":"Marr D.","year":"1983","unstructured":"Marr , D. 1983 . Vision: A Computational Investigation into the Human Representation and Processing of Visual Information . W. H. Freeman . Marr, D. 1983. Vision: A Computational Investigation into the Human Representation and Processing of Visual Information. W. H. Freeman."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344951"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186562.1015805"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218398"},{"key":"e_1_2_1_39_1","unstructured":"Microsoft Corporation. Media player 9 video quality demos. http:\/\/www.microsoft.com\/windows\/windowsmedia\/demos\/video quality demos.aspx. Microsoft Corporation. Media player 9 video quality demos. http:\/\/www.microsoft.com\/windows\/windowsmedia\/demos\/video quality demos.aspx."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.56205"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0042-6989(96)00164-2"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1399504.1360659"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1275808.1276472"},{"volume-title":"Sensory communication","author":"Reichardt W.","key":"e_1_2_1_45_1","unstructured":"Reichardt , W. 1961. Autocorrelation , A principle for the evaluation of sensory information by the central nervous system . In Sensory communication , W. Rosenblith Ed., MIT Press-Wiley , New York , 303--317. Reichardt, W. 1961. Autocorrelation, A principle for the evaluation of sensory information by the central nervous system. In Sensory communication, W. Rosenblith Ed., MIT Press-Wiley, New York, 303--317."},{"volume-title":"Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR'99)","author":"Ruzon M.","key":"e_1_2_1_46_1","unstructured":"Ruzon , M. and Tomasi , C . 1999. Color edge detection with the compass operator . In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR'99) . IEEE, Los Alamitos, 160--166. Ruzon, M. and Tomasi, C. 1999. Color edge detection with the compass operator. In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR'99). IEEE, Los Alamitos, 160--166."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1179352.1141920"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237196"},{"key":"e_1_2_1_49_1","volume-title":"Object: Segmentation and Grouping in Vision","author":"Shipley T.","year":"2001","unstructured":"Shipley , T. and Cunningham , D . 2001 . Perception of occluding and occluded objects over time: Spatiotemporal segmentation and unit formation. In From Fragments to Object: Segmentation and Grouping in Vision . Elsevier Science Ltd., Oxford, UK , 557--585. Shipley, T. and Cunningham, D. 2001. Perception of occluding and occluded objects over time: Spatiotemporal segmentation and unit formation. In From Fragments to Object: Segmentation and Grouping in Vision. Elsevier Science Ltd., Oxford, UK, 557--585."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1179352.1141964"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2008.01323.x"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1394281.1394299"},{"volume-title":"Proceedings of the International Conference on Image Processing (ICIP '01)","author":"Tourapis A.","key":"e_1_2_1_53_1","unstructured":"Tourapis , A. , Cheong , H. , Liou , M. , and Au , O . 2001. Temporal interpolation of video sequences using zonal based algorithms . In Proceedings of the International Conference on Image Processing (ICIP '01) . IEEE, Los Alamitos, CA, 895--898. Tourapis, A., Cheong, H., Liou, M., and Au, O. 2001. Temporal interpolation of video sequences using zonal based algorithms. In Proceedings of the International Conference on Image Processing (ICIP '01). IEEE, Los Alamitos, CA, 895--898."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.2.000300"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1394281.1394304"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1275808.1276473"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1061347.1061351"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02409790"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1278387.1278390"},{"volume-title":"A Source Book of Gestalt Psychology","author":"Wertheimer M.","key":"e_1_2_1_60_1","unstructured":"Wertheimer , M. 1938. Laws of organization in perceptual forms . In A Source Book of Gestalt Psychology , W. Ellis, Ed. Kegan Paul, Trench, Trubner &amp; Co. Ltd ., London, 71--88. Wertheimer, M. 1938. Laws of organization in perceptual forms. In A Source Book of Gestalt Psychology, W. Ellis, Ed. Kegan Paul, Trench, Trubner &amp; Co. Ltd., London, 71--88."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/s003710050148"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344925"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1986.4767748"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.61"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186562.1015766"}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1870076.1870079","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1870076.1870079","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T10:59:47Z","timestamp":1750244387000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1870076.1870079"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,1]]},"references-count":64,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2011,1]]}},"alternative-id":["10.1145\/1870076.1870079"],"URL":"https:\/\/doi.org\/10.1145\/1870076.1870079","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"type":"print","value":"1544-3558"},{"type":"electronic","value":"1544-3965"}],"subject":[],"published":{"date-parts":[[2011,1]]},"assertion":[{"value":"2009-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2010-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-02-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}