{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T07:14:42Z","timestamp":1791875682009,"version":"4.3.4"},"reference-count":29,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2005,7,1]],"date-time":"2005-07-01T00:00:00Z","timestamp":1120176000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2005,7]]},"abstract":"<jats:p>Video matting is the process of pulling a high-quality alpha matte and foreground from a video sequence. Current techniques require either a known background (e.g., a blue screen) or extensive user interaction (e.g., to specify known foreground and background elements). The matting problem is generally under-constrained, since not enough information has been collected at capture time. We propose a novel, fully autonomous method for pulling a matte using multiple synchronized video streams that share a point of view but differ in their plane of focus. The solution is obtained by directly minimizing the error in filter-based image formation equations, which are over-constrained by our rich data stream. Our system solves the fully dynamic video matting problem without user assistance: both the foreground and background may be high frequency and have dynamic content, the foreground may resemble the background, and the scene is lit by natural (as opposed to polarized or collimated) illumination.<\/jats:p>","DOI":"10.1145\/1073204.1073231","type":"journal-article","created":{"date-parts":[[2005,11,7]],"date-time":"2005-11-07T16:00:45Z","timestamp":1131379245000},"page":"567-576","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":77,"title":["Defocus video matting"],"prefix":"10.1145","volume":"24","author":[{"given":"Morgan","family":"McGuire","sequence":"first","affiliation":[{"name":"Brown University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wojciech","family":"Matusik","sequence":"additional","affiliation":[{"name":"MERL"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hanspeter","family":"Pfister","sequence":"additional","affiliation":[{"name":"MERL"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John F.","family":"Hughes","sequence":"additional","affiliation":[{"name":"Brown University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fr\u00e9do","family":"Durand","sequence":"additional","affiliation":[{"name":"MIT"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2005,7]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 407--414","author":"Apostoloff N. E.","unstructured":"Apostoloff , N. E. , and Fitzgibbon , A. W . 2004. Bayesian video matting using learnt image priors . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 407--414 . Apostoloff, N. E., and Fitzgibbon, A. W. 2004. Bayesian video matting using learnt image priors. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 407--414."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.659933"},{"key":"e_1_2_2_3_1","doi-asserted-by":"crossref","unstructured":"Ben-Ezra M. and Nayar S. 2004. Jitter camera: High resolution video from a low resolution detector. In IEEE CVPR 135--142. Ben-Ezra M. and Nayar S. 2004. Jitter camera: High resolution video from a low resolution detector. In IEEE CVPR 135--142.","DOI":"10.21236\/ADA437160"},{"key":"e_1_2_2_4_1","first-page":"488","article-title":"Depth from defocus in presence of partial self occlusion","volume":"1","author":"Bhasin S. S.","year":"2001","unstructured":"Bhasin , S. S. , and Chaudhuri , S. 2001 . Depth from defocus in presence of partial self occlusion . Proceedings of the International Conference on Computer Vision 1 , 2, 488 -- 493 . Bhasin, S. S., and Chaudhuri, S. 2001. Depth from defocus in presence of partial self occlusion. Proceedings of the International Conference on Computer Vision 1, 2, 488--93.","journal-title":"Proceedings of the International Conference on Computer Vision"},{"key":"e_1_2_2_5_1","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV).","author":"Blake A.","unstructured":"Blake , A. , Rother , C. , Brown , M. , Perez . P. , and Torr , P . 2004. Interactive image segmentation using an adaptive gmmrf model . Proceedings of the European Conference on Computer Vision (ECCV). Blake, A., Rother, C., Brown, M., Perez. P., and Torr, P. 2004. Interactive image segmentation using an adaptive gmmrf model. Proceedings of the European Conference on Computer Vision (ECCV)."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2006.259"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566572"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258884"},{"key":"e_1_2_2_9_1","doi-asserted-by":"crossref","unstructured":"Favaro P. and Soatto S. 2003. Seeing beyond occlusions (and other marvels of a finite lens aperture). In IEEE CVPR 579--586. Favaro P. and Soatto S. 2003. Seeing beyond occlusions (and other marvels of a finite lens aperture). In IEEE CVPR 579--586.","DOI":"10.1109\/CVPR.2003.1211519"},{"issue":"1","key":"e_1_2_2_10_1","first-page":"242","article-title":"Method of producing moving picture cartoons","author":"Fleischer M.","year":"1917","unstructured":"Fleischer , M. , 1917 . Method of producing moving picture cartoons . US Patent no. 1 , 242 ,674. Fleischer, M., 1917. Method of producing moving picture cartoons. US Patent no. 1,242,674.","journal-title":"US Patent"},{"key":"e_1_2_2_11_1","volume-title":"Principles of Digital Image Synthesis","author":"Glassner A. S.","unstructured":"Glassner , A. S. 1995. Principles of Digital Image Synthesis . Morgan Kaufmann Publishers, Inc. Glassner, A. S. 1995. Principles of Digital Image Synthesis. Morgan Kaufmann Publishers, Inc."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1987.4767941"},{"key":"e_1_2_2_13_1","volume-title":"Optics","author":"Hecht E.","unstructured":"Hecht , E. 1998. Optics Third Edition. Addison Wesley Longman, Inc. Hecht, E. 1998. Optics Third Edition. Addison Wesley Longman, Inc."},{"key":"e_1_2_2_14_1","volume-title":"Proceedings of IEEE CVPR","volume":"1","author":"Hillman P.","year":"2001","unstructured":"Hillman , P. , Hannah , J. , and Renshaw , D . 2001. Alpha channel estimation in high resolution images and image sequences . In Proceedings of IEEE CVPR 2001 , IEEE Computer Society , vol. 1 , 1063--1068. Hillman, P., Hannah, J., and Renshaw, D. 2001. Alpha channel estimation in high resolution images and image sequences. In Proceedings of IEEE CVPR 2001, IEEE Computer Society, vol. 1, 1063--1068."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015806"},{"key":"e_1_2_2_16_1","volume-title":"Proceedings of the IEEE International Conference on Speech, Acoustics, and Signal Processing.","author":"Malvar H. S.","unstructured":"Malvar , H. S. , Wei He , L. , and Cutler , R . 2004. High-quality linear interpolation for demosaicing of bayer-patterned color images . Proceedings of the IEEE International Conference on Speech, Acoustics, and Signal Processing. Malvar, H. S., Wei He, L., and Cutler, R. 2004. High-quality linear interpolation for demosaicing of bayer-patterned color images. Proceedings of the IEEE International Conference on Speech, Acoustics, and Signal Processing."},{"key":"e_1_2_2_17_1","volume-title":"Proceedings of the International Conference on Computer Vision (ICCV), 1168--1175","author":"Nayar S. K.","unstructured":"Nayar , S. K. , and Branzoi , V . 2003. Adaptive dynamic range imaging: Optical control of pixel exposures over space and time . In Proceedings of the International Conference on Computer Vision (ICCV), 1168--1175 . Nayar, S. K., and Branzoi, V. 2003. Adaptive dynamic range imaging: Optical control of pixel exposures over space and time. In Proceedings of the International Conference on Computer Vision (ICCV), 1168--1175."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.546256"},{"key":"e_1_2_2_19_1","doi-asserted-by":"crossref","unstructured":"Nocedal J. and Wright S. J. 1999. Numerical Optimization. Springer Verlag. Nocedal J. and Wright S. J. 1999. Numerical Optimization. Springer Verlag.","DOI":"10.1007\/b98874"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1987.4767940"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/800031.808606"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/964967.801169"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015720"},{"key":"e_1_2_2_24_1","volume-title":"CVPR","volume":"1","author":"Ruzon M. A.","year":"2000","unstructured":"Ruzon , M. A. , and Tomasi , C . 2000. Alpha estimation in natural images . In CVPR 2000 , vol. 1 , 18--25. Ruzon, M. A., and Tomasi, C. 2000. Alpha estimation in natural images. In CVPR 2000, vol. 1, 18--25."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008166017466"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237263"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015721"},{"key":"e_1_2_2_28_1","unstructured":"Yahav G. and Iddan G. 2002. 3dv systems' zcam. Broadcast Engineering. Yahav G. and Iddan G. 2002. 3dv systems' zcam. Broadcast Engineering."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015766"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1073204.1073231","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1073204.1073231","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T16:07:45Z","timestamp":1750262865000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1073204.1073231"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,7]]},"references-count":29,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2005,7]]}},"alternative-id":["10.1145\/1073204.1073231"],"URL":"https:\/\/doi.org\/10.1145\/1073204.1073231","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2005,7]]},"assertion":[{"value":"2005-07-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}