{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T17:18:28Z","timestamp":1791911908771,"version":"4.3.4"},"reference-count":38,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2015,7,27]],"date-time":"2015-07-27T00:00:00Z","timestamp":1437955200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2015,7,27]]},"abstract":"<jats:p>We present a unified computational approach for taking photos through reflecting or occluding elements such as windows and fences. Rather than capturing a single image, we instruct the user to take a short image sequence while slightly moving the camera. Differences that often exist in the relative position of the background and the obstructing elements from the camera allow us to separate them based on their motions, and to recover the desired background scene as if the visual obstructions were not there. We show results on controlled experiments and many real and practical scenarios, including shooting through reflections, fences, and raindrop-covered windows.<\/jats:p>","DOI":"10.1145\/2766940","type":"journal-article","created":{"date-parts":[[2015,7,28]],"date-time":"2015-07-28T08:26:38Z","timestamp":1438071998000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":198,"title":["A computational approach for obstruction-free photography"],"prefix":"10.1145","volume":"34","author":[{"given":"Tianfan","family":"Xue","sequence":"first","affiliation":[{"name":"MIT CSAIL"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Rubinstein","sequence":"additional","affiliation":[{"name":"Google Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ce","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"William T.","family":"Freeman","sequence":"additional","affiliation":[{"name":"MIT CSAIL and Google Research"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2015,7,27]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-008-0200-2"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2007.915548"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344972"},{"key":"e_1_2_2_4_1","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Bertalmio M.","unstructured":"Bertalmio , M. , Bertozzi , A. L. , and Sapiro , G . 2001. Navier-stokes, fluid dynamics, and image and video inpainting . In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Bertalmio, M., Bertozzi, A. L., and Sapiro, G. 2001. Navier-stokes, fluid dynamics, and image and video inpainting. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1006\/cviu.1996.0006"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1986.4767851"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2004.833105"},{"key":"e_1_2_2_8_1","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Farid H.","unstructured":"Farid , H. , and Adelson , E. H . 1999. Separating reflections and lighting using independent components analysis . IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Farid, H., and Adelson, E. H. 1999. Separating reflections and lighting using independent components analysis. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_9_1","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Gai K.","unstructured":"Gai , K. , Shi , Z. , and Zhang , C . 2009. Blind separation of superimposed images with unknown motions . In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Gai, K., Shi, Z., and Zhang, C. 2009. Blind separation of superimposed images with unknown motions. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2011.87"},{"key":"e_1_2_2_11_1","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Garg K.","unstructured":"Garg , K. , and Nayar , S. K . 2004. Detection and removal of rain from videos . In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Garg, K., and Nayar, S. K. 2004. Detection and removal of rain from videos. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.281"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/11744047_40"},{"key":"e_1_2_2_14_1","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Jepson A.","unstructured":"Jepson , A. , and Black , M. J . 1993. Mixture models for optical flow computation . In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Jepson, A., and Black, M. J. 1993. Mixture models for optical flow computation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_15_1","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Jojic N.","unstructured":"Jojic , N. , and Frey , B. J . 2001. Learning flexible sprites in video layers . In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Jojic, N., and Frey, B. J. 2001. Learning flexible sprites in video layers. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.45"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508369"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1106"},{"key":"e_1_2_2_19_1","unstructured":"Levin A. Zomet A. and Weiss Y. 2002. Learning to perceive transparency from the statistics of natural scenes. Advances in Neural Information Processing Systems (NIPS).  Levin A. Zomet A. and Weiss Y. 2002. Learning to perceive transparency from the statistics of natural scenes. Advances in Neural Information Processing Systems (NIPS)."},{"key":"e_1_2_2_20_1","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Levin A.","unstructured":"Levin , A. , Zomet , A. , and Weiss , Y . 2004. Separating reflections from a single image using local features . IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Levin, A., Zomet, A., and Weiss, Y. 2004. Separating reflections from a single image using local features. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.302"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.346"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.127"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88690-7_3"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.536"},{"key":"e_1_2_2_26_1","volume-title":"Introduction to linear and nonlinear programming","author":"Luenberger D. G.","unstructured":"Luenberger , D. G. 1973. Introduction to linear and nonlinear programming , vol. 28 . Addison-Wesley Reading , MA. Luenberger, D. G. 1973. Introduction to linear and nonlinear programming, vol. 28. Addison-Wesley Reading, MA."},{"key":"e_1_2_2_27_1","unstructured":"Mu Y. Liu W. and Yan S. 2012. Video de-fencing. IEEE Circuits and Systems Society.  Mu Y. Liu W. and Yan S. 2012. Video de-fencing. IEEE Circuits and Systems Society."},{"key":"e_1_2_2_28_1","article-title":"Video inpainting of complex scenes","author":"Newson A.","year":"2014","unstructured":"Newson , A. , Almansa , A. , Fradet , M. , Gousseau , Y. , P\u00e9rez , P. , 2014 . Video inpainting of complex scenes . Journal on Imaging Sciences, Society for Industrial and Applied Mathematics. Newson, A., Almansa, A., Fradet, M., Gousseau, Y., P\u00e9rez, P., et al. 2014. Video inpainting of complex scenes. Journal on Imaging Sciences, Society for Industrial and Applied Mathematics.","journal-title":"Journal on Imaging Sciences, Society for Industrial and Applied Mathematics."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88688-4_35"},{"key":"e_1_2_2_30_1","volume-title":"Asian Conference on Computer Vision (ACCV).","author":"Park M.","unstructured":"Park , M. , Brocklehurst , K. , Collins , R. T. , and Liu , Y . 2011. Image de-fencing revisited . In Asian Conference on Computer Vision (ACCV). Park, M., Brocklehurst, K., Collins, R. T., and Liu, Y. 2011. Image de-fencing revisited. In Asian Conference on Computer Vision (ACCV)."},{"key":"e_1_2_2_31_1","volume-title":"European Conference on Computer Vision (ECCV).","author":"Sarel B.","unstructured":"Sarel , B. , and Irani , M . 2004. Separating transparent layers through layer information exchange . European Conference on Computer Vision (ECCV). Sarel, B., and Irani, M. 2004. Separating transparent layers through layer information exchange. European Conference on Computer Vision (ECCV)."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2003.1211446"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185596"},{"key":"e_1_2_2_34_1","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Szeliski R.","unstructured":"Szeliski , R. , Avidan , S. , and Anandan , P . 2000. Layer extraction from multiple images containing reflections and transparency . IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Szeliski, R., Avidan, S., and Anandan, P. 2000. Layer extraction from multiple images containing reflections and transparency. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.56188"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.42"},{"key":"e_1_2_2_37_1","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","author":"Weiss Y.","unstructured":"Weiss , Y. , and Adelson , E. H . 1996. A unified mixture framework for motion segmentation: Incorporating spatial coherence and estimating the number of models . In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE. Weiss, Y., and Adelson, E. H. 1996. A unified mixture framework for motion segmentation: Incorporating spatial coherence and estimating the number of models. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2010.1101"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2766940","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2766940","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:43:01Z","timestamp":1750210981000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2766940"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,7,27]]},"references-count":38,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2015,7,27]]}},"alternative-id":["10.1145\/2766940"],"URL":"https:\/\/doi.org\/10.1145\/2766940","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,7,27]]},"assertion":[{"value":"2015-07-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}