{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T08:35:19Z","timestamp":1774600519454,"version":"3.50.1"},"reference-count":30,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2007,7,29]],"date-time":"2007-07-29T00:00:00Z","timestamp":1185667200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2007,7,29]]},"abstract":"<jats:p>A conventional camera captures blurred versions of scene information away from the plane of focus. Camera systems have been proposed that allow for recording all-focus images, or for extracting depth, but to record both simultaneously has required more extensive hardware and reduced spatial resolution. We propose a simple modification to a conventional camera that allows for the simultaneous recovery of both (a) high resolution image information and (b) depth information adequate for semi-automatic extraction of a layered depth representation of the image.<\/jats:p><jats:p>Our modification is to insert a patterned occluder within the aperture of the camera lens, creating a coded aperture. We introduce a criterion for depth discriminability which we use to design the preferred aperture pattern. Using a statistical model of images, we can recover both depth information and an all-focus image from single photographs taken with the modified camera. A layered depth map is then extracted, requiring user-drawn strokes to clarify layer assignments in some cases. The resulting sharp image and layered depth map can be combined for various photographic applications, including automatic scene segmentation, post-exposure refocusing, or re-rendering of the scene from an alternate viewpoint.<\/jats:p>","DOI":"10.1145\/1276377.1276464","type":"journal-article","created":{"date-parts":[[2007,9,14]],"date-time":"2007-09-14T13:44:55Z","timestamp":1189777495000},"page":"70","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":946,"title":["Image and depth from a conventional camera with a coded aperture"],"prefix":"10.1145","volume":"26","author":[{"given":"Anat","family":"Levin","sequence":"first","affiliation":[{"name":"Computer Science and Artificial Intelligence Laboratory"}]},{"given":"Rob","family":"Fergus","sequence":"additional","affiliation":[{"name":"Computer Science and Artificial Intelligence Laboratory"}]},{"given":"Fr\u00e9do","family":"Durand","sequence":"additional","affiliation":[{"name":"Computer Science and Artificial Intelligence Laboratory"}]},{"given":"William T.","family":"Freeman","sequence":"additional","affiliation":[{"name":"Computer Science and Artificial Intelligence Laboratory"}]}],"member":"320","published-online":{"date-parts":[[2007,7,29]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.121783"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0924-2716(99)00008-8"},{"key":"e_1_2_2_3_1","volume-title":"Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods","author":"Barrett R.","unstructured":"Barrett , R. , Berry , M. , Chan , T. F. , Demmel , J. , Donato , J. , Dongarra , J. , Eijkhout , V. , Pozo , R. , Romine , C. , and der Vorst , H. V. 1994. Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods , 2 nd Edition. SIAM , Philadelphia, PA . Barrett, R., Berry, M., Chan, T. F., Demmel, J., Donato, J., Dongarra, J., Eijkhout, V., Pozo, R., Romine, C., and der Vorst, H. V. 1994. Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods, 2nd Edition. SIAM, Philadelphia, PA.","edition":"2"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.969114"},{"key":"e_1_2_2_5_1","first-page":"1859","article-title":"A new paradigm for imaging systems","volume":"41","author":"Cathey W.","year":"1995","unstructured":"Cathey , W. , and Dowski , R. 1995 . A new paradigm for imaging systems . Applied Optics 41 , 1859 -- 1866 . Cathey, W., and Dowski, R. 1995. A new paradigm for imaging systems. Applied Optics 41, 1859--1866.","journal-title":"Applied Optics"},{"key":"e_1_2_2_6_1","doi-asserted-by":"crossref","unstructured":"Chaudhuri S. and Rajagopalan A. 1999. Depth from defocus: A real aperture imaging approach. Springer-Verlag New York. Chaudhuri S. and Rajagopalan A. 1999. Depth from defocus: A real aperture imaging approach . Springer-Verlag New York.","DOI":"10.1007\/978-1-4612-1490-8"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1364\/AO.33.006762"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.15.001777"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022366408068"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1364\/AO.17.000337"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141956"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.2312\/EGWR\/EGSR06\/263-272"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1364\/OL.31.000181"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-8655(87)90026-2"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/11744023_48"},{"key":"e_1_2_2_16_1","doi-asserted-by":"crossref","unstructured":"Hiura S. and Matsuyama T. 1998. Depth measurement by the multi-focus camera. In CVPR IEEE Computer Society 953--961. Hiura S. and Matsuyama T. 1998. Depth measurement by the multi-focus camera. In CVPR IEEE Computer Society 953--961.","DOI":"10.1109\/CVPR.1998.698719"},{"key":"e_1_2_2_17_1","unstructured":"Jones D. and Lamb D. 1993. Analyzing the visual echo: passive 3-D imaging with a multiple aperture camera. Technical Report CIM 93-3 Dept. of Electrical Engineering McGill University. Jones D. and Lamb D. 1993. Analyzing the visual echo: passive 3-D imaging with a multiple aperture camera. Technical Report CIM 93-3 Dept. of Electrical Engineering McGill University."},{"key":"e_1_2_2_18_1","first-page":"3","article-title":"Blind image deconvolution","volume":"13","author":"Kundur D.","year":"1996","unstructured":"Kundur , D. , and Hatzinakos , D. 1996 . Blind image deconvolution . IEEE Signal Processing Magazine 13 , 3 (May), 43--64. Kundur, D., and Hatzinakos, D. 1996. Blind image deconvolution. IEEE Signal Processing Magazine 13, 3 (May), 43--64.","journal-title":"IEEE Signal Processing Magazine"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.126803"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1106"},{"key":"e_1_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Levin A. 2006. Blind motion deblurring using image statistics. In Advances in Neural Information Processing Systems (NIPS). Levin A. 2006. Blind motion deblurring using image statistics. In Advances in Neural Information Processing Systems (NIPS) .","DOI":"10.7551\/mitpress\/7503.003.0110"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141976"},{"key":"e_1_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Nayar S. K. Watanabe M. and Noguchi M. 1995. Real-time focus range sensor. In ICCV 995--1001. Nayar S. K. Watanabe M. and Noguchi M. 1995. Real-time focus range sensor. In ICCV 995--1001.","DOI":"10.1109\/ICCV.1995.466826"},{"key":"e_1_2_2_24_1","first-page":"2005","article-title":"Light field photography with a handheld plenoptic camera","author":"Ng R.","year":"2005","unstructured":"Ng , R. , Levoy , M. , Bredif , M. , Duval , G. , Horowitz , M. , and Hanrahan , P. 2005 . Light field photography with a handheld plenoptic camera . Stanford University Computer Science Tech Report CSTR 2005 - 2002 . Ng, R., Levoy, M., Bredif, M., Duval, G., Horowitz, M., and Hanrahan, P. 2005. Light field photography with a handheld plenoptic camera. Stanford University Computer Science Tech Report CSTR 2005-02.","journal-title":"Stanford University Computer Science Tech Report CSTR"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1038\/381607a0"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1987.4767940"},{"key":"e_1_2_2_27_1","doi-asserted-by":"crossref","unstructured":"Premaratne P. and Ko C. C. 1999. Zero sheet separation of blurred images with symmetrical point spread functions. Signals Systems and Computers 1297--1299. Premaratne P. and Ko C. C. 1999. Zero sheet separation of blurred images with symmetrical point spread functions. Signals Systems and Computers 1297--1299.","DOI":"10.1109\/ACSSC.1999.831916"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141957"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1014573219977"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1179352.1141974"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1276377.1276464","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1276377.1276464","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T14:58:04Z","timestamp":1750258684000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1276377.1276464"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,7,29]]},"references-count":30,"aliases":["10.1145\/1239451.1239521"],"journal-issue":{"issue":"3","published-print":{"date-parts":[[2007,7,29]]}},"alternative-id":["10.1145\/1276377.1276464"],"URL":"https:\/\/doi.org\/10.1145\/1276377.1276464","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2007,7,29]]},"assertion":[{"value":"2007-07-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}