{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T16:04:29Z","timestamp":1778256269821,"version":"3.51.4"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2013,11,1]],"date-time":"2013-11-01T00:00:00Z","timestamp":1383264000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2013,11]]},"abstract":"<jats:p>We present<jats:italic>PiCam<\/jats:italic>(Pelican Imaging Camera-Array), an ultra-thin high performance monolithic camera array, that captures light fields and synthesizes high resolution images along with a range image (scene depth) through integrated parallax detection and superresolution. The camera is passive, supporting both stills and video, low light capable, and small enough to be included in the next generation of mobile devices including smartphones. Prior works [Rander et al. 1997; Yang et al. 2002; Zhang and Chen 2004; Tanida et al. 2001; Tanida et al. 2003; Duparr\u00e9 et al. 2004] in camera arrays have explored multiple facets of light field capture - from viewpoint synthesis, synthetic refocus, computing range images, high speed video, and micro-optical aspects of system miniaturization. However, none of these have addressed the modifications needed to achieve the strict form factor and image quality required to make array cameras practical for mobile devices. In our approach, we customize many aspects of the camera array including lenses, pixels, sensors, and software algorithms to achieve imaging performance and form factor comparable to existing mobile phone cameras.<\/jats:p><jats:p>Our contributions to the post-processing of images from camera arrays include a cost function for parallax detection that integrates across multiple color channels, and a regularized image restoration (superresolution) process that takes into account all the system degradations and adapts to a range of practical imaging conditions. The registration uncertainty from the parallax detection process is integrated into a Maximum-a-Posteriori formulation that synthesizes an estimate of the high resolution image and scene depth. We conclude with some examples of our array capabilities such as postcapture (still) refocus, video refocus, view synthesis to demonstrate motion parallax, 3D range images, and briefly address future work.<\/jats:p>","DOI":"10.1145\/2508363.2508390","type":"journal-article","created":{"date-parts":[[2013,11,6]],"date-time":"2013-11-06T14:09:19Z","timestamp":1383746959000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":176,"title":["<i>PiCam<\/i>"],"prefix":"10.1145","volume":"32","author":[{"given":"Kartik","family":"Venkataraman","sequence":"first","affiliation":[{"name":"Pelican Imaging Corporation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dan","family":"Lelescu","sequence":"additional","affiliation":[{"name":"Pelican Imaging Corporation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jacques","family":"Duparr\u00e9","sequence":"additional","affiliation":[{"name":"Pelican Imaging Corporation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew","family":"McMahon","sequence":"additional","affiliation":[{"name":"Pelican Imaging Corporation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gabriel","family":"Molina","sequence":"additional","affiliation":[{"name":"Pelican Imaging Corporation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Priyam","family":"Chatterjee","sequence":"additional","affiliation":[{"name":"Pelican Imaging Corporation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robert","family":"Mullis","sequence":"additional","affiliation":[{"name":"Pelican Imaging Corporation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shree","family":"Nayar","sequence":"additional","affiliation":[{"name":"Columbia University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2013,11]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.121783"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2002.1033210"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2011.168"},{"key":"e_1_2_2_4_1","volume-title":"Proceedings of International Conference on Computational Photography (ICCP), IEEE.","author":"Bishop T.","unstructured":"Bishop , T. , Zanetti , S. , and Favaro , P . 2009. Light field superresolution . In Proceedings of International Conference on Computational Photography (ICCP), IEEE. Bishop, T., Zanetti, S., and Favaro, P. 2009. Light field superresolution. In Proceedings of International Conference on Computational Photography (ICCP), IEEE."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2006.877406"},{"key":"e_1_2_2_6_1","first-page":"24","article-title":"Thin wafer-level camera lenses inspired by insect compound eyes","volume":"18","author":"Bruckner A.","year":"2010","unstructured":"Bruckner , A. , Duparre , J. , Leitel , R. , Dannberg , P. , Brauer , A. , and Tunnermann , A. 2010 . Thin wafer-level camera lenses inspired by insect compound eyes . Optics Express 18 , 24 (Nov.), 24379--24394. Bruckner, A., Duparre, J., Leitel, R., Dannberg, P., Brauer, A., and Tunnermann, A. 2010. Thin wafer-level camera lenses inspired by insect compound eyes. Optics Express 18, 24 (Nov.), 24379--24394.","journal-title":"Optics Express"},{"key":"e_1_2_2_7_1","volume-title":"Proceedings of International Image Sensors Workshop.","author":"Cho K.-B.","unstructured":"Cho , K.-B. , Tu , N. , Brummer , J. , Azad , K. , Hsu , L. , Wang , V. , Kim , D. , Palle , K. , Miao , T.-M. , Chen , Y. , Hong , C. , Bao , T. , Sharma , V. , Fong , Y. , Irkar , K. , Hashmi , S. , Sukumar , V. , Kabir , S. , Rosenblum , G. , Gao , Y. , Ahn , K.-H. , Ko , H.-J. , Watson , J. , and Kenoyer , C . 2013. A 12MP 16-focal plane CMOS image sensor with 1.75 &mu;m pixel: Architecture and implementation . In Proceedings of International Image Sensors Workshop. Cho, K.-B., Tu, N., Brummer, J., Azad, K., Hsu, L., Wang, V., Kim, D., Palle, K., Miao, T.-M., Chen, Y., Hong, C., Bao, T., Sharma, V., Fong, Y., Irkar, K., Hashmi, S., Sukumar, V., Kabir, S., Rosenblum, G., Gao, Y., Ahn, K.-H., Ko, H.-J., Watson, J., and Kenoyer, C. 2013. A 12MP 16-focal plane CMOS image sensor with 1.75 &mu;m pixel: Architecture and implementation. In Proceedings of International Image Sensors Workshop."},{"key":"e_1_2_2_8_1","doi-asserted-by":"crossref","unstructured":"Duparr\u00e9 J. Dannberg P. Schreiber P. Brauer A. and Tunnermann A. 2004. Thin observation module by bound optics: Concept and experimental verification. Artificial apposition compound eye fabricated by micro-optics technology 43. Duparr\u00e9 J. Dannberg P. Schreiber P. Brauer A. and Tunnermann A. 2004. Thin observation module by bound optics: Concept and experimental verification. Artificial apposition compound eye fabricated by micro-optics technology 43 .","DOI":"10.1364\/AO.43.004303"},{"key":"e_1_2_2_9_1","doi-asserted-by":"crossref","unstructured":"El-Yamany N. A. and Papamichalis P. E. 2008. Robust color image superresolution: An adaptive m-estimation framework. EURASIP Journal in Advances in Signal Processing 2008 (Feb.) Article ID 763254. El-Yamany N. A. and Papamichalis P. E. 2008. Robust color image superresolution: An adaptive m-estimation framework. EURASIP Journal in Advances in Signal Processing 2008 (Feb.) Article ID 763254.","DOI":"10.1155\/2008\/763254"},{"key":"e_1_2_2_10_1","first-page":"14","article-title":"Advances and challenges in super-resolution","volume":"2004","author":"Farsiu S.","year":"2004","unstructured":"Farsiu , S. , Robinson , D. , Elad , M. , and Milanfar , P. 2004 . Advances and challenges in super-resolution . International Journal of Imaging Systems and Technology 2004 , 14 (Aug.), 47--57. Farsiu, S., Robinson, D., Elad, M., and Milanfar, P. 2004. Advances and challenges in super-resolution. International Journal of Imaging Systems and Technology 2004, 14 (Aug.), 47--57.","journal-title":"International Journal of Imaging Systems and Technology"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2005.860336"},{"key":"e_1_2_2_12_1","unstructured":"Fischer R. E. Galeb B. T. and Yoder P. 2008. Optical systems design. Fischer R. E. Galeb B. T. and Yoder P. 2008. Optical systems design."},{"key":"e_1_2_2_13_1","doi-asserted-by":"crossref","unstructured":"Georgiev T. Chunev G. and Lumsdaine A. 2011. Superresolution with the focused plenoptic camera. Computational Imaging IX 243--254. Georgiev T. Chunev G. and Lumsdaine A. 2011. Superresolution with the focused plenoptic camera. Computational Imaging IX 243--254.","DOI":"10.1117\/12.872666"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/83.650116"},{"key":"e_1_2_2_15_1","volume-title":"Cameras and Displays","author":"Holst G. C.","unstructured":"Holst , G. C. 1998. CCD Arrays , Cameras and Displays , 2 nd ed. JCD Publishing and SPIE , Winter Park , Florida, March. Holst, G. C. 1998. CCD Arrays, Cameras and Displays, 2nd ed. JCD Publishing and SPIE, Winter Park, Florida, March.","edition":"2"},{"key":"e_1_2_2_16_1","volume-title":"Proceedings of the SPIE 7072 (Sept.).","author":"Horisaki R.","unstructured":"Horisaki , R. , Nakao , Y. , Toyoda , T. , Kagawa , K. , Masaki , Y. , and Tanida , J . 2008. A compound-eye imaging system with irregular lens-array arrangement . Proceedings of the SPIE 7072 (Sept.). Horisaki, R., Nakao, Y., Toyoda, T., Kagawa, K., Masaki, Y., and Tanida, J. 2008. A compound-eye imaging system with irregular lens-array arrangement. Proceedings of the SPIE 7072 (Sept.)."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/1049-9652(91)90045-L"},{"key":"e_1_2_2_18_1","volume-title":"Lens design fundamentals","author":"Kingslake R.","unstructured":"Kingslake , R. 1951. Lens design fundamentals . Academic Press . Kingslake, R. 1951. Lens design fundamentals. Academic Press."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237199"},{"key":"e_1_2_2_20_1","first-page":"146","article-title":"\u00c9preuves r\u00e9versibles. photographies int\u00e9grales","volume":"9","author":"Lippmann G.","year":"1908","unstructured":"Lippmann , G. 1908 . \u00c9preuves r\u00e9versibles. photographies int\u00e9grales . Comptes Rendus de l'Acad\u00e9mie des Sciences 9 , 146 (Mar.), 446--451. Lippmann, G. 1908. \u00c9preuves r\u00e9versibles. photographies int\u00e9grales. Comptes Rendus de l'Acad\u00e9mie des Sciences 9, 146 (Mar.), 446--451.","journal-title":"Comptes Rendus de l'Acad\u00e9mie des Sciences"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1364\/AO.28.004996"},{"key":"e_1_2_2_22_1","volume-title":"Proceedings of Computer Visison and Pattern Recognition Workshops (CVPRW), IEEE, 22--28","author":"Mitra K.","unstructured":"Mitra , K. , and Veeraraghavan , A . 2012. Light field denoising, light field superresolution and stereo camera based refocusing using a GMM light field patch prior . In Proceedings of Computer Visison and Pattern Recognition Workshops (CVPRW), IEEE, 22--28 . Mitra, K., and Veeraraghavan, A. 2012. Light field denoising, light field superresolution and stereo camera based refocusing using a GMM light field patch prior. In Proceedings of Computer Visison and Pattern Recognition Workshops (CVPRW), IEEE, 22--28."},{"key":"e_1_2_2_23_1","unstructured":"Ng R. Levoy M. Brodif M. Duval G. Horowitz M. and Hanrahan P. 2005. Light field photography with a handheld plenoptic camera. Stanford University Computer Science Tech Report CSTR-2005-02. Ng R. Levoy M. Brodif M. Duval G. Horowitz M. and Hanrahan P. 2005. Light field photography with a handheld plenoptic camera. Stanford University Computer Science Tech Report CSTR-2005-02 ."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383847.2383866"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.206955"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1155\/2007\/23565"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2009.2022440"},{"key":"e_1_2_2_28_1","volume-title":"IEEE Proceedings on Visualization, 277--283","author":"Rander P.","unstructured":"Rander , P. , Narayanan , P. , and Kanade , T . 1997. Virtualized reality: Constructing time-varying virtual worlds from real events . IEEE Proceedings on Visualization, 277--283 . Rander, P., Narayanan, P., and Kanade, T. 1997. Virtualized reality: Constructing time-varying virtual worlds from real events. IEEE Proceedings on Visualization, 277--283."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-2789(92)90242-F"},{"key":"e_1_2_2_30_1","volume-title":"Proceedings of 43rd Asilomar Conference on Signals, Systems, and Computers, IEEE, 1235--1242","author":"Sen P.","unstructured":"Sen , P. , and Darabi , S . 2009. Compressive image superresolution . In Proceedings of 43rd Asilomar Conference on Signals, Systems, and Computers, IEEE, 1235--1242 . Sen, P., and Darabi, S. 2009. Compressive image superresolution. In Proceedings of 43rd Asilomar Conference on Signals, Systems, and Computers, IEEE, 1235--1242."},{"key":"e_1_2_2_31_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-84882-935-0","volume-title":"Computer Vision, Algorithms and Applications","author":"Szeliski R.","year":"2011","unstructured":"Szeliski , R. 2010. Computer Vision, Algorithms and Applications , 2011 ed. Springer , Springer- Verlag, London Limited. Szeliski, R. 2010. Computer Vision, Algorithms and Applications, 2011 ed. Springer, Springer-Verlag, London Limited."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1364\/AO.40.001806"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.11.002109"},{"key":"e_1_2_2_34_1","first-page":"9","article-title":"Virtual camera movement: The way of the future","volume":"77","author":"Taylor D.","year":"1996","unstructured":"Taylor , D. 1996 . Virtual camera movement: The way of the future ? American Cinematographer 77 , 9 (Sept.), 93--100. Taylor, D. 1996. Virtual camera movement: The way of the future? American Cinematographer 77, 9 (Sept.), 93--100.","journal-title":"American Cinematographer"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2007.894257"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33715-4_44"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073259"},{"key":"e_1_2_2_38_1","volume-title":"Eurographics Workshop on Rendering, 77--86","author":"Yang J. C.","year":"2002","unstructured":"Yang , J. C. , Everett , M. , Buehler , C. , and McMillan , L. 2002 . A real time distributed light field camera . Eurographics Workshop on Rendering, 77--86 . Yang, J. C., Everett, M., Buehler, C., and McMillan, L. 2002. A real time distributed light field camera. Eurographics Workshop on Rendering, 77--86."},{"key":"e_1_2_2_39_1","volume-title":"Proceedings of Computer Vision and Pattern Recognition (CVPR), IEEE, 1--8.","author":"Yang J.","unstructured":"Yang , J. , Wright , J. , Ma , Y. , and Huang , T . 2008. Image super-resolution as sparse representation of raw image patches . In Proceedings of Computer Vision and Pattern Recognition (CVPR), IEEE, 1--8. Yang, J., Wright, J., Ma, Y., and Huang, T. 2008. Image super-resolution as sparse representation of raw image patches. In Proceedings of Computer Vision and Pattern Recognition (CVPR), IEEE, 1--8."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383533.2383567"},{"key":"e_1_2_2_41_1","volume-title":"Proceedings of Computer Vision and Pattern Recognition (CVPR)","volume":"1","author":"Zomet A.","unstructured":"Zomet , A. , Rav-Acha , A. , and Peleg , S . 2001. Robust super-resolution . In Proceedings of Computer Vision and Pattern Recognition (CVPR) , vol. 1 , IEEE, 645--650. Zomet, A., Rav-Acha, A., and Peleg, S. 2001. Robust super-resolution. In Proceedings of Computer Vision and Pattern Recognition (CVPR), vol. 1, IEEE, 645--650."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2508363.2508390","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2508363.2508390","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T07:28:38Z","timestamp":1750231718000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2508363.2508390"}},"subtitle":["an ultra-thin high performance monolithic camera array"],"short-title":[],"issued":{"date-parts":[[2013,11]]},"references-count":41,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2013,11]]}},"alternative-id":["10.1145\/2508363.2508390"],"URL":"https:\/\/doi.org\/10.1145\/2508363.2508390","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,11]]},"assertion":[{"value":"2013-11-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}