{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:23:19Z","timestamp":1750306999307,"version":"3.41.0"},"reference-count":21,"publisher":"Association for Computing Machinery (ACM)","issue":"11","license":[{"start":{"date-parts":[[2012,11,1]],"date-time":"2012-11-01T00:00:00Z","timestamp":1351728000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Commun. ACM"],"published-print":{"date-parts":[[2012,11]]},"abstract":"<jats:p>Although there has been much interest in computational photography within the research and photography communities, progress has been hampered by the lack of a portable, programmable camera with sufficient image quality and computing power. To address this problem, we have designed and implemented an open architecture and application programming interface (API) for such cameras: the Frankencamera. It consists of a base hardware specification, a software stack based on Linux, and an API for C++. Our architecture permits control and synchronization of the sensor and image processing pipeline at the microsecond timescale, as well as the ability to incorporate and synchronize external hardware like lenses and flashes. This paper specifies our architecture and API, and it describes two reference implementations we have built. Using these implementations, we demonstrate several computational photography applications: high dynamic range (HDR) viewfinding and capture, automated acquisition of extended dynamic range panoramas, foveal imaging, and inertial measurement unit (IMU)-based hand shake detection. Our goal is to standardize the architecture and distribute Frankencameras to researchers and students, as a step toward creating a community of photographer-programmers who develop algorithms, applications, and hardware for computational cameras.<\/jats:p>","DOI":"10.1145\/2366316.2366339","type":"journal-article","created":{"date-parts":[[2012,10,24]],"date-time":"2012-10-24T18:44:51Z","timestamp":1351104291000},"page":"90-98","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["The Frankencamera"],"prefix":"10.1145","volume":"55","author":[{"given":"Andrew","family":"Adams","sequence":"first","affiliation":[{"name":"MIT"}]},{"given":"David E.","family":"Jacobs","sequence":"additional","affiliation":[{"name":"Stanford University"}]},{"given":"Jennifer","family":"Dolson","sequence":"additional","affiliation":[{"name":"Stanford University"}]},{"given":"Marius","family":"Tico","sequence":"additional","affiliation":[{"name":"Nokia Research Center"}]},{"given":"Kari","family":"Pulli","sequence":"additional","affiliation":[{"name":"NVIDIA Research"}]},{"given":"Eino-Ville","family":"Talvala","sequence":"additional","affiliation":[{"name":"Stanford University"}]},{"given":"Boris","family":"Ajdin","sequence":"additional","affiliation":[{"name":"T\u00fcbingen University"}]},{"given":"Daniel","family":"Vaquero","sequence":"additional","affiliation":[{"name":"University of California Santa Barbara"}]},{"given":"Hendrik P. A.","family":"Lensch","sequence":"additional","affiliation":[{"name":"T\u00fcbingen University"}]},{"given":"Mark","family":"Horowitz","sequence":"additional","affiliation":[{"name":"Stanford University"}]},{"given":"Sung Hee","family":"Park","sequence":"additional","affiliation":[{"name":"Stanford University"}]},{"given":"Natasha","family":"Gelfand","sequence":"additional","affiliation":[{"name":"University of Labrador"}]},{"given":"Jongmin","family":"Baek","sequence":"additional","affiliation":[{"name":"Stanford University"}]},{"given":"Wojciech","family":"Matusik","sequence":"additional","affiliation":[{"name":"MIT CSAIL"}]},{"given":"Marc","family":"Levoy","sequence":"additional","affiliation":[{"name":"Stanford University"}]}],"member":"320","published-online":{"date-parts":[[2012,11]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Viewfinder alignment. 2","author":"Adams A.","year":"2008","unstructured":"Adams , A. , Gelfand , N. , and Pulli , K . Viewfinder alignment. 2 ( 2008 ), 597--606. Adams, A., Gelfand, N., and Pulli, K. Viewfinder alignment. 2 (2008), 597--606."},{"key":"e_1_2_1_2_1","volume-title":"Using photographs to enhance videos of a static scene. In","author":"Bhat P.","year":"2007","unstructured":"Bhat , P. , Zitnick , C.L. , Snavely , N. , Agarwala , A. , Agrawala , M. , Cohen , M. , Curless , B. , Kang , S.B. Using photographs to enhance videos of a static scene. In ( 2007 ). Bhat, P., Zitnick, C.L., Snavely, N., Agarwala, A., Agrawala, M., Cohen, M., Curless, B., Kang, S.B. Using photographs to enhance videos of a static scene. In (2007)."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2006.55"},{"key":"e_1_2_1_4_1","unstructured":"The CHDK Project 2010.  The CHDK Project 2010."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258884"},{"key":"e_1_2_1_6_1","volume-title":"private communication","author":"Durand F.","year":"2009","unstructured":"Durand , F. private communication , 2009 . Durand, F. private communication, 2009."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186562.1015778"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1236360.1236406"},{"key":"e_1_2_1_9_1","volume-title":"Image deblurring using inertial measurement sensors., 3 (Aug","author":"Joshi N.","year":"2010","unstructured":"Joshi , N. , Kang , S.B. , Zitnick , C.L. , Szeliski , R. Image deblurring using inertial measurement sensors., 3 (Aug . 2010 ). Joshi, N., Kang, S.B., Zitnick, C.L., Szeliski, R. Image deblurring using inertial measurement sensors., 3 (Aug. 2010)."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1201775.882270"},{"key":"e_1_2_1_11_1","volume-title":"ACM SenSys 2006 Workshop on Distributed Smart Cameras (DSC 2006)","author":"Kleihorst R.","year":"2006","unstructured":"Kleihorst , R. , Schueler , B. , Danilin , A. , Heijligers , M. Smart camera mote with high performance vision system . In ACM SenSys 2006 Workshop on Distributed Smart Cameras (DSC 2006) ( Oct. 2006 ). Kleihorst, R., Schueler, B., Danilin, A., Heijligers, M. Smart camera mote with high performance vision system. In ACM SenSys 2006 Workshop on Distributed Smart Cameras (DSC 2006) (Oct. 2006)."},{"key":"e_1_2_1_12_1","unstructured":"The Magic Lantern project 2010.  The Magic Lantern project 2010."},{"key":"e_1_2_1_13_1","volume-title":"On being 'undigital' with digital cameras: extending dynamic range by combining differently exposed pictures. In","author":"Mann S.","year":"1995","unstructured":"Mann , S. , Picard , R.W. On being 'undigital' with digital cameras: extending dynamic range by combining differently exposed pictures. In ( 1995 ), 442--448. Mann, S., Picard, R.W. On being 'undigital' with digital cameras: extending dynamic range by combining differently exposed pictures. In (1995), 442--448."},{"key":"e_1_2_1_14_1","volume-title":"Exposure fusion. In","author":"Mertens T.","year":"2007","unstructured":"Mertens , T. , Kautz , J. , Reeth , F.V. Exposure fusion. In ( 2007 ). Mertens, T., Kautz, J., Reeth, F.V. Exposure fusion. In (2007)."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186562.1015777"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1098918.1098939"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1179352.1141957"},{"key":"e_1_2_1_18_1","volume-title":"A K Peters","author":"Raskar R.","year":"2010","unstructured":"Raskar , R. , Tumblin , J. Computational Photography: Mastering New Techniques for Lenses, Lighting, and Sensors , A K Peters , Natick , MA , 2010 , in press. Raskar, R., Tumblin, J. Computational Photography: Mastering New Techniques for Lenses, Lighting, and Sensors, A K Peters, Natick, MA, 2010, in press."},{"key":"e_1_2_1_19_1","volume-title":"High Dynamic Range Imaging - Acquisition, Display and Image-based Lighting","author":"Reinhard E.","year":"2006","unstructured":"Reinhard , E. , Ward , G. , Pattanaik , S. , Debevec , P. High Dynamic Range Imaging - Acquisition, Display and Image-based Lighting , Morgan Kaufman Publishers , San Francisco, CA , 2006 . Reinhard, E., Ward, G., Pattanaik, S., Debevec, P. High Dynamic Range Imaging - Acquisition, Display and Image-based Lighting, Morgan Kaufman Publishers, San Francisco, CA, 2006."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186822.1073259"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2002.1033027"}],"container-title":["Communications of the ACM"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2366316.2366339","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2366316.2366339","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T08:48:48Z","timestamp":1750236528000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2366316.2366339"}},"subtitle":["an experimental platform for computational photography"],"short-title":[],"issued":{"date-parts":[[2012,11]]},"references-count":21,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2012,11]]}},"alternative-id":["10.1145\/2366316.2366339"],"URL":"https:\/\/doi.org\/10.1145\/2366316.2366339","relation":{},"ISSN":["0001-0782","1557-7317"],"issn-type":[{"type":"print","value":"0001-0782"},{"type":"electronic","value":"1557-7317"}],"subject":[],"published":{"date-parts":[[2012,11]]},"assertion":[{"value":"2012-11-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}