{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T17:34:59Z","timestamp":1777570499012,"version":"3.51.4"},"reference-count":72,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2019,7,12]],"date-time":"2019-07-12T00:00:00Z","timestamp":1562889600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2019,8,31]]},"abstract":"<jats:p>\n            Compared to DSLR cameras, smartphone cameras have smaller sensors, which limits their spatial resolution; smaller apertures, which limits their light gathering ability; and smaller pixels, which reduces their signal-to-noise ratio. The use of color filter arrays (CFAs) requires demosaicing, which further degrades resolution. In this paper, we supplant the use of traditional demosaicing in single-frame and burst photography pipelines with a multiframe super-resolution algorithm that creates a complete RGB image directly from a burst of CFA raw images. We harness natural hand tremor, typical in handheld photography, to acquire a burst of raw frames with small offsets. These frames are then aligned and merged to form a single image with red, green, and blue values at every pixel site. This approach, which includes no explicit demosaicing step, serves to both increase image resolution and boost signal to noise ratio. Our algorithm is robust to challenging scene conditions: local motion, occlusion, or scene changes. It runs at 100 milliseconds per 12-megapixel RAW input burst frame on mass-produced mobile phones. Specifically, the algorithm is the basis of the\n            <jats:italic>Super-Res Zoom<\/jats:italic>\n            feature, as well as the default merge method in\n            <jats:italic>Night Sight<\/jats:italic>\n            mode (whether zooming or not) on Google's flagship phone.\n          <\/jats:p>","DOI":"10.1145\/3306346.3323024","type":"journal-article","created":{"date-parts":[[2019,7,12]],"date-time":"2019-07-12T19:04:08Z","timestamp":1562958248000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":190,"title":["Handheld multi-frame super-resolution"],"prefix":"10.1145","volume":"38","author":[{"given":"Bartlomiej","family":"Wronski","sequence":"first","affiliation":[{"name":"Google Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ignacio","family":"Garcia-Dorado","sequence":"additional","affiliation":[{"name":"Google Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manfred","family":"Ernst","sequence":"additional","affiliation":[{"name":"Google Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Damien","family":"Kelly","sequence":"additional","affiliation":[{"name":"Google Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Krainin","sequence":"additional","affiliation":[{"name":"Google Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chia-Kai","family":"Liang","sequence":"additional","affiliation":[{"name":"Google Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marc","family":"Levoy","sequence":"additional","affiliation":[{"name":"Google Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peyman","family":"Milanfar","sequence":"additional","affiliation":[{"name":"Google Research"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,7,12]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Adobe. 2012. Digital Negative (DNG) Specification. https:\/\/www.adobe.com\/content\/dam\/acom\/en\/products\/photoshop\/pdfs\/dng_spec_1.4.0.0.pdf.  Adobe. 2012. Digital Negative (DNG) Specification. https:\/\/www.adobe.com\/content\/dam\/acom\/en\/products\/photoshop\/pdfs\/dng_spec_1.4.0.0.pdf."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2002.1033210"},{"key":"e_1_2_2_3_1","first-page":"971","article-title":"Color imaging array","volume":"3","author":"Bayer Bryce E","year":"1976","unstructured":"Bryce E Bayer . 1976 . Color imaging array . US Patent 3 , 971 ,065. Bryce E Bayer. 1976. Color imaging array. US Patent 3,971,065.","journal-title":"US Patent"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2010.2042115"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2005.129"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.85668"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/357306.357310"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.342861"},{"key":"e_1_2_2_9_1","volume-title":"CIPA Report. www.cipa.jp\/stats\/report_e.html. {Online","author":"CIPA.","year":"2018","unstructured":"CIPA. 2018. CIPA Report. www.cipa.jp\/stats\/report_e.html. {Online ; accessed 29- Nov- 2018 }. CIPA. 2018. CIPA Report. www.cipa.jp\/stats\/report_e.html. {Online; accessed 29-Nov-2018}."},{"key":"e_1_2_2_10_1","first-page":"217","article-title":"Image synthesis by rank-1 lattices","volume":"2006","author":"Dammertz Sabrina","year":"2008","unstructured":"Sabrina Dammertz and Alexander Keller . 2008 . Image synthesis by rank-1 lattices . In Monte Carlo and Quasi-Monte Carlo Methods 2006. 217 -- 236 . Sabrina Dammertz and Alexander Keller. 2008. Image synthesis by rank-1 lattices. In Monte Carlo and Quasi-Monte Carlo Methods 2006. 217--236.","journal-title":"Monte Carlo and Quasi-Monte Carlo Methods"},{"key":"e_1_2_2_11_1","unstructured":"Michael Drobot. 2014. Hybrid reconstruction anti-aliasing. In ACM SIGGRAPH Courses.  Michael Drobot. 2014. Hybrid reconstruction anti-aliasing. In ACM SIGGRAPH Courses."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2014.2341928"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/83.650118"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2005.860336"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00056772"},{"key":"e_1_2_2_16_1","volume-title":"Top Devices of 2017 on Flickr. https:\/\/blog.flickr.net\/en\/2017\/12\/07\/top-devices-of-2017\/. {Online","year":"2019","unstructured":"Flickr. 2017. Top Devices of 2017 on Flickr. https:\/\/blog.flickr.net\/en\/2017\/12\/07\/top-devices-of-2017\/. {Online ; accessed 11- Jan- 2019 }. Flickr. 2017. Top Devices of 2017 on Flickr. https:\/\/blog.flickr.net\/en\/2017\/12\/07\/top-devices-of-2017\/. {Online; accessed 11-Jan-2019}."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2008.2001399"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2982399"},{"key":"e_1_2_2_19_1","first-page":"560","article-title":"Deep burst denoising","volume":"11219","author":"Godard Cl\u00e9ment","year":"2018","unstructured":"Cl\u00e9ment Godard , Kevin Matzen , and Matt Uyttendaele . 2018 . Deep burst denoising . In Proc. ECCV , Vol. 11219. 560 -- 577 . Cl\u00e9ment Godard, Kevin Matzen, and Matt Uyttendaele. 2018. Deep burst denoising. In Proc. ECCV, Vol. 11219. 560--577.","journal-title":"Proc. ECCV"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/1896300.1896387"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.5244\/C.2.23"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980254"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.430"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661260"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSA.59.000164"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1730804.1730819"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2004.838691"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2006.875241"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/1049-9652(91)90045-L"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2037636.2037642"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.1991.131738"},{"key":"e_1_2_2_33_1","unstructured":"Brian Karis. 2014. High-Quality Temporal Supersampling. In ACM SIGGRAPH Courses.  Brian Karis. 2014. High-Quality Temporal Supersampling. In ACM SIGGRAPH Courses."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1985.4767641"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2010.2050108"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2011.2107524"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201383"},{"key":"e_1_2_2_38_1","volume-title":"Visual Communications and Image Processing","volume":"6822","author":"Li Xin","year":"2008","unstructured":"Xin Li , Bahadir Gunturk , and Lei Zhang . 2008 . Image demosaicing: A systematic survey . In Visual Communications and Image Processing 2008, Vol. 6822 . 68221J. Xin Li, Bahadir Gunturk, and Lei Zhang. 2008. Image demosaicing: A systematic survey. In Visual Communications and Image Processing 2008, Vol. 6822. 68221J."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995614"},{"key":"e_1_2_2_40_1","volume-title":"Quantum-optimal detection of one-versus-two incoherent optical sources with arbitrary separation. arXiv preprint arXiv:1802.02300","author":"Lu Xiao-Ming","year":"2018","unstructured":"Xiao-Ming Lu , Hari Krovi , Ranjith Nair , Saikat Guha , and Jeffrey H Shapiro . 2018. Quantum-optimal detection of one-versus-two incoherent optical sources with arbitrary separation. arXiv preprint arXiv:1802.02300 ( 2018 ). Xiao-Ming Lu, Hari Krovi, Ranjith Nair, Saikat Guha, and Jeffrey H Shapiro. 2018. Quantum-optimal detection of one-versus-two incoherent optical sources with arbitrary separation. arXiv preprint arXiv:1802.02300 (2018)."},{"key":"e_1_2_2_41_1","unstructured":"Bruce D Lucas and Takeo Kanade. 1981. An iterative image registration technique with an application to stereo vision. (1981).  Bruce D Lucas and Takeo Kanade. 1981. An iterative image registration technique with an application to stereo vision. (1981)."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2004.1309456"},{"key":"e_1_2_2_43_1","unstructured":"Hugh Malan. 2012. Real-Time Global Illumination and Reflections in Dust 514. In ACM SIGGRAPH Courses.  Hugh Malan. 2012. Real-Time Global Illumination and Reflections in Dust 514. In ACM SIGGRAPH Courses."},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1136\/jnnp.19.4.260"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00265"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2015.7351528"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073368.1073402"},{"key":"e_1_2_2_48_1","volume-title":"www.ninds.nih.gov\/Disorders\/Patient-Caregiver-Education\/Fact-Sheets\/Tremor-Fact-Sheet. {Online","author":"Tremor Fact NIH.","year":"2018","unstructured":"NIH. 2018. Tremor Fact . www.ninds.nih.gov\/Disorders\/Patient-Caregiver-Education\/Fact-Sheets\/Tremor-Fact-Sheet. {Online ; accessed 29- Nov- 2018 }. NIH. 2018. Tremor Fact. www.ninds.nih.gov\/Disorders\/Patient-Caregiver-Education\/Fact-Sheets\/Tremor-Fact-Sheet. {Online; accessed 29-Nov-2018}."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AIEE.1928.5055024"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCS.1977.1084284"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/10.686791"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2004.832923"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2006.871079"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCI.2016.2629284"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00693"},{"key":"e_1_2_2_56_1","volume-title":"GDC2016 From the Lab Bench: Real-Time Rendering Advances from NVIDIA Research","author":"Salvi Marco","year":"2016","unstructured":"Marco Salvi . 2016 . An excursion in temporal super sampling . GDC2016 From the Lab Bench: Real-Time Rendering Advances from NVIDIA Research (2016). Marco Salvi. 2016. An excursion in temporal super sampling. GDC2016 From the Lab Bench: Real-Time Rendering Advances from NVIDIA Research (2016)."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1113\/jphysiol.1886.sp000210"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2006.878180"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-005-6878-5"},{"key":"e_1_2_2_60_1","unstructured":"Tiago Sousa. 2013. Graphics Gems CryENGINE3. In ACM SIGGRAPH Courses.  Tiago Sousa. 2013. Graphics Gems CryENGINE3. In ACM SIGGRAPH Courses."},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1152\/jn.01218.2004"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2006.312573"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2006.888330"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2017.8296823"},{"key":"e_1_2_2_65_1","first-page":"317","article-title":"Multiframe image restoration and registration","volume":"1","author":"Tsai R.Y.","year":"1984","unstructured":"R.Y. Tsai and T.S. Huang . 1984 . Multiframe image restoration and registration . Advance Computer Visual and Image Processing 1 (1984), 317 -- 339 . R.Y. Tsai and T.S. Huang. 1984. Multiframe image restoration and registration. Advance Computer Visual and Image Processing 1 (1984), 317--339.","journal-title":"Advance Computer Visual and Image Processing"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.703980"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201329"},{"key":"e_1_2_2_68_1","volume-title":"\u00dcber die Gibbs'sche Erscheinung und verwandte Konvergenzph\u00e4nomene. Rendiconti del Circolo Matematico di Palermo (1884--1940) 30, 1 (01","author":"Weyl Hermann","year":"1910","unstructured":"Hermann Weyl . 1910. \u00dcber die Gibbs'sche Erscheinung und verwandte Konvergenzph\u00e4nomene. Rendiconti del Circolo Matematico di Palermo (1884--1940) 30, 1 (01 Dec 1910 ), 377--407. Hermann Weyl. 1910. \u00dcber die Gibbs'sche Erscheinung und verwandte Konvergenzph\u00e4nomene. Rendiconti del Circolo Matematico di Palermo (1884--1940) 30, 1 (01 Dec 1910), 377--407."},{"key":"e_1_2_2_69_1","unstructured":"Bartlomiej Wronski and Peyman Milanfar. 2018. See Better and Further with Super Res Zoom on the Pixel 3. https:\/\/ai.googleblog.com\/2018\/10\/see-better-and-further-with-super-res.html.  Bartlomiej Wronski and Peyman Milanfar. 2018. See Better and Further with Super Res Zoom on the Pixel 3. https:\/\/ai.googleblog.com\/2018\/10\/see-better-and-further-with-super-res.html."},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2005.860938"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCT.1956.1086325"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/2421636.2421641"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1117\/1.3600632"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3306346.3323024","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3306346.3323024","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:25:52Z","timestamp":1750206352000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3306346.3323024"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,12]]},"references-count":72,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019,8,31]]}},"alternative-id":["10.1145\/3306346.3323024"],"URL":"https:\/\/doi.org\/10.1145\/3306346.3323024","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,12]]},"assertion":[{"value":"2019-07-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}