{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T15:13:16Z","timestamp":1778080396462,"version":"3.51.4"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T00:00:00Z","timestamp":1573171200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2019,12,31]]},"abstract":"<jats:p>Taking photographs in low light using a mobile phone is challenging and rarely produces pleasing results. Aside from the physical limits imposed by read noise and photon shot noise, these cameras are typically handheld, have small apertures and sensors, use mass-produced analog electronics that cannot easily be cooled, and are commonly used to photograph subjects that move, like children and pets. In this paper we describe a system for capturing clean, sharp, colorful photographs in light as low as 0.3 lux, where human vision becomes monochromatic and indistinct. To permit handheld photography without flash illumination, we capture, align, and combine multiple frames. Our system employs \"motion metering\", which uses an estimate of motion magnitudes (whether due to handshake or moving objects) to identify the number of frames and the per-frame exposure times that together minimize both noise and motion blur in a captured burst. We combine these frames using robust alignment and merging techniques that are specialized for high-noise imagery. To ensure accurate colors in such low light, we employ a learning-based auto white balancing algorithm. To prevent the photographs from looking like they were shot in daylight, we use tone mapping techniques inspired by illusionistic painting: increasing contrast, crushing shadows to black, and surrounding the scene with darkness. All of these processes are performed using the limited computational resources of a mobile device. Our system can be used by novice photographers to produce shareable pictures in a few seconds based on a single shutter press, even in environments so dim that humans cannot see clearly.<\/jats:p>","DOI":"10.1145\/3355089.3356508","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T20:27:58Z","timestamp":1573244878000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":105,"title":["Handheld mobile photography in very low light"],"prefix":"10.1145","volume":"38","author":[{"given":"Orly","family":"Liba","sequence":"first","affiliation":[{"name":"Google Research"}]},{"given":"Kiran","family":"Murthy","sequence":"additional","affiliation":[{"name":"Google Research"}]},{"given":"Yun-Ta","family":"Tsai","sequence":"additional","affiliation":[{"name":"Google Research"}]},{"given":"Tim","family":"Brooks","sequence":"additional","affiliation":[{"name":"Google Research"}]},{"given":"Tianfan","family":"Xue","sequence":"additional","affiliation":[{"name":"Google Research"}]},{"given":"Nikhil","family":"Karnad","sequence":"additional","affiliation":[{"name":"Google Research"}]},{"given":"Qiurui","family":"He","sequence":"additional","affiliation":[{"name":"Google Research"}]},{"given":"Jonathan T.","family":"Barron","sequence":"additional","affiliation":[{"name":"Google Research"}]},{"given":"Dillon","family":"Sharlet","sequence":"additional","affiliation":[{"name":"Google Research"}]},{"given":"Ryan","family":"Geiss","sequence":"additional","affiliation":[{"name":"Google Research"}]},{"given":"Samuel W.","family":"Hasinoff","sequence":"additional","affiliation":[{"name":"Google Research"}]},{"given":"Yael","family":"Pritch","sequence":"additional","affiliation":[{"name":"Google Research"}]},{"given":"Marc","family":"Levoy","sequence":"additional","affiliation":[{"name":"Google Research"}]}],"member":"320","published-online":{"date-parts":[[2019,11,8]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Burst image deblurring using permutation invariant convolutional neural networks. ECCV","author":"Aittala Miika","year":"2018","unstructured":"Miika Aittala and Fr\u00e9do Durand. 2018. Burst image deblurring using permutation invariant convolutional neural networks. ECCV (2018)."},{"key":"e_1_2_2_2_1","volume-title":"Convolutional Color Constancy. ICCV","author":"Barron Jonathan T.","year":"2015","unstructured":"Jonathan T. Barron. 2015. Convolutional Color Constancy. ICCV (2015)."},{"key":"e_1_2_2_3_1","volume-title":"Barron and Yun-Ta Tsai","author":"Jonathan","year":"2017","unstructured":"Jonathan T. Barron and Yun-Ta Tsai. 2017. Fast Fourier Color Constancy. CVPR (2017)."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2012.2192126"},{"key":"e_1_2_2_5_1","volume-title":"Barron","author":"Brooks Tim","year":"2019","unstructured":"Tim Brooks, Ben Mildenhall, Tianfan Xue, Jiawen Chen, Dillon Sharlet, and Jonathan T. Barron. 2019. Unprocessing Images for Learned Raw Denoising. CVPR (2019)."},{"key":"e_1_2_2_6_1","volume-title":"Black","author":"Butler Daniel J.","year":"2012","unstructured":"Daniel J. Butler, Jonas Wulff, Garrett B. Stanley, and Michael J. Black. 2012. A naturalistic open source movie for optical flow evaluation. ECCV (2012)."},{"key":"e_1_2_2_7_1","volume-title":"Learning to See in the Dark. CVPR","author":"Chen Chen","year":"2018","unstructured":"Chen Chen, Qifeng Chen, Jia Xu, and Vladlen Koltun. 2018. Learning to See in the Dark. CVPR (2018)."},{"key":"e_1_2_2_8_1","volume-title":"Brown","author":"Cheng Dongliang","year":"2014","unstructured":"Dongliang Cheng, Dilip K. Prasad, and Michael S. Brown. 2014. Illuminant estimation for color constancy: why spatial-domain methods work and the role of the color distribution. JOSA A (2014)."},{"key":"e_1_2_2_9_1","volume-title":"Image denoising by sparse 3-D transform-domain collaborative filtering. TIP","author":"Dabov Kostadin","year":"2007","unstructured":"Kostadin Dabov, Alessandro Foi, Vladimir Katkovnik, and Karen Egiazarian. 2007. Image denoising by sparse 3-D transform-domain collaborative filtering. TIP (2007)."},{"key":"e_1_2_2_10_1","volume-title":"Hand-Held Video Deblurring Via Efficient Fourier Aggregation. TCI","author":"Delbracio Mauricio","year":"2015","unstructured":"Mauricio Delbracio and Guillermo Sapiro. 2015. Hand-Held Video Deblurring Via Efficient Fourier Aggregation. TCI (2015)."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1977.tb01600.x"},{"key":"e_1_2_2_12_1","volume-title":"FlowNet: Learning Optical Flow with Convolutional Networks. ICCV","author":"Dosovitskiy Alexey","year":"2015","unstructured":"Alexey Dosovitskiy, Philipp Fischery, Eddy Ilg, Philip Hausser, Caner Hazirbas, Vladimir Golkov, Patrick van der Smagt, Daniel Cremers, and Thomas Brox. 2015. FlowNet: Learning Optical Flow with Convolutional Networks. ICCV (2015)."},{"key":"e_1_2_2_13_1","volume-title":"Real-Time Video Denoising on Mobile Phones. ICIP","author":"Ehmann Jana","year":"2018","unstructured":"Jana Ehmann, Lun-Cheng Chu, Sung-Fang Tsai, and Chia-Kai Liang. 2018. Real-Time Video Denoising on Mobile Phones. ICIP (2018)."},{"key":"e_1_2_2_14_1","volume-title":"Evaluation of tone mapping operators for HDR video. High Dynamic Range Video","author":"Eilertsen Gabriel","year":"2016","unstructured":"Gabriel Eilertsen, Jonas Unger, and Rafal K Mantiuk. 2016. Evaluation of tone mapping operators for HDR video. High Dynamic Range Video (2016)."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2004.834669"},{"key":"e_1_2_2_16_1","volume-title":"Greenberg","author":"Ferwerda James A.","year":"1996","unstructured":"James A. Ferwerda, Sumanta N. Pattanaik, Peter Shirley, and Donald P. Greenberg. 1996. A model of visual adaptation for realistic image synthesis. Computer graphics and interactive techniques (1996)."},{"key":"e_1_2_2_17_1","volume-title":"Reproduction Angular Error: An Improved Performance Metric for Illuminant Estimation. BMVC","author":"Finlayson Graham","year":"2014","unstructured":"Graham Finlayson and Roshanak Zakizadeh. 2014. Reproduction Angular Error: An Improved Performance Metric for Illuminant Estimation. BMVC (2014)."},{"key":"e_1_2_2_18_1","volume-title":"Color constancy. Vision research","author":"Foster David H.","year":"2011","unstructured":"David H. Foster. 2011. Color constancy. Vision research (2011)."},{"key":"e_1_2_2_19_1","volume-title":"Bayesian color constancy revisited. CVPR","author":"Gehler Peter Vincent","year":"2008","unstructured":"Peter Vincent Gehler, Carsten Rother, Andrew Blake, Tom Minka, and Toby Sharp. 2008. Bayesian color constancy revisited. CVPR (2008)."},{"key":"e_1_2_2_20_1","volume-title":"http:\/\/gfxbench.com\/. [Online","year":"2019","unstructured":"GFXBench. 2019. http:\/\/gfxbench.com\/. [Online; accessed 17-May-2019]."},{"key":"e_1_2_2_21_1","volume-title":"Lucassen","author":"Gijsenij Arjan","year":"2009","unstructured":"Arjan Gijsenij, Theo Gevers, and Marcel P. Lucassen. 2009. Perceptual analysis of distance measures for color constancy algorithms. JOSA A (2009)."},{"key":"e_1_2_2_22_1","volume-title":"Computational Color Constancy: Survey and Experiments","author":"Gijsenij Arjan","year":"2011","unstructured":"Arjan Gijsenij, Theo Gevers, and Joost van de Weijer. 2011. Computational Color Constancy: Survey and Experiments. IEEE TIP (2011)."},{"key":"e_1_2_2_23_1","volume-title":"Deep Burst Denoising. ECCV","author":"Godard Cl\u00e9ment","year":"2018","unstructured":"Cl\u00e9ment Godard, Kevin Matzen, and Matt Uyttendaele. 2018. Deep Burst Denoising. ECCV (2018)."},{"key":"e_1_2_2_24_1","unstructured":"Google LLC. 2016a. Android Camera2 API http:\/\/developer.android.com\/reference\/android\/hardware\/camera2\/package-summary.html."},{"key":"e_1_2_2_25_1","unstructured":"Google LLC. 2016b. HDR+ burst photography dataset http:\/\/www.hdrplusdata.org."},{"key":"e_1_2_2_26_1","unstructured":"Google LLC. 2019. Handheld Mobile Photography in Very Low Light webpage https:\/\/google.github.io\/night-sight\/."},{"key":"e_1_2_2_27_1","volume-title":"Motion Aware Exposure Bracketing for HDR Video. Computer Graphics Forum (Proc. EGSR)","author":"Gryaditskaya Yulia","year":"2015","unstructured":"Yulia Gryaditskaya, Tania Pouli, Erik Reinhard, Karol Myszkowski, and Hans-Peter Seidel. 2015. Motion Aware Exposure Bracketing for HDR Video. Computer Graphics Forum (Proc. EGSR) (2015)."},{"key":"e_1_2_2_28_1","volume-title":"Burst photography for high dynamic range and low-light imaging on mobile cameras. SIGGRAPH Asia","author":"Hasinoff Samuel W","year":"2016","unstructured":"Samuel W Hasinoff, Dillon Sharlet, Ryan Geiss, Andrew Adams, Jonathan T. Barron, Florian Kainz, Jiawen Chen, and Marc Levoy. 2016. Burst photography for high dynamic range and low-light imaging on mobile cameras. SIGGRAPH Asia (2016)."},{"key":"e_1_2_2_29_1","volume-title":"On the relation of optics to painting. Science and culture: Popular and philosophical essays","author":"von Helmholtz Hermann","year":"1995","unstructured":"Hermann von Helmholtz. 1995. On the relation of optics to painting. Science and culture: Popular and philosophical essays (1995)."},{"key":"e_1_2_2_30_1","volume-title":"Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861","author":"Howard Andrew G","year":"2017","unstructured":"Andrew G Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017)."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/1049-9652(91)90045-L"},{"key":"e_1_2_2_32_1","doi-asserted-by":"crossref","unstructured":"David E. Jacobs Orazio Gallo Emily A. Cooper Kari Pulli and Marc Levoy. 2015. Simulating the Visual Experience of Very Bright and Very Dark Scenes. ACM Trans. Graph. (2015).","DOI":"10.1145\/2714573"},{"key":"e_1_2_2_34_1","volume-title":"O'Brien","author":"Kirk Adam G.","year":"2011","unstructured":"Adam G. Kirk and James F. O'Brien. 2011. Perceptually based tone mapping for low-light conditions. ACM Trans. Graph. (2011)."},{"key":"e_1_2_2_35_1","volume-title":"Evaluation of tone mapping operators using a high dynamic range display. SIGGRAPH","author":"Ledda Patrick","year":"2005","unstructured":"Patrick Ledda, Alan Chalmers, Tom Troscianko, and Helge Seetzen. 2005. Evaluation of tone mapping operators using a high dynamic range display. SIGGRAPH (2005)."},{"key":"e_1_2_2_36_1","unstructured":"Marc Levoy. 2012. SynthCam https:\/\/sites.google.com\/site\/marclevoy\/."},{"key":"e_1_2_2_38_1","volume-title":"Fast Burst Images Denoising. SIGGRAPH Asia","author":"Liu Ziwei","year":"2014","unstructured":"Ziwei Liu, Lu Yuan, Xiaoou Tang, Matt Uyttendaele, and Jian Sun. 2014. Fast Burst Images Denoising. SIGGRAPH Asia (2014)."},{"key":"e_1_2_2_39_1","volume-title":"Lucas and Takeo Kanade","author":"Bruce","year":"1981","unstructured":"Bruce D. Lucas and Takeo Kanade. 1981. An Iterative Image Registration Technique with an Application to Stereo Vision. IJCAI (1981)."},{"key":"e_1_2_2_40_1","volume-title":"Digital heritage","author":"MacDonald Lindsay","unstructured":"Lindsay MacDonald. 2006. Digital heritage. Routledge."},{"key":"e_1_2_2_41_1","volume-title":"Video denoising, deblocking, and enhancement through separable 4-D nonlocal spatiotemporal transforms. TIP","author":"Maggioni Matteo","year":"2012","unstructured":"Matteo Maggioni, Giacomo Boracchi, Alessandro Foi, and Karen Egiazarian. 2012. Video denoising, deblocking, and enhancement through separable 4-D nonlocal spatiotemporal transforms. TIP (2012)."},{"key":"e_1_2_2_42_1","volume-title":"Pacific Graphics","author":"Mertens Tom","year":"2007","unstructured":"Tom Mertens, Jan Kautz, and Frank Van Reeth. 2007. Exposure Fusion. Pacific Graphics (2007)."},{"key":"e_1_2_2_43_1","volume-title":"Burst Denoising with Kernel Prediction Networks. CVPR","author":"Mildenhall Ben","year":"2018","unstructured":"Ben Mildenhall, Jonathan T. Barron, Jiawen Chen, Dillon Sharlet, Ren Ng, and Robert Carroll. 2018. Burst Denoising with Kernel Prediction Networks. CVPR (2018)."},{"key":"e_1_2_2_44_1","volume-title":"Image sensors and signal processing for digital still cameras","author":"Nakamura Junichi","unstructured":"Junichi Nakamura. 2016. Image sensors and signal processing for digital still cameras. CRC press."},{"key":"e_1_2_2_45_1","volume-title":"A generalized brightness change model for computing optical flow. ICCV","author":"Negahdaripour Shahriar","year":"1993","unstructured":"Shahriar Negahdaripour and C-H Yu. 1993. A generalized brightness change model for computing optical flow. ICCV (1993)."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2011.6130216"},{"key":"e_1_2_2_47_1","volume-title":"Review of Motion Estimation and Video Stabilization techniques For hand held mobile video. Signal & Image Processing: An International Journal (SIPIJ)","author":"Rawat Dr","year":"2011","unstructured":"Dr Rawat and Singhai Jyoti. 2011. Review of Motion Estimation and Video Stabilization techniques For hand held mobile video. Signal & Image Processing: An International Journal (SIPIJ) (2011)."},{"key":"e_1_2_2_48_1","volume-title":"EpicFlow: Edge-Preserving Interpolation of Correspondences for Optical Flow. CVPR","author":"Revaud Jerome","year":"2015","unstructured":"Jerome Revaud, Philippe Weinzaepfel, Zaid Harchaoui, and Cordelia Schmid. 2015. EpicFlow: Edge-Preserving Interpolation of Correspondences for Optical Flow. CVPR (2015)."},{"key":"e_1_2_2_49_1","volume-title":"A virtual tripod for hand-held video stacking on smartphones. ICCP","author":"Ringaby Erik","year":"2014","unstructured":"Erik Ringaby and Per-Erik Forss\u00e9n. 2014. A virtual tripod for hand-held video stacking on smartphones. ICCP (2014)."},{"key":"e_1_2_2_50_1","volume-title":"Using brightness histogram to perform optimum auto exposure. WSEAS Transactions on Systems and Control","author":"Schulz Simon","year":"2007","unstructured":"Simon Schulz, Marcus Grimm, and Rolf-Rainer Grigat. 2007. Using brightness histogram to perform optimum auto exposure. WSEAS Transactions on Systems and Control (2007)."},{"key":"e_1_2_2_51_1","volume-title":"Change of color appearance in photopic, mesopic and scotopic vision. Optical review","author":"Shin Jae Chul","year":"2004","unstructured":"Jae Chul Shin, Hirohisa Yaguchi, and Satoshi Shioiri. 2004. Change of color appearance in photopic, mesopic and scotopic vision. Optical review (2004)."},{"key":"e_1_2_2_52_1","volume-title":"Color Gamut Transform Pairs. SIGGRAPH","author":"Smith Alvy Ray","year":"1978","unstructured":"Alvy Ray Smith. 1978. Color Gamut Transform Pairs. SIGGRAPH (1978)."},{"key":"e_1_2_2_53_1","volume-title":"Into the twilight zone: the complexities of mesopic vision and luminous efficiency. Ophthalmic and Physiological Optics","author":"Stockman Andrew","year":"2006","unstructured":"Andrew Stockman and Lindsay T Sharpe. 2006. Into the twilight zone: the complexities of mesopic vision and luminous efficiency. Ophthalmic and Physiological Optics (2006)."},{"key":"e_1_2_2_54_1","volume-title":"Creating Hubble's Technicolor Universe. Sky and Telescope","author":"Villard Ray","year":"2002","unstructured":"Ray Villard and Zolta Levay. 2002. Creating Hubble's Technicolor Universe. Sky and Telescope (2002)."},{"key":"e_1_2_2_55_1","volume-title":"Handheld MultiFrame Super-Resolution. ACM Trans. Graph. (Proc. SIGGRAPH)","author":"Wronski Bartlomiej","year":"2019","unstructured":"Bartlomiej Wronski, Ignacio Garcia-Dorado, Manfred Ernst, Damien Kelly, Michael Krainin, Chia-Kai Liang, Marc Levoy, and Peyman Milanfar. 2019. Handheld MultiFrame Super-Resolution. ACM Trans. Graph. (Proc. SIGGRAPH) (2019)."},{"key":"e_1_2_2_56_1","doi-asserted-by":"crossref","unstructured":"Karel Zuiderveld. 1994. Contrast limited adaptive histogram equalization. In Graphics gems IV.","DOI":"10.1016\/B978-0-12-336156-1.50061-6"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3355089.3356508","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3355089.3356508","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:41Z","timestamp":1750203881000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3355089.3356508"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,8]]},"references-count":54,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2019,12,31]]}},"alternative-id":["10.1145\/3355089.3356508"],"URL":"https:\/\/doi.org\/10.1145\/3355089.3356508","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,8]]},"assertion":[{"value":"2019-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}