{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T16:17:50Z","timestamp":1771949870175,"version":"3.50.1"},"reference-count":76,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2020,3,17]],"date-time":"2020-03-17T00:00:00Z","timestamp":1584403200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003422","name":"Global Collaborative Research, King Abdullah University of Science and Technology","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003422","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2020,4,30]]},"abstract":"<jats:p>Single Photon Avalanche Photodiodes (SPADs) have recently received a lot of attention in imaging and vision applications due to their excellent performance in low-light conditions, as well as their ultra-high temporal resolution. Unfortunately, like many evolving sensor technologies, image sensors built around SPAD technology currently suffer from a low pixel count.<\/jats:p>\n          <jats:p>In this work, we investigate a simple, low-cost, and compact optical coding camera design that supports high-resolution image reconstructions from raw measurements with low pixel counts. We demonstrate this approach for regular intensity imaging, depth imaging, as well transient imaging.<\/jats:p>\n          <jats:p>Our method uses an end-to-end framework to simultaneously optimize the optical design and a reconstruction network for obtaining super-resolved images from raw measurements. The optical design space is that of an engineered point spread function (implemented with diffractive optics), which can be considered an optimized anti-aliasing filter to preserve as much high-resolution information as possible despite imaging with a low pixel count, low fill-factor SPAD array. We further investigate a deep network for reconstruction. The effectiveness of this joint design and reconstruction approach is demonstrated for a range of different applications, including high-speed imaging, and time of flight depth imaging, as well as transient imaging. While our work specifically focuses on low-resolution SPAD sensors, similar approaches should prove effective for other emerging image sensor technologies with low pixel counts and low fill-factors.<\/jats:p>","DOI":"10.1145\/3372261","type":"journal-article","created":{"date-parts":[[2020,3,18]],"date-time":"2020-03-18T04:34:35Z","timestamp":1584506075000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":46,"title":["End-to-end Learned, Optically Coded Super-resolution SPAD Camera"],"prefix":"10.1145","volume":"39","author":[{"given":"Qilin","family":"Sun","sequence":"first","affiliation":[{"name":"King Abdullah University of Science and Technology, KAUST, Thuwal, Saudi Arabia"}]},{"given":"Jian","family":"Zhang","sequence":"additional","affiliation":[{"name":"Peking University, Shenzhen, China"}]},{"given":"Xiong","family":"Dun","sequence":"additional","affiliation":[{"name":"Tongji University, Shanghai, China"}]},{"given":"Bernard","family":"Ghanem","sequence":"additional","affiliation":[{"name":"King Abdullah University of Science and Technology, KAUST, Thuwal, Saudi Arabia"}]},{"given":"Yifan","family":"Peng","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}]},{"given":"Wolfgang","family":"Heidrich","sequence":"additional","affiliation":[{"name":"King Abdullah University of Science and Technology, KAUST, Thuwal, Saudi Arabia"}]}],"member":"320","published-online":{"date-parts":[[2020,3,17]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.161"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2013.2278763"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.5244\/C.26.135"},{"key":"e_1_2_2_4_1","volume-title":"Proceedings of the IS & T\u2019s PICS Conference. Society for Imaging Science and Technology, 191--195","author":"Peter"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2016.2598681"},{"key":"e_1_2_2_6_1","volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems. 3081--3089","author":"Chakrabarti Ayan","year":"2016"},{"key":"e_1_2_2_7_1","volume-title":"Hybrid optical-electronic convolutional neural networks with optimized diffractive optics for image classification. Sci. Rep. 8, 12324","author":"Chang Julie","year":"2018"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.01029"},{"key":"e_1_2_2_9_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201915)","author":"Chen Huaijin","year":"2015"},{"key":"e_1_2_2_10_1","volume-title":"Transactions on","author":"Datta Soma"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.15.018066"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2015.2439281"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46475-6_25"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1364\/AO.34.001859"},{"key":"e_1_2_2_15_1","volume-title":"Single-photon sensitive light-in-fight imaging. Nat. Commun. 6","author":"Gariepy Genevieve","year":"2015"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1088\/1464-4258\/5\/5\/358"},{"key":"e_1_2_2_17_1","first-page":"237","article-title":"A practical algorithm for the determination of phase from image and diffraction plane pictures","volume":"35","author":"Gerchberg Ralph W.","year":"1972","journal-title":"Optik"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.405"},{"key":"e_1_2_2_19_1","volume-title":"Introduction to Fourier Optics","author":"Goodman Joseph W."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00179"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_2_22_1","volume-title":"Sub-picosecond photon-efficient 3D imaging using single-photon sensors. Scientific Reports 8, 17726","author":"Heide Felix","year":"2018"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269977"},{"key":"e_1_2_2_24_1","volume-title":"Encoded diffractive optics for full-spectrum computational imaging. Sci. Rep. 6","author":"Heide Felix","year":"2016"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.22.026338"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dsp.2019.102591"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.23.033777"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.20.002814"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.182"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.181"},{"key":"e_1_2_2_31_1","volume-title":"Goyal","author":"Kirmani Ahmed","year":"2014"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.618"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276464"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531403"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.3390\/s120505650"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.18.010257"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2017.151"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201316"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322937"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.21.010526"},{"key":"e_1_2_2_41_1","volume-title":"Willett","author":"Marcia Roummel F.","year":"2009"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/JMEMS.2003.823220"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1088\/0031-9155\/60\/12\/4635"},{"key":"e_1_2_2_44_1","volume-title":"Time-correlated Single Photon Counting","author":"O\u2019Connor Desmond"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.246"},{"key":"e_1_2_2_46_1","volume-title":"Digital Signal Processing 101","author":"Parker Michael"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0900245106"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.22.004202"},{"key":"e_1_2_2_49_1","volume-title":"Signal processing based pile-up compensation for gated single-photon avalanche diodes. arXiv preprint arXiv:1806.07437","author":"Pediredla Adithya K.","year":"2018"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPHOT.2018.8368469"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925941"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356526"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.proeng.2017.09.665"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1364\/AO.54.010018"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299003"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSSC.2008.2005818"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.113.133902"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.207"},{"key":"e_1_2_2_59_1","volume-title":"Shapiro","author":"Shin Dongeek","year":"2016"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201333"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00668"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00036"},{"key":"e_1_2_2_63_1","volume-title":"Proceedings of the Asian Conference on Computer Vision. 111--126","author":"Timofte Radu","year":"2014"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSTQE.2018.2867439"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms1747"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461928"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.50"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPHOT.2019.8747330"},{"key":"e_1_2_2_69_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201915)","author":"Xiao Lei","year":"2015"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.75"},{"key":"e_1_2_2_71_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201908)","author":"Yang Jianchao","year":"2008"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2010.2050625"},{"key":"e_1_2_2_73_1","volume-title":"Computational Optical Sensing and Imaging","author":"Yeh Li-Hao"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-27413-8_47"},{"key":"e_1_2_2_75_1","volume-title":"Prince","author":"Zhao Can","year":"2018"},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-010-0409-8"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3372261","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3372261","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:32:10Z","timestamp":1750195930000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3372261"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,17]]},"references-count":76,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,4,30]]}},"alternative-id":["10.1145\/3372261"],"URL":"https:\/\/doi.org\/10.1145\/3372261","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,17]]},"assertion":[{"value":"2018-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-03-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}