{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T18:07:04Z","timestamp":1758823624066,"version":"3.44.0"},"reference-count":68,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T00:00:00Z","timestamp":1724284800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Ontario Research Fund"},{"DOI":"10.13039\/501100006374","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006374","name":"Canada Foundation for Innovation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2024,8,22]]},"abstract":"<jats:p>Hyperspectral imaging captures scene information across narrow, contiguous bands of the electromagnetic spectrum. Despite its proven utility in industrial and biomedical applications, its ubiquity has been limited by bulky form factors, slow capture times, and prohibitive costs. In this work, we propose a generalized approach to snapshot hyperspectral imaging that only requires a standard rolling shutter camera and wavelength-adjustable lighting. The crux of this approach entails using the rolling shutter as a spatiotemporal mask, varying incoming light quicker than the camera's frame rate in order for the captured image to contain rows of pixels illuminated at different wavelengths. An image reconstruction pipeline then converts this coded image into a complete hyperspectral image using sparse optimization. We demonstrate the feasibility of this approach by deploying a low-cost system called ChromaFlash, which uses a smartphone's camera for image acquisition and a series of LEDs to change the scene's illumination. We evaluated ChromaFlash through simulations on two public hyperspectral datasets and assessed its spatial and spectral accuracy across various system parameters. We also tested the real-world performance of our prototype by capturing diverse scenes under varied ambient lighting conditions. In both experiments, ChromaFlash outperformed state-of-the-art techniques that use deep learning to convert RGB images into hyperspectral ones, achieving snapshot performance not demonstrated by prior attempts at accessible hyperspectral imaging.<\/jats:p>","DOI":"10.1145\/3678582","type":"journal-article","created":{"date-parts":[[2024,9,9]],"date-time":"2024-09-09T14:36:21Z","timestamp":1725892581000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["ChromaFlash: Snapshot Hyperspectral Imaging Using Rolling Shutter Cameras"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4780-5901","authenticated-orcid":false,"given":"Dhruv","family":"Verma","sequence":"first","affiliation":[{"name":"University of Toronto, Toronto, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1592-9248","authenticated-orcid":false,"given":"Ian","family":"Ruffolo","sequence":"additional","affiliation":[{"name":"University of Toronto, Toronto, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6999-3958","authenticated-orcid":false,"given":"David B.","family":"Lindell","sequence":"additional","affiliation":[{"name":"University of Toronto, Toronto, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5165-902X","authenticated-orcid":false,"given":"Kiriakos N.","family":"Kutulakos","sequence":"additional","affiliation":[{"name":"University of Toronto, Toronto, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9986-3345","authenticated-orcid":false,"given":"Alex","family":"Mariakakis","sequence":"additional","affiliation":[{"name":"University of Toronto, Toronto, Canada"}]}],"member":"320","published-online":{"date-parts":[[2024,9,9]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3332165.3347889"},{"key":"e_1_2_1_2_1","volume-title":"Hyperspectral recovery from RGB images using Gaussian processes","author":"Akhtar Naveed","year":"2018","unstructured":"Naveed Akhtar and Ajmal Mian. 2018. Hyperspectral recovery from RGB images using Gaussian processes. IEEE transactions on pattern analysis and machine intelligence 42, 1 (2018), 100--113."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2017.64"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPHOT.2019.8747341"},{"volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. 863--881","author":"Arad Boaz","key":"e_1_2_1_5_1","unstructured":"Boaz Arad, Radu Timofte, Rony Yahel, Nimrod Morag, Amir Bernat, Yuanhao Cai, Jing Lin, Zudi Lin, Haoqian Wang, Yulun Zhang, Hanspeter Pfister, Luc Van Gool, Shuai Liu, Yongqiang Li, Chaoyu Feng, Lei Lei, Jiaojiao Li, Songcheng Du, Chaoxiong Wu, Yihong Leng, Rui Song, Mingwei Zhang, Chongxing Song, Shuyi Zhao, Zhiqiang Lang, Wei Wei, Lei Zhang, Renwei Dian, Tianci Shan, Anjing Guo, Chengguo Feng, Jinyang Liu, Mirko Agarla, Simone Bianco, Marco Buzzelli, Luigi Celona, Raimondo Schettini, Jiang He, Yi Xiao, Jiajun Xiao, Qiangqiang Yuan, Jie Li, Liangpei Zhang, Taesung Kwon, Dohoon Ryu, Hyokyoung Bae, Hao-Hsiang Yang, Hua-En Chang, Zhi-Kai Huang, Wei-Ting Chen, Sy-Yen Kuo, Junyu Chen, Haiwei Li, Song Liu, Sabarinathan, K Uma, B Sathya Bama, and S. Mohamed Mansoor Roomi. 2022. NTIRE 2022 Spectral Recovery Challenge and Data Set. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. 863--881."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2013.2278763"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130896"},{"volume-title":"Sensors, Cameras, and Applications for Digital Photography","author":"Baer Richard L","key":"e_1_2_1_8_1","unstructured":"Richard L Baer, William D Holland, Jack M Holm, and Poorvi L Vora. 1999. Comparison of primary and complementary color filters for CCD-based digital photography. In Sensors, Cameras, and Applications for Digital Photography, Vol. 3650. SPIE, 16--25."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3569479"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Stephen Boyd Neal Parikh Eric Chu Borja Peleato Jonathan Eckstein et al. 2011. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends\u00ae in Machine learning 3 1 (2011) 1--122.","DOI":"10.1561\/2200000016"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3131672.3131696"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3360725"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW56347.2022.00090"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2005.858979"},{"key":"e_1_2_1_15_1","volume-title":"A prism-mask system for multispectral video acquisition","author":"Cao Xun","year":"2011","unstructured":"Xun Cao, Hao Du, Xin Tong, Qionghai Dai, and Stephen Lin. 2011. A prism-mask system for multispectral video acquisition. IEEE transactions on pattern analysis and machine intelligence 33, 12 (2011), 2423--2435."},{"key":"e_1_2_1_16_1","volume-title":"A Survey on Hyperspectral Sensing Techniques for Identification of Fake Pharmaceuticals Medicines. AITC-2023 and CSSP-2023","author":"Dhole Pravin V","year":"2023","unstructured":"Pravin V Dhole, Vijay D Dhangar, Sulochana D Shejul, and Bharti W Gawali. 2023. A Survey on Hyperspectral Sensing Techniques for Identification of Fake Pharmaceuticals Medicines. AITC-2023 and CSSP-2023 (2023), 244."},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"David L Donoho Xiaoming Huo et al. 2001. Uncertainty principles and ideal atomic decomposition. IEEE transactions on information theory 47 7 (2001) 2845--2862.","DOI":"10.1109\/18.959265"},{"volume-title":"Applied industrial optics: Spectroscopy, imaging and metrology","author":"Eichenholz Jason M","key":"e_1_2_1_18_1","unstructured":"Jason M Eichenholz, Nick Barnett, and Dave Fish. 2010. Sequential filter wheel multispectral imaging systems. In Applied industrial optics: Spectroscopy, imaging and metrology. Optica Publishing Group, ATuB2."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2014.7025137"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW50498.2020.00248"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2804282"},{"volume-title":"Techniques and applications of hyperspectral image analysis","author":"Grahn Hans","key":"e_1_2_1_22_1","unstructured":"Hans Grahn and Paul Geladi. 2007. Techniques and applications of hyperspectral image analysis. John Wiley & Sons."},{"key":"e_1_2_1_23_1","volume-title":"Colin L Masters, Alice P\u00e9bay, Sophie Chevalier, Jason Ha, Samantha Loi, Christopher J Fowler, Christopher Rowe, et al.","author":"Hadoux Xavier","year":"2019","unstructured":"Xavier Hadoux, Flora Hui, Jeremiah KH Lim, Colin L Masters, Alice P\u00e9bay, Sophie Chevalier, Jason Ha, Samantha Loi, Christopher J Fowler, Christopher Rowe, et al. 2019. Non-invasive in vivo hyperspectral imaging of the retina for potential biomarker use in Alzheimer's disease. Nature communications 10, 1 (2019), 4227."},{"key":"e_1_2_1_24_1","volume-title":"Guided image filtering","author":"He Kaiming","year":"2012","unstructured":"Kaiming He, Jian Sun, and Xiaoou Tang. 2012. Guided image filtering. IEEE transactions on pattern analysis and machine intelligence 35, 6 (2012), 1397--1409."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.vibspec.2021.103329"},{"key":"e_1_2_1_26_1","first-page":"1","article-title":"BabyNutri: A Cost-Effective Baby Food Macronutrients Analyzer Based on Spectral Reconstruction","volume":"7","author":"Hu Haiyan","year":"2023","unstructured":"Haiyan Hu, Qianyi Huang, and Qian Zhang. 2023. BabyNutri: A Cost-Effective Baby Food Macronutrients Analyzer Based on Spectral Reconstruction. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 1 (2023), 1--30.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.optlaseng.2022.107098"},{"key":"e_1_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Daniel S Jeon Seung-Hwan Baek Shinyoung Yi Qiang Fu Xiong Dun Wolfgang Heidrich and Min H Kim. 2019. Compact snapshot hyperspectral imaging with diffracted rotation. (2019).","DOI":"10.1145\/3306346.3322946"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3369834"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1117\/1.2434950"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2018.00129"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07998-1_4"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2867171"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00267"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20082426"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jspr.2015.01.006"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264936"},{"key":"e_1_2_1_38_1","volume-title":"Forensic analysis of beverage stains using hyperspectral imaging. Scientific reports 11, 1","author":"Devassy Binu Melit","year":"2021","unstructured":"Binu Melit Devassy and Sony George. 2021. Forensic analysis of beverage stains using hyperspectral imaging. Scientific reports 11, 1 (2021), 6512."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1364\/OPTICA.397214"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01343"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.270"},{"key":"e_1_2_1_42_1","unstructured":"Ryosuke Okuta Yuya Unno Daisuke Nishino Shohei Hido and Crissman Loomis. 2017. CuPy: A NumPy-Compatible Library for NVIDIA GPU Calculations. In Proceedings of Workshop on Machine Learning Systems (LearningSys) in The Thirty-first Annual Conference on Neural Information Processing Systems (NIPS). http:\/\/learningsys.org\/nips17\/assets\/papers\/paper_16.pdf"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/192161.192213"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2007.4409090"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.softx.2019.100361"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2513383.2513392"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCP54855.2022.9887696"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00242"},{"key":"e_1_2_1_49_1","volume-title":"Nicolas Walter, Aamir Saeed Malik, and Fabrice Meriaudeau.","author":"Shahzad Aamir","year":"2014","unstructured":"Aamir Shahzad, Mohamad Naufal Saad, Nicolas Walter, Aamir Saeed Malik, and Fabrice Meriaudeau. 2014. Hyperspectral venous image quality assessment for optimum illumination range selection based on skin tone characteristics. Biomedical engineering online 13, 1 (2014), 1--13."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3570361.3613296"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPHOT.2018.8368472"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.3390\/jimaging7080136"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1080\/10408436.2020.1819199"},{"volume-title":"The Fabry-Perot interferometer: history, theory, practice and applications","author":"Vaughan M","key":"e_1_2_1_54_1","unstructured":"M Vaughan. 2017. The Fabry-Perot interferometer: history, theory, practice and applications. Routledge."},{"volume-title":"Plug-and-play priors for model based reconstruction. In 2013 IEEE global conference on signal and information processing","author":"Venkatakrishnan Singanallur V","key":"e_1_2_1_55_1","unstructured":"Singanallur V Venkatakrishnan, Charles A Bouman, and Brendt Wohlberg. 2013. Plug-and-play priors for model based reconstruction. In 2013 IEEE global conference on signal and information processing. IEEE, 945--948."},{"key":"e_1_2_1_56_1","volume-title":"Single disperser design for coded aperture snapshot spectral imaging. Applied optics 47, 10","author":"Wagadarikar Ashwin","year":"2008","unstructured":"Ashwin Wagadarikar, Renu John, Rebecca Willett, and David Brady. 2008. Single disperser design for coded aperture snapshot spectral imaging. Applied optics 47, 10 (2008), B44-B51."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971653"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123024.3123180"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVCS.2013.6626274"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3569502"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfoodeng.2019.01.004"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2017.68"},{"key":"e_1_2_1_63_1","unstructured":"F. Yasuma T. Mitsunaga D. Iso and S.K. Nayar. 2008. Generalized Assorted Pixel Camera: Post-Capture Control of Resolution Dynamic Range and Spectrum. Technical Report."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3098279.3098541"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2021.3106285"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2020.3023869"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01039"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00890"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3678582","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3678582","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T14:41:46Z","timestamp":1755787306000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3678582"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,22]]},"references-count":68,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,8,22]]}},"alternative-id":["10.1145\/3678582"],"URL":"https:\/\/doi.org\/10.1145\/3678582","relation":{},"ISSN":["2474-9567"],"issn-type":[{"type":"electronic","value":"2474-9567"}],"subject":[],"published":{"date-parts":[[2024,8,22]]},"assertion":[{"value":"2024-09-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}