{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T19:47:09Z","timestamp":1764704829544,"version":"3.46.0"},"reference-count":82,"publisher":"Association for Computing Machinery (ACM)","issue":"4","funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2025,12,2]]},"abstract":"<jats:p>Most current methods for liquid analysis and fraud detection rely on expensive tools and controlled lab environments, making them inaccessible to lay users. We present MobiLyzer, a mobile system that enables fine-grained liquid analysis on unmodified commodity smartphones in realistic environments such as homes and grocery stores. MobiLyzer conducts spectral analysis of liquids based on how their chemical components reflect different wavelengths. Conducting spectral analysis of liquids on smartphones, however, is challenging due to the limited sensing capabilities of smartphones and the heterogeneity in their camera designs. This is further complicated by the uncontrolled nature of ambient illumination and the diversity in liquid containers. The ambient illumination, for example, introduces distortions in measured spectra, and liquid containers cause specular reflections that degrade accuracy. To address these challenges, MobiLyzer utilizes RGB images captured by regular smartphone cameras. It then introduces intrinsic decomposition ideas to mitigate the effects of illumination and interference from liquid containers. It further leverages the near-infrared (NIR) sensors on smartphones to collect complementary signals in the NIR spectral range, partially mitigating the limited sensing capabilities of smartphones. It finally presents a new machine-learning model that reconstructs the entire spectrum in the visible and NIR ranges using the captured RGB and NIR images, which enables fine-grained spectral analysis of liquids on smartphones without the need for expensive equipment. Unlike prior models, the presented spectral reconstruction model preserves the original RGB colors during reconstruction, which is critical for liquid analysis since many liquids differ only in subtle spectral cues. We demonstrate the accuracy and robustness of MobiLyzer through extensive experiments with multiple liquids, four different smartphones, and seven illumination sources. Our results show, for example, that MobiLyzer can accurately detect adulteration with small ratios, identify quality grades of the same liquid (e.g., refined vs. extra virgin olive oil), differentiate the country of origin of oils (e.g., olive oil from Italy versus USA), and analyze the concentration of materials in liquids (e.g., protein concentration in urine for early detection of kidney diseases).<\/jats:p>","DOI":"10.1145\/3770678","type":"journal-article","created":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T19:42:32Z","timestamp":1764704552000},"page":"1-37","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["MobiLyzer: Fine-grained Mobile Liquid Analyzer"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-2272-501X","authenticated-orcid":false,"given":"Shahrzad","family":"Mirzaei","sequence":"first","affiliation":[{"name":"School of Computing Science, Simon Fraser University, Burnaby, British Columbia, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-1454-8744","authenticated-orcid":false,"given":"Mariam","family":"Bebawy","sequence":"additional","affiliation":[{"name":"School of Computing Science, Simon Fraser University, Burnaby, British Columbia, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-8819-2411","authenticated-orcid":false,"given":"Amr Mohamed","family":"Sharafeldin","sequence":"additional","affiliation":[{"name":"School of Computing Science, Simon Fraser University, Burnaby, British Columbia, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3261-4376","authenticated-orcid":false,"given":"Mohamed","family":"Hefeeda","sequence":"additional","affiliation":[{"name":"Hamad Bin Khalifa University, Qatar Computing Research Institute, Doha, Qatar and School of Computing Science, Simon Fraser University, Burnaby, British Columbia, Canada"}]}],"member":"320","published-online":{"date-parts":[[2025,12,2]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.23919\/EUSIPCO55093.2022.9909827"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00199"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330701"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1155\/2013\/341402"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1088\/1538-3873\/acd04a"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR'22)","author":"Boaz","unstructured":"Boaz Arad and et al. 2022. NTIRE 2022 Spectral Recovery Challenge and Data Set. In Proceedings of IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR'22) Workshops. 863\u2013881."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601206"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5194\/isprsarchives-XL-1-W4-207-2015"},{"key":"e_1_2_1_9_1","volume-title":"Intrinsic Decompositions for Image Editing. Computer Graphics Forum (Eurographics State of The Art Report)","author":"Bonneel Nicolas","year":"2017","unstructured":"Nicolas Bonneel, Balazs Kovacs, Sylvain Paris, and Kavita Bala. 2017. Intrinsic Decompositions for Image Editing. Computer Graphics Forum (Eurographics State of The Art Report) (2017)."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW56347.2022.00090"},{"key":"e_1_2_1_11_1","unstructured":"Canadian Food Inspection Agency. 2022. Food Fraud Annual Report 2021 to 2022. https:\/\/inspection.canada.ca\/en\/science-and-research\/our-research-and-publications\/food-fraud-report"},{"key":"e_1_2_1_12_1","article-title":"Intrinsic Image Decomposition via Ordinal Shading","volume":"43","author":"Careaga Chris","year":"2023","unstructured":"Chris Careaga and Ya\u011fiz Aksoy. 2023. Intrinsic Image Decomposition via Ordinal Shading. ACM Trans. Graph. 43, 1, Article 12 (2023), 24 pages.","journal-title":"ACM Trans. Graph."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3687984"},{"key":"e_1_2_1_14_1","unstructured":"Chris Careaga and Ya\u011fiz Aksoy. 2024. Colorful Diffuse Intrinsic Image Decomposition in the Wild. https:\/\/github.com\/compphoto\/Intrinsic. accessed on 2025-07-30."},{"key":"e_1_2_1_15_1","volume-title":"Proteinuria in adults: a diagnostic approach. American family physician 62, 6","author":"Carroll Michael F","year":"2000","unstructured":"Michael F Carroll and Jonathan L Temte. 2000. Proteinuria in adults: a diagnostic approach. American family physician 62, 6 (2000), 1333\u20131340."},{"key":"e_1_2_1_16_1","first-page":"48","article-title":"Fatal poisoning among young children from diethylene glycol-contaminated acetaminophen - Nigeria, 2008\u20132009","volume":"58","author":"Centers for Disease Control and Prevention (CDC).","year":"2009","unstructured":"Centers for Disease Control and Prevention (CDC). 2009. Fatal poisoning among young children from diethylene glycol-contaminated acetaminophen - Nigeria, 2008\u20132009. MMWR Morb. Mortal. Wkly. Rep. 58, 48 (Dec. 2009), 1345\u20131347.","journal-title":"MMWR Morb. Mortal. Wkly. Rep."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3517256"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3517256"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4419-9170-6"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3636534.3690687"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.2307\/1422186"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.32.000381"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2022.103538"},{"key":"e_1_2_1_24_1","unstructured":"ONNX Runtime developers. 2021. ONNX Runtime. https:\/\/onnxruntime.ai\/. Version: x.y.z."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.33785\/IJDS.2020.v73i02.005"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3210240.3210345"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of International Conference on Learning Representations (ICLR'21)","author":"Dosovitskiy Alexey","year":"2021","unstructured":"Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby. 2021. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In Proceedings of International Conference on Learning Representations (ICLR'21)."},{"key":"e_1_2_1_28_1","unstructured":"U.S. Food and Drug Administration. 2023. Economically Motivated Adulteration (Food Fraud). https:\/\/www.fda.gov\/food\/compliance-enforcement-food\/economically-motivated-adulteration-food-fraud\/"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/tci.2018.2855445"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-021-01563-8"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-021-01563-8"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cdc.2021.100702"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.foodres.2018.12.052"},{"key":"e_1_2_1_34_1","unstructured":"Google Research. 2020. uDepth: Real-time 3D Depth Sensing on the Pixel 4. https:\/\/research.google\/blog\/udepth-real-time-3d-depth-sensing-on-the-pixel-4\/. Accessed: 2025-04-15."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jafr.2024.101123"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3636534.3690666"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447993.3448621"},{"key":"e_1_2_1_38_1","volume-title":"Kotlin Programming Language. https:\/\/kotlinlang.org. Version accessed","year":"2025","unstructured":"JetBrains. 2011. Kotlin Programming Language. https:\/\/kotlinlang.org. Version accessed: July 2025."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.58"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00126537"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfca.2022.104713"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00942"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478075"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20216399"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1002\/col.1049"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.3390\/agriculture11020147"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1093\/ndt\/gfad215"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.clnu.2022.10.001"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tifs.2019.07.045"},{"key":"e_1_2_1_50_1","volume-title":"Amr Mohamed Sharafeldin, and Mohamed Hefeeda","author":"Mirzaei Shahrzad","year":"2025","unstructured":"Shahrzad Mirzaei, Mariam Bebawy, Amr Mohamed Sharafeldin, and Mohamed Hefeeda. 2025. MobiLyzer Source Code, and Dataset. https:\/\/github.com\/chercode\/mobilyzer-imwut25"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581783.3612082"},{"key":"e_1_2_1_52_1","unstructured":"World Health Organization. 2017. A Study on the Public Health and Socioeconomic Impact of Substandard and Falsified Medical Products. https:\/\/www.who.int\/publications\/i\/item\/9789241513432\/"},{"key":"e_1_2_1_53_1","unstructured":"World Health Organization. 2022. Medical Product Alert N\u00b07\/2022: Substandard (contaminated) Paediatric Liquid Dosage Medicines. https:\/\/www.who.int\/news\/item\/02-11-2022-medical-product-alert-n-7-2022-substandard-(contaminated)-paediatric-liquid-dosage-medicines\/"},{"key":"e_1_2_1_54_1","unstructured":"World Health Organization. 2023. WHO urges action to protect children from contaminated medicines. https:\/\/www.who.int\/news\/item\/23-01-2023-who-urges-action-to-protect-children-from-contaminated-medicines\/"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1002\/9780470027318.a1018"},{"key":"e_1_2_1_56_1","volume-title":"PyTorch: An imperative style, high-performance deep learning library. arXiv preprint arXiv:1912.01703. 12 pages","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas K\u00f6pf, Edward Yang, Zach DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An imperative style, high-performance deep learning library. arXiv preprint arXiv:1912.01703. 12 pages; NeurIPS 2019."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.3390\/foods10030484"},{"key":"e_1_2_1_58_1","volume-title":"Hyperspectral Remote Sensing: Fundamentals and Practices","author":"Ruiliang Pu.","unstructured":"Ruiliang Pu. 2017. Hyperspectral Remote Sensing: Fundamentals and Practices. Routledge."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2994551.2994572"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1002\/aocs.12774"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.microc.2017.06.002"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1080\/10942912.2017.1360905"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1002\/col.5080100409"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3643509"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3495243.3560540"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3569469"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3570361.3613296"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3498361.3539776"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3551640"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3546037.3546053"},{"key":"e_1_2_1_71_1","unstructured":"Hamid Tabani Ajay Balasubramaniam Elahe Arani and Bahram Zonooz. 2021. Challenges and Obstacles Towards Deploying Deep Learning Models on Mobile Devices. arXiv:2105.02613 [cs.LG] https:\/\/arxiv.org\/abs\/2105.02613"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.2196\/19346"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21154985"},{"key":"e_1_2_1_74_1","volume-title":"Proceedings of USENIX Symposium on Networked Systems Design and Implementation (NSDI'20)","author":"Ha Unsoo","year":"2020","unstructured":"Unsoo Ha, Junshan Leng, Alaa Khaddaj, and Fadel Adib. 2020. Food and Liquid Sensing in Practical Environments using RFIDs. In Proceedings of USENIX Symposium on Networked Systems Design and Implementation (NSDI'20)."},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2023.3255164"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3631443"},{"key":"e_1_2_1_77_1","volume-title":"RipeTrack: Assessing Fruit Ripeness and Remaining Lifetime using Smartphones","author":"Waseem Muhammad Shahzaib","year":"2025","unstructured":"Muhammad Shahzaib Waseem, Neha Sharma, and Mohamed Hefeeda. 2025. RipeTrack: Assessing Fruit Ripeness and Remaining Lifetime using Smartphones. IEEE Transactions on Mobile Computing (2025), 1\u201316."},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.2215\/CJN.03190906"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2022.3144427"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3307334.3326078"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1002\/fsn3.1980"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.3390\/pr10020214"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3770678","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T19:43:53Z","timestamp":1764704633000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3770678"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,2]]},"references-count":82,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,12,2]]}},"alternative-id":["10.1145\/3770678"],"URL":"https:\/\/doi.org\/10.1145\/3770678","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,2]]},"assertion":[{"value":"2025-12-02","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}