{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T22:21:53Z","timestamp":1780611713756,"version":"3.54.1"},"reference-count":75,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2025,9,3]]},"abstract":"<jats:p>Developing an accessible fruit sugar content detection system for average users, particularly diabetic patients, is essential. Current fruit sugar detection solutions often fail to balance ease of use with high accuracy. In this study, we introduce FruitPhone, an innovative smartphone-based spectral imaging system that provides quantitative assessments of fruit sugar content. To enable the smartphone to capture the fine-grained spectral features necessary for accurate sugar content analysis, FruitPhone utilizes the smartphone screen to simulate multiple monochromatic light sources. This approach allows for the collection of spectral data that extends beyond the standard three-channel RGB format. To address the discrepancies between screen-generated and true monochromatic light, we propose a two-stage spectral reconstruction algorithm that translates the smartphone's pseudo-spectral data into real multi-spectral images for further analysis. Additionally, we tackle environmental variability by employing a black screen light for reference data collection, which helps mitigate ambient influences and enhance consistency. We also introduce a detrending algorithm for high-dimensional spectral images to correct spatial inconsistencies while preserving spectral trends. We evaluate FruitPhone using 335 spectral images from 37 different fruit types, achieving a normalized mean-absolute error of 8.48% \u00b0Bx, which is comparable to that of a laboratory spectral system and demonstrates a 19.98% reduction in reconstruction errors, along with a 45.58% R2 improvement over baseline schemes.<\/jats:p>","DOI":"10.1145\/3749470","type":"journal-article","created":{"date-parts":[[2025,9,3]],"date-time":"2025-09-03T17:15:45Z","timestamp":1756919745000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["FruitPhone: Detecting Sugar Content in Fruits Using Unmodified Smartphones with Spectral Imaging"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4862-5619","authenticated-orcid":false,"given":"Haiyan","family":"Hu","sequence":"first","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-8304-0844","authenticated-orcid":false,"given":"Yinan","family":"Zhu","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-4006-2734","authenticated-orcid":false,"given":"Shanwen","family":"Chen","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9525-7754","authenticated-orcid":false,"given":"Qianyi","family":"Huang","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University, Guang Zhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9205-1881","authenticated-orcid":false,"given":"Qian","family":"Zhang","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,9,3]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3570361.3613275"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2017.64"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46478-7_2"},{"key":"e_1_2_1_4_1","volume-title":"Watermelon ripeness detector using near infrared spectroscopy. Jurnal Teknologi dan Sistem Komputer 8, 4","author":"Arboleda Edwin R","year":"2020","unstructured":"Edwin R Arboleda, Kimberly M Parazo, and Christle M Pareja. 2020. Watermelon ripeness detector using near infrared spectroscopy. Jurnal Teknologi dan Sistem Komputer 8, 4 (2020), 317--322."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW54120.2021.00152"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.foodres.2012.05.004"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.3390\/foods11142086"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSTARS.2025.3533302"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW56347.2022.00090"},{"key":"e_1_2_1_10_1","volume-title":"Early detection of plant stress by digital imaging within narrow stress-sensitive wavebands. Remote sensing of environment 50, 3","author":"Carter Gregory A","year":"1994","unstructured":"Gregory A Carter and Richard L Miller. 1994. Early detection of plant stress by digital imaging within narrow stress-sensitive wavebands. Remote sensing of environment 50, 3 (1994), 295--302."},{"key":"e_1_2_1_11_1","volume-title":"Siyuan Xing, Bruce D Hammock, and Tingrui Pan.","author":"Chen Arnold","year":"2014","unstructured":"Arnold Chen, Royal Wang, Candace RS Bever, Siyuan Xing, Bruce D Hammock, and Tingrui Pan. 2014. Smartphone-interfaced lab-on-a-chip devices for field-deployable enzyme-linked immunosorbent assay. Biomicrofluidics 8, 6 (2014)."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2018.08.046"},{"key":"e_1_2_1_13_1","volume-title":"A personalized food allergen testing platform on a cellphone. Lab on a Chip 13, 4","author":"Coskun Ahmet F","year":"2013","unstructured":"Ahmet F Coskun, Justin Wong, Delaram Khodadadi, Richie Nagi, Andrew Tey, and Aydogan Ozcan. 2013. A personalized food allergen testing platform on a cellphone. Lab on a Chip 13, 4 (2013), 636--640."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1039\/D1AN00025J"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.vibspec.2023.103599"},{"key":"e_1_2_1_16_1","unstructured":"Felix. 2024. F-750 Produce Quality Meter. https:\/\/felixinstruments.com\/food-science-instruments\/nir-spectroscopy\/f-750-produce-quality-meter\/"},{"key":"e_1_2_1_17_1","volume-title":"Recent advances in ultrasound application as a novel technique in analysis, processing and quality control of fruits, juices and dairy products industries: A review. Ultrasonics sonochemistry 57","author":"Firouz Mahmoud Soltani","year":"2019","unstructured":"Mahmoud Soltani Firouz, Ali Farahmandi, and Soleiman Hosseinpour. 2019. Recent advances in ultrasound application as a novel technique in analysis, processing and quality control of fruits, juices and dairy products industries: A review. Ultrasonics sonochemistry 57 (2019), 73--88."},{"key":"e_1_2_1_18_1","unstructured":"Food and Agriculture Organization. 2021. The State of Food and Agriculture. http:\/\/www.fao.org\/publications\/sofa\/2021\/en\/ Accessed: 2023-10-01."},{"key":"e_1_2_1_19_1","volume-title":"Limitations of Data-Driven Spectral Reconstruction-An Optics-Aware Analysis. arXiv preprint arXiv:2401.03835","author":"Fu Qiang","year":"2024","unstructured":"Qiang Fu, Matheus Souza, Eunsue Choi, Suhyun Shin, Seung-Hwan Baek, and Wolfgang Heidrich. 2024. Limitations of Data-Driven Spectral Reconstruction-An Optics-Aware Analysis. arXiv preprint arXiv:2401.03835 (2024)."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCI.2018.2855445"},{"key":"e_1_2_1_21_1","unstructured":"Cubert GmbH. 2023. FIREFLEYE 185. https:\/\/www.cubert-hyperspectral.com\/products\/firefleye-185."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2804282"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1364\/BOE.497602"},{"key":"e_1_2_1_24_1","volume-title":"Hyperspectral imaging enabled by an unmodified smartphone for analyzing skin morphological features and monitoring hemodynamics. Biomedical optics express 11, 2","author":"He Qinghua","year":"2020","unstructured":"Qinghua He and Ruikang Wang. 2020. Hyperspectral imaging enabled by an unmodified smartphone for analyzing skin morphological features and monitoring hemodynamics. Biomedical optics express 11, 2 (2020), 895--910."},{"key":"e_1_2_1_25_1","first-page":"1","article-title":"Babynutri: a cost-effective baby food macronutrients analyzer based on spectral reconstruction","volume":"7","author":"Hu Haiyan","year":"2023","unstructured":"Haiyan Hu, Qianyi Huang, and Qian Zhang. 2023. Babynutri: a cost-effective baby food macronutrients analyzer based on spectral reconstruction. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 7, 1 (2023), 1--30.","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2022.3163710"},{"key":"e_1_2_1_27_1","unstructured":"Food Marketing Institute. 2021. Consumer Trends in Food Quality. https:\/\/www.fmi.org\/research-and-reports Accessed: 2023-10-01."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.3390\/mi10030180"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfoodeng.2022.111254"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00371"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfoodeng.2022.111401"},{"key":"e_1_2_1_32_1","volume-title":"Josse De Baerdemaeker, and Bart Nicola\u0131","author":"Lammertyn Jeroen","year":"2000","unstructured":"Jeroen Lammertyn, Ann Peirs, Josse De Baerdemaeker, and Bart Nicola\u0131. 2000. Light penetration properties of NIR radiation in fruit with respect to non-destructive quality assessment. Postharvest biology and technology 18, 2 (2000), 121--132."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW50498.2020.00239"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.3390\/a14010018"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2017.2776167"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.scienta.2019.03.042"},{"key":"e_1_2_1_37_1","first-page":"1","article-title":"Wi-Fruit: See through fruits with smart devices","volume":"5","author":"Liu Yutong","year":"2021","unstructured":"Yutong Liu, Landu Jiang, Linghe Kong, Qiao Xiang, Xue Liu, and Guihai Chen. 2021. Wi-Fruit: See through fruits with smart devices. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 4 (2021), 1--29.","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11947-011-0725-1"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01264-9_22"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.scienta.2015.01.001"},{"key":"e_1_2_1_41_1","unstructured":"Display Mate. [n. d.]. Light Spectra for the Apple iPhone X. https:\/\/www.displaymate.com\/Spectra_41a.html."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.3390\/s18010223"},{"key":"e_1_2_1_43_1","volume-title":"Fifth Asia-Pacific Optical Sensors Conference","volume":"9655","author":"Mignani Anna Grazia","year":"2015","unstructured":"Anna Grazia Mignani, Andrea Azelio Mencaglia, Massimo Baldi, and Leonardo Ciaccheri. 2015. SpiderSpec: A low-cost compact colorimeter with IoT functionality. In Fifth Asia-Pacific Optical Sensors Conference, Vol. 9655. SPIE, 96--99."},{"key":"e_1_2_1_44_1","unstructured":"mileseey. 2023. SM20 Saccharimeter. https:\/\/www.mileseey.net\/ProductCenter\/ProductCenterList1034\/10.html."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1255\/jnirs.73"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.biomaterials.2015.04.054"},{"key":"e_1_2_1_47_1","unstructured":"National Institute of Health. 2020. Healthcare Costs of Poor Nutrition. https:\/\/www.nih.gov\/news-events\/news-releases\/healthcare-costs-poor-nutrition Accessed: 2023-10-01."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tifs.2019.10.004"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.aiia.2022.09.004"},{"key":"e_1_2_1_50_1","volume-title":"Consumer demand for fruit and vegetables: the US example. Changing structure of global food consumption and trade 6","author":"Pollack Susan L","year":"2001","unstructured":"Susan L Pollack. 2001. Consumer demand for fruit and vegetables: the US example. Changing structure of global food consumption and trade 6 (2001), 49--54."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1515\/opag-2022-0183"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2019.2949528"},{"key":"e_1_2_1_53_1","volume-title":"Optical Diagnostics and Sensing XVI: Toward Point-of-Care Diagnostics","author":"Sasikumar Harish","unstructured":"Harish Sasikumar, Vishnu Prasad, Parama Pal, and Manoj M Varma. 2016. Diffractive interference optical analyzer (DiOPTER). In Optical Diagnostics and Sensing XVI: Toward Point-of-Care Diagnostics, Vol. 9715. SPIE, 18--21."},{"key":"e_1_2_1_54_1","unstructured":"SCiO. [n. d.]. SCiO Mini. https:\/\/shop.consumerphysics.com\/."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3570361.3613296"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2018.00139"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.snb.2019.127247"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.microc.2021.106088"},{"key":"e_1_2_1_59_1","volume-title":"Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research 15, 1","author":"Srivastava Nitish","year":"2014","unstructured":"Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research 15, 1 (2014), 1929--1958."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.snb.2013.10.024"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1021\/ed039p333"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bios.2014.08.027"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0925-5214(98)00030-1"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3678582"},{"key":"e_1_2_1_65_1","volume-title":"CIE 1931 color space. https:\/\/en.wikipedia.org\/wiki\/CIE_1931_color_space.","year":"2024","unstructured":"Wikipedia. 2024. CIE 1931 color space. https:\/\/en.wikipedia.org\/wiki\/CIE_1931_color_space."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2017.68"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-03335-4_18"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bios.2015.08.020"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.02397"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3098279.3098541"},{"key":"e_1_2_1_71_1","volume-title":"2018 International Conference on Artificial Intelligence and Data Processing (IDAP). IEEE, 1--5.","author":"Ahmet Fikret YILDIZ","year":"2018","unstructured":"Fikret YILDIZ, Ahmet Turan \u00d6ZDEM\u0130R, and Selman Ului\u015fik. 2018. Custom design fruit quality evaluation system with non-destructive testing (NDT) techniques. In 2018 International Conference on Artificial Intelligence and Data Processing (IDAP). IEEE, 1--5."},{"key":"e_1_2_1_72_1","doi-asserted-by":"crossref","unstructured":"Baohua Zhang Dejian Dai Jichao Huang Jun Zhou Qifa Gui and Fang Dai. 2018. Influence of physical and biological variability and solution methods in fruit and vegetable quality nondestructive inspection by using imaging and near-infrared spectroscopy techniques: A review. Critical reviews in food science and nutrition 58 12 (2018) 2099--2118.","DOI":"10.1080\/10408398.2017.1300789"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.rinp.2023.106868"},{"key":"e_1_2_1_74_1","unstructured":"Xin-xin Zhang Pao Li Mei Yu Li-wen Jiang Xia Liu and Yang Shan. 2022. Progress in non-destructive citrus quality detection using near-infrared spectroscopy. (2022)."},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW50498.2020.00219"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3749470","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T16:25:04Z","timestamp":1758817504000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3749470"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,3]]},"references-count":75,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,9,3]]}},"alternative-id":["10.1145\/3749470"],"URL":"https:\/\/doi.org\/10.1145\/3749470","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,3]]},"assertion":[{"value":"2025-09-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}