{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T14:11:06Z","timestamp":1777558266148,"version":"3.51.4"},"reference-count":45,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2021,5,20]],"date-time":"2021-05-20T00:00:00Z","timestamp":1621468800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The traditional weighing and selling process of non-barcode items requires manual service, which not only consumes manpower and material resources but is also more prone to errors or omissions of data. This paper proposes an intelligent self-service vending system embedded with a single camera to detect multiple products in real-time performance without any labels, and the system realizes the integration of weighing, identification, and online settlement in the process of non-barcode items. The system includes a self-service vending device and a multi-device data management platform. The flexible configuration of the structure gives the system the possibility of identifying fruits from multiple angles. The height of the system can be adjusted to provide self-service for people of different heights; then, deep learning skill is applied implementing product detection, and real-time multi-object detection technology is utilized in the image-based checkout system. In addition, on the multi-device data management platform, the information docking between embedded devices, WeChat applets, Alipay, and the database platform can be implemented. We conducted experiments to verify the accuracy of the measurement. The experimental results demonstrate that the correlation coefficient R2 between the measured value of the weight and the actual value is 0.99, and the accuracy of non-barcode item prediction is 93.73%. In Yangpu District, Shanghai, a comprehensive application scenario experiment was also conducted, proving that our system can effectively deal with the challenges of various sales situations.<\/jats:p>","DOI":"10.3390\/s21103560","type":"journal-article","created":{"date-parts":[[2021,5,20]],"date-time":"2021-05-20T11:45:57Z","timestamp":1621511157000},"page":"3560","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["An Intelligent Self-Service Vending System for Smart Retail"],"prefix":"10.3390","volume":"21","author":[{"given":"Kun","family":"Xia","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9231-4207","authenticated-orcid":false,"given":"Hongliang","family":"Fan","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianguang","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hanyu","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junxue","family":"Ren","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qin","family":"Jian","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dafang","family":"Wei","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.techfore.2016.09.032","article-title":"Enabling smart retail settings via mobile augmented reality shopping apps","volume":"124","author":"Dacko","year":"2017","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_2","unstructured":"(2017, January 23). Amazon, Go. Available online: https:\/\/www.amazon.com."},{"key":"ref_3","unstructured":"(2017, July 03). Early Amazon Step! Alibaba Announced that no One Retail Store is Coming. Available online: https:\/\/tw.news.yahoo.com."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1049\/iet-its.2019.0380","article-title":"Mobilenet\u2013SSD Microscope using adaptive error correction algorithm: Real\u2013time detection of license plates on mobile devices","volume":"14","author":"Xun","year":"2020","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_5","unstructured":"(2018, October 16). chuanqi305\/MobileNet\u2013SSD. Available online: http:\/\/github.com\/chua\u2013nqi305\/MobileNet\u2013SSD."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., and Berg, A.C. (2016, January 17). SSD: Single Shot MultiBox Detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_7","unstructured":"(2014, January 17). With the Introduction of RAPTOR, ECRS Looks to Change How Groceries Are Purchased. Available online: http:\/\/goo.gl\/g8Bq1N."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1504\/IJISM.2007.011972","article-title":"Radio frequency identification: Past, present and future business applications","volume":"3","author":"Reyes","year":"2015","journal-title":"Int. J. Integr. Supply Manag."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wu, B.F., Tseng, W.J., Chen, Y.S., Yao, S.J., and Chang, P.J. (2016, January 7\u20139). An Intelligent Self\u2013Checkout System for Smart Retail. Proceedings of the International Conference on System Science and Engineering (ICSSE), Puli, Taiwan.","DOI":"10.1109\/ICSSE.2016.7551621"},{"key":"ref_10","unstructured":"Ravi, V., and Aparna, R. (2016, January 16\u201318). Security in RFID based Smart Retail System. Proceedings of the International Conference on Computing for Sustainable Global Development, New Delhi, India."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"6774","DOI":"10.1109\/JSEN.2016.2586101","article-title":"3s\u2013Cart: A lightweight, interactive sensor\u2013Based cart for smart shopping in supermarkets","volume":"16","author":"Wang","year":"2016","journal-title":"IEEE Sens. J."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Chandrasekar, P., and Sangeetha, T. (2014, January 27\u201328). Smart Shopping Cart with Automatic Billing System Through RFID and ZigBee. Proceedings of the International Conference on Information Communication and Embedded Systems, Chennai, India.","DOI":"10.1109\/ICICES.2014.7033996"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Chi, H.C., Sarwar, M.A., Daraghmi, Y.A., Liu, K.W., Ik, T.U., and Li, Y.L. (2020, January 22\u201325). Smart Self\u2013Checkout Carts Based on Deep Learning for Shopping Activity Recognition. Proceedings of the 21st Asia\u2013Pacific Network Operations and Management Symposium, Daegu, Korea (South).","DOI":"10.23919\/APNOMS50412.2020.9237053"},{"key":"ref_14","first-page":"76","article-title":"Use of balance calibration certificate to calculate the errors of indication and measurement uncertainty in mass determinations performed in medical laboratories","volume":"132","author":"Valcu","year":"2011","journal-title":"Sens. Transducers J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1109\/TMC.2013.28","article-title":"RF\u2013Sensing of activities from non\u2013cooperative subjects in device\u2013free recognition systems using ambient and local signals","volume":"13","author":"Sigg","year":"2014","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1109\/MSP.2015.2504328","article-title":"High\u2013accuracy localization for assisted living: 5G systems will turnmultipath channels from foe to friend","volume":"33","author":"Witrisal","year":"2016","journal-title":"IEEE Signal Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1109\/MIM.2014.6873732","article-title":"The smartphone\u2013enabled DMM","volume":"17","author":"Brateris","year":"2014","journal-title":"IEEE Instrum. Meas. Mag."},{"key":"ref_18","first-page":"352","article-title":"ZigBee\u2013based wireless electronic scale and its network performance analysis for the application of smart billing system in super markets","volume":"7","author":"Sivakumar","year":"2014","journal-title":"Indian J. Sci. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"Lecun","year":"2015","journal-title":"Nature"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1038\/nature21056","article-title":"Dermatologist\u2013Level classification of skin cancer with deep neural networks","volume":"542","author":"Esteva","year":"2017","journal-title":"Nature"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","article-title":"A survey on deep learning in medical image analysis","volume":"42","author":"Litjens","year":"2017","journal-title":"Med. Image Anal."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1678","DOI":"10.3390\/app8091678","article-title":"Research on a surface defect detection algorithm based on mobilenet\u2013SSD","volume":"8","author":"Li","year":"2018","journal-title":"Appl. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Kortli, Y., Jridi, M., Falou, A.A., and Atri, M. (2020). Face recognition systems: A survey. Sensors, 20.","DOI":"10.3390\/s20020342"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"118310","DOI":"10.1109\/ACCESS.2019.2936454","article-title":"A pedestrian detection method based on genetic algorithm for optimize xgboost training parameters","volume":"7","author":"Jiang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MSP.2012.2205597","article-title":"Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups","volume":"29","author":"Hinton","year":"2012","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"154683","DOI":"10.1109\/ACCESS.2019.2949343","article-title":"Automatic detection of single ripe tomato on plant combining faster r-cnn and intuitionistic fuzzy set","volume":"7","author":"Hu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Qiao, S., Shen, W., Qiu, W., Liu, C., and Yuille, A. (2017, January 22\u201329). ScaleNet: Guiding Object Proposal Generation in Supermarkets and Beyond. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.199"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Tonioni, A., Serra, E., and Stefano, L.D. (2018, January 12\u201314). A Deep Learning Pipeline for Product Recognition on Store Shelves. Proceedings of the 2018 IEEE International Conference on Image Processing, Applications and Systems (IPAS), Sophia Antipolis, France.","DOI":"10.1109\/IPAS.2018.8708890"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards realtime object detection with region proposal networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"4580","DOI":"10.1109\/TII.2019.2893122","article-title":"Fast analytical model predictive controllers and their implementation for STM32 ARM microcontroller","volume":"15","author":"Chaber","year":"2019","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1016\/j.snb.2012.12.044","article-title":"Analog wheatstone bridge\u2013Based automatic interface for grounded and floating wide\u2013range resistive sensors","volume":"187","author":"Marcellis","year":"2013","journal-title":"Sens. Actuators B Chem."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Ruiz, C., Falcao, J., and Zhang, P. (2019, January 9\u201313). Autotag: Visual Domain Adaptation for Autonomous Retail Stores Through Multi-Modal Sensing. Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers, London, UK.","DOI":"10.1145\/3341162.3345604"},{"key":"ref_35","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very deep convolutional networks for large-scale image recognition. Proceedings of the 3rd International Conference on Learning Representations, ICLR, San Diego, CA, USA."},{"key":"ref_36","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1109\/TMC.2011.243","article-title":"SSD: A robust rf location fingerprint addressing mobile devices\u2019 heterogeneity","volume":"12","author":"Hossain","year":"2013","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_38","unstructured":"(2019, December 30). TI Deep Learning API User\u2019s Guide. Available online: http:\/\/downloads.ti.com\/mctools\/esd\/docs\/tidl-api\/index.html."},{"key":"ref_39","unstructured":"(2019, August 07). Overview of Ti Deep Learning (tidl). Available online: https:\/\/edu.21ic.com\/video\/3411."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/j.isatra.2019.06.026","article-title":"An experimental setup of multi\u2013intelligent control system of water management using the internet of things (IoT)","volume":"96","author":"Hadipour","year":"2020","journal-title":"ISA Trans."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1109\/MIM.2020.9234764","article-title":"Wearable smart multimeter equipped with ar glasses based on IoT platform","volume":"23","author":"Xia","year":"2020","journal-title":"IEEE Instrum. Meas. Mag."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"50380","DOI":"10.1109\/ACCESS.2019.2902905","article-title":"Mobile payment with alipay: An application of extended technology acceptance model","volume":"7","author":"Li","year":"2019","journal-title":"IEEE Access"},{"key":"ref_43","unstructured":"(2021, March 24). Tencent Announces 2020 Fourth Quarter and Annual Results. Available online: https:\/\/www.tencent.com\/en-us\/media.html#media-con-2."},{"key":"ref_44","unstructured":"(2021, May 05). Facebook Inc CIK#: 0001326801 (See All Company Filings), Available online: https:\/\/www.sec.gov\/cgi-bin\/browse-edgar?CIK=FB&Find=Search&owner=exclude&action=getcompany."},{"key":"ref_45","unstructured":"(2012). OIML V 2\u2013200. Measurement Precision. International Vocabulary of Metrology\u2013Basic and General Concepts and Associated Terms (VIM), International Organization of Legal Metrology."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/10\/3560\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:04:38Z","timestamp":1760162678000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/10\/3560"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,20]]},"references-count":45,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["s21103560"],"URL":"https:\/\/doi.org\/10.3390\/s21103560","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,20]]}}}