{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T07:42:32Z","timestamp":1780472552123,"version":"3.54.1"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,9,9]],"date-time":"2021-09-09T00:00:00Z","timestamp":1631145600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["NSF-CMMI-202669"],"award-info":[{"award-number":["NSF-CMMI-202669"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2021,9,9]]},"abstract":"<jats:p>90% of retail sales occur in physical stores. In these physical stores 40% of shoppers leave the store based on the wait time. Autonomous stores can remove customer waiting time by providing a receipt without the need for scanning the items. Prior approaches use computer vision only, combine computer vision with weight sensors, or combine computer vision with sensors and human product recognition. These approaches, in general, suffer from low accuracy, up to hour long delays for receipt generation, or do not scale to store level deployments due to computation requirements and real-world multiple shopper scenarios.<\/jats:p>\n          <jats:p>We present ISACS, which combines a physical store model (e.g. customers, shelves, and item interactions), multi-human 3D pose estimation, and live inventory monitoring to provide an accurate matching of multiple people to multiple products. ISACS utilizes only shelf weight sensors and does not require visual inventory monitoring which drastically reduces the computational requirements and thus is scalable to a store-level deployment. In addition, ISACS generates an instant receipt by not requiring human intervention during receipt generation. To fully evaluate the ISACS, we deployed and evaluated our approach in an operating convenience store covering 800 square feet with 1653 distinct products, and more than 20,000 items. Over the course of 13 months of operation, ISACS achieved a receipt daily accuracy of up to 96.4%. Which translates to a 3.5x reduction in error compared to self-checkout stations.<\/jats:p>","DOI":"10.1145\/3478086","type":"journal-article","created":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T22:48:23Z","timestamp":1631659703000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["ISACS"],"prefix":"10.1145","volume":"5","author":[{"given":"Jo\u00e3o Diogo","family":"Falc\u00e3o","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Moffett Field, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carlos","family":"Ruiz","sequence":"additional","affiliation":[{"name":"AiFi Inc. Santa Clara, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adeola","family":"Bannis","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Moffett Field, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hae Young","family":"Noh","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pei","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, Michigan, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,9,14]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Amazon. 2019. Amazon.com: Amazon Go. https:\/\/www.amazon.com\/b?node=16008589011 Accessed: 2019-04-10.  Amazon. 2019. Amazon.com: Amazon Go. https:\/\/www.amazon.com\/b?node=16008589011 Accessed: 2019-04-10."},{"key":"e_1_2_2_2_1","unstructured":"ECR An. 2018. Self-checkout in Retail: Measuring the Loss. (2018).  ECR An. 2018. Self-checkout in Retail: Measuring the Loss. (2018)."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.3390\/electronics7120421"},{"key":"e_1_2_2_4_1","volume-title":"OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. arXiv preprint arXiv:1812.08008","author":"Cao Zhe","year":"2018","unstructured":"Zhe Cao , Gines Hidalgo , Tomas Simon , Shih-En Wei , and Yaser Sheikh . 2018. OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. arXiv preprint arXiv:1812.08008 ( 2018 ). Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2018. OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. arXiv preprint arXiv:1812.08008 (2018)."},{"key":"e_1_2_2_5_1","volume-title":"International Conference on Intelligent Autonomous Systems. Springer, 534--545","author":"Carraro Marco","year":"2018","unstructured":"Marco Carraro , Matteo Munaro , Jeff Burke , and Emanuele Menegatti . 2018 . Real-time marker-less multi-person 3D pose estimation in RGB-Depth camera networks . In International Conference on Intelligent Autonomous Systems. Springer, 534--545 . Marco Carraro, Matteo Munaro, Jeff Burke, and Emanuele Menegatti. 2018. Real-time marker-less multi-person 3D pose estimation in RGB-Depth camera networks. In International Conference on Intelligent Autonomous Systems. Springer, 534--545."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00334"},{"key":"e_1_2_2_7_1","unstructured":"McKinsey & Company. 2020. Redefining value and affordability in retail's next normal. https:\/\/www.mckinsey.com\/industries\/retail\/our-insights\/redefining-value-and-affordability-in-retails-next-normal Accessed: 2021-05-15.  McKinsey & Company. 2020. Redefining value and affordability in retail's next normal. https:\/\/www.mckinsey.com\/industries\/retail\/our-insights\/redefining-value-and-affordability-in-retails-next-normal Accessed: 2021-05-15."},{"key":"e_1_2_2_8_1","first-page":"109","article-title":"Consumer Response to Promotional Deals","volume":"42","author":"Cotton B. C.","year":"1978","unstructured":"B. C. Cotton and Emerson M. Babb . 1978 . Consumer Response to Promotional Deals . Journal of Marketing 42 , 3 (1978), 109 -- 113 . http:\/\/www.jstor.org\/stable\/1250544 B. C. Cotton and Emerson M. Babb. 1978. Consumer Response to Promotional Deals. Journal of Marketing 42, 3 (1978), 109--113. http:\/\/www.jstor.org\/stable\/1250544","journal-title":"Journal of Marketing"},{"key":"e_1_2_2_9_1","unstructured":"Statista Research Department. 2020. Retail e-commerce sales worldwide from 2014 to 2023(in billion U.S. dollars). https:\/\/www.statista.com\/statistics\/379046\/worldwide-retail-e-commerce-sales\/ Accessed: 2020-11-15.  Statista Research Department. 2020. Retail e-commerce sales worldwide from 2014 to 2023(in billion U.S. dollars). https:\/\/www.statista.com\/statistics\/379046\/worldwide-retail-e-commerce-sales\/ Accessed: 2020-11-15."},{"key":"e_1_2_2_10_1","unstructured":"Statista Research Department. 2020. Total retail sales worldwide from 2018 to 2022(in trillion U.S. dollars). https:\/\/www.statista.com\/statistics\/443522\/global-retail-sales\/ Accessed: 2020-11-15.  Statista Research Department. 2020. Total retail sales worldwide from 2018 to 2022(in trillion U.S. dollars). https:\/\/www.statista.com\/statistics\/443522\/global-retail-sales\/ Accessed: 2020-11-15."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00798"},{"key":"e_1_2_2_12_1","unstructured":"Meiling Du. 2018. Examining the User Experience of Amazon Go Shopping Just Walk Out. https:\/\/blog.prototypr.io\/examining-the-user-experience-of-amazon-go-shopping-just-walk-out-bfeda3c9ce39 Accessed: 2019-11-15.  Meiling Du. 2018. Examining the User Experience of Amazon Go Shopping Just Walk Out. https:\/\/blog.prototypr.io\/examining-the-user-experience-of-amazon-go-shopping-just-walk-out-bfeda3c9ce39 Accessed: 2019-11-15."},{"key":"e_1_2_2_13_1","volume-title":"CenterNet: Keypoint Triplets for Object Detection. In The IEEE International Conference on Computer Vision (ICCV).","author":"Duan Kaiwen","year":"2019","unstructured":"Kaiwen Duan , Song Bai , Lingxi Xie , Honggang Qi , Qingming Huang , and Qi Tian . 2019 . CenterNet: Keypoint Triplets for Object Detection. In The IEEE International Conference on Computer Vision (ICCV). Kaiwen Duan, Song Bai, Lingxi Xie, Honggang Qi, Qingming Huang, and Qi Tian. 2019. CenterNet: Keypoint Triplets for Object Detection. In The IEEE International Conference on Computer Vision (ICCV)."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.3389\/fbuil.2020.568372"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/SITIS.2018.00013"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11628-016-0302-9"},{"key":"e_1_2_2_17_1","unstructured":"Forrester. 2018. Consumers Cringe At Slow Checkout. https:\/\/www.digimarc.com\/docs\/default-source\/digimarc-resources\/forrester-study.pdf Accessed: 2019-11-15.  Forrester. 2018. Consumers Cringe At Slow Checkout. https:\/\/www.digimarc.com\/docs\/default-source\/digimarc-resources\/forrester-study.pdf Accessed: 2019-11-15."},{"key":"e_1_2_2_18_1","volume-title":"Optical Character Recognition for Autonomous Stores. In 2020 IEEE 10th International Conference on Intelligent Systems (IS). IEEE, 69--75","author":"Georgieva Petia","year":"2020","unstructured":"Petia Georgieva and Pei Zhang . 2020 . Optical Character Recognition for Autonomous Stores. In 2020 IEEE 10th International Conference on Intelligent Systems (IS). IEEE, 69--75 . Petia Georgieva and Pei Zhang. 2020. Optical Character Recognition for Autonomous Stores. In 2020 IEEE 10th International Conference on Intelligent Systems (IS). IEEE, 69--75."},{"key":"e_1_2_2_19_1","doi-asserted-by":"crossref","unstructured":"Grabango. 2016. Eliminate Lines and Save People Time. https:\/\/grabango.com\/ Accessed: 2019-04-10.  Grabango. 2016. Eliminate Lines and Save People Time. https:\/\/grabango.com\/ Accessed: 2019-04-10.","DOI":"10.12968\/cypn.2016.23.10"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.322"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2015.7354005"},{"key":"e_1_2_2_22_1","unstructured":"Mahdi Hussain. 2019. Convenience Store Loss Prevention - The Complete Guide. https:\/\/petrooutlet.com\/blog\/posts\/convenience-store-loss-prevention-guide\/ Accessed: 2019-11-15.  Mahdi Hussain. 2019. Convenience Store Loss Prevention - The Complete Guide. https:\/\/petrooutlet.com\/blog\/posts\/convenience-store-loss-prevention-guide\/ Accessed: 2019-11-15."},{"key":"e_1_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Hanbyul Joo Tomas Simon Xulong Li Hao Liu Lei Tan Lin Gui Sean Banerjee Timothy Godisart Bart Nabbe Iain Matthews etal 2017. Panoptic studio: A massively multiview system for social interaction capture. IEEE transactions on pattern analysis and machine intelligence 41 1 (2017) 190--204.  Hanbyul Joo Tomas Simon Xulong Li Hao Liu Lei Tan Lin Gui Sean Banerjee Timothy Godisart Bart Nabbe Iain Matthews et al. 2017. Panoptic studio: A massively multiview system for social interaction capture. IEEE transactions on pattern analysis and machine intelligence 41 1 (2017) 190--204.","DOI":"10.1109\/TPAMI.2017.2782743"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2011.5980287"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2020.3002345"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/15332969.2019.1592861"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01231-1_42"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CAMAD.2018.8514988"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364911436018"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10463"},{"key":"e_1_2_2_31_1","volume-title":"Grab: Fast and Accurate Sensor Processing for Cashier-Free Shopping. arXiv preprint arXiv:2001.01033","author":"Liu Xiaochen","year":"2020","unstructured":"Xiaochen Liu , Yurong Jiang , Kyu-Han Kim , and Ramesh Govindan . 2020 . Grab: Fast and Accurate Sensor Processing for Cashier-Free Shopping. arXiv preprint arXiv:2001.01033 (2020). Xiaochen Liu, Yurong Jiang, Kyu-Han Kim, and Ramesh Govindan. 2020. Grab: Fast and Accurate Sensor Processing for Cashier-Free Shopping. arXiv preprint arXiv:2001.01033 (2020)."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1061\/(ASCE)EM.1943-7889.0001719"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ymssp.2018.04.026"},{"key":"e_1_2_2_34_1","unstructured":"Bryan (Forbes) Pearson. 2017. How Retailers Can Maximize The Power of Coupons. https:\/\/www.forbes.com\/sites\/bryanpearson\/2017\/03\/15\/research-reveals-how-retailers-can-maximize-the-power-of-coupons\/?sh=4873e6532f01 Accessed: 2019-11-15.  Bryan (Forbes) Pearson. 2017. How Retailers Can Maximize The Power of Coupons. https:\/\/www.forbes.com\/sites\/bryanpearson\/2017\/03\/15\/research-reveals-how-retailers-can-maximize-the-power-of-coupons\/?sh=4873e6532f01 Accessed: 2019-11-15."},{"key":"e_1_2_2_35_1","unstructured":"Recode. 2019. Amazon's store of the future has no cashiers but humans are watching from behind the scenes. https:\/\/www.recode.net\/2017\/1\/6\/14189880\/amazon-go-convenience-store-computer-vision-humans Accessed: 2019-04-10.  Recode. 2019. Amazon's store of the future has no cashiers but humans are watching from behind the scenes. https:\/\/www.recode.net\/2017\/1\/6\/14189880\/amazon-go-convenience-store-computer-vision-humans Accessed: 2019-04-10."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpe.2006.08.024"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2006.88"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3360322.3361018"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3360322.3361018"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341162.3345604"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/IoTDI49375.2020.00012"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2019.03.005"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2007.4408987"},{"key":"e_1_2_2_44_1","volume-title":"The excitement of getting a bargain: some hypotheses concerning the origins and effects of smart-shopper feelings. ACR North American Advances","author":"Schindler Robert M","year":"1989","unstructured":"Robert M Schindler . 1989. The excitement of getting a bargain: some hypotheses concerning the origins and effects of smart-shopper feelings. ACR North American Advances ( 1989 ). Robert M Schindler. 1989. The excitement of getting a bargain: some hypotheses concerning the origins and effects of smart-shopper feelings. ACR North American Advances (1989)."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICME.2018.8486576"},{"key":"e_1_2_2_46_1","unstructured":"TechCrunch. 2019. Inside Amazon's surveillance-powered no-checkout convenience store. https:\/\/techcrunch.com\/2018\/01\/21\/inside-amazons-surveillance-powered-no-checkout-convenience-store\/ Accessed: 2019-04-10.  TechCrunch. 2019. Inside Amazon's surveillance-powered no-checkout convenience store. https:\/\/techcrunch.com\/2018\/01\/21\/inside-amazons-surveillance-powered-no-checkout-convenience-store\/ Accessed: 2019-04-10."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/AIPR.2018.8707375"},{"key":"e_1_2_2_48_1","unstructured":"Malvina Vega. 2020. 15+ Retail Statistics 2020 and The Future of Shopping. https:\/\/review42.com\/retail-statistics\/ Accessed: 2019-11-15.  Malvina Vega. 2020. 15+ Retail Statistics 2020 and The Future of Shopping. https:\/\/review42.com\/retail-statistics\/ Accessed: 2019-11-15."},{"key":"e_1_2_2_49_1","volume-title":"Klaus Ludwig Fuchs, and Alexander Ilic","author":"Vuckovac Denis","year":"2017","unstructured":"Denis Vuckovac , Pascal Fritzen , Klaus Ludwig Fuchs, and Alexander Ilic . 2017 . From Shopping aids to fully autonomous mobile self-checkouts-a field study in retail. (2017). Denis Vuckovac, Pascal Fritzen, Klaus Ludwig Fuchs, and Alexander Ilic. 2017. From Shopping aids to fully autonomous mobile self-checkouts-a field study in retail. (2017)."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.09.075"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-020-05148-3"},{"key":"e_1_2_2_52_1","unstructured":"Cale G. Weissman. 2019. Why discount stores are one of the fastest growing retail sectors. https:\/\/www.modernretail.co\/retailers\/why-discount-stores-are-one-of-the-fastest-growing-retail-sectors\/ Accessed: 2021-05-15.  Cale G. Weissman. 2019. Why discount stores are one of the fastest growing retail sectors. https:\/\/www.modernretail.co\/retailers\/why-discount-stores-are-one-of-the-fastest-growing-retail-sectors\/ Accessed: 2021-05-15."},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIT.2016.7474733"},{"key":"e_1_2_2_54_1","unstructured":"Zippin. 2020. Zippin. Checkout-free technology. https:\/\/www.getzippin.com\/ Accessed: 2019-04-10.  Zippin. 2020. Zippin. Checkout-free technology. https:\/\/www.getzippin.com\/ Accessed: 2019-04-10."}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478086","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478086","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478086","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:32Z","timestamp":1750188692000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478086"}},"subtitle":["In-Store Autonomous Checkout System for Retail"],"short-title":[],"issued":{"date-parts":[[2021,9,9]]},"references-count":54,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,9,9]]}},"alternative-id":["10.1145\/3478086"],"URL":"https:\/\/doi.org\/10.1145\/3478086","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,9]]},"assertion":[{"value":"2021-09-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}