{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T20:59:29Z","timestamp":1776113969404,"version":"3.50.1"},"reference-count":92,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T00:00:00Z","timestamp":1695772800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2023,9,27]]},"abstract":"<jats:p>Designing an extensive set of mid-air gestures that are both easy to learn and perform quickly presents a significant challenge. Further complicating this challenge is achieving high-accuracy detection of such gestures using commonly available hardware, like a 2D commodity camera. Previous work often proposed smaller, application-specific gesture sets, requiring specialized hardware and struggling with adaptability across diverse environments. Addressing these limitations, this paper introduces Abacus Gestures, a comprehensive collection of 100 mid-air gestures. Drawing on the metaphor of Finger Abacus counting, gestures are formed from various combinations of open and closed fingers, each assigned different values. We developed an algorithm using an off-the-shelf computer vision library capable of detecting these gestures from a 2D commodity camera feed with an accuracy exceeding 98% for palms facing the camera and 95% for palms facing the body. We assessed the detection accuracy, ease of learning, and usability of these gestures in a user study involving 20 participants. The study found that participants could learn Abacus Gestures within five minutes after executing just 15 gestures and could recall them after a four-month interval. Additionally, most participants developed motor memory for these gestures after performing 100 gestures. Most of the gestures were easy to execute with the designated finger combinations, and the flexibility in executing the gestures using multiple finger combinations further enhanced the usability. Based on these findings, we created a taxonomy that categorizes Abacus Gestures into five groups based on motor memory development and three difficulty levels according to their ease of execution. Finally, we provided design guidelines and proposed potential use cases for Abacus Gestures in the realm of mid-air interaction.<\/jats:p>","DOI":"10.1145\/3610898","type":"journal-article","created":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T15:45:03Z","timestamp":1695829503000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Abacus Gestures"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8803-2100","authenticated-orcid":false,"given":"Md","family":"Ehtesham-Ul-Haque","sequence":"first","affiliation":[{"name":"Pennsylvania State University, University Park, Pennsylvania, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5063-3808","authenticated-orcid":false,"given":"Syed Masum","family":"Billah","sequence":"additional","affiliation":[{"name":"Pennsylvania State University, University Park, Pennsylvania, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,9,27]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"2017. An incredible way to do maths: finger calculations the Indian way. https:\/\/www.news24.com\/parent\/learn\/back-to-school\/maths-finger-calculations-the-indian-way-20170227"},{"key":"e_1_2_2_2_1","unstructured":"2019. Learning Mental Maths with The Abacus Finger Theory. https:\/\/supermaths.co.uk\/making-maths-fun-with-the-abacus-finger-theory\/"},{"key":"e_1_2_2_3_1","unstructured":"2022. Finger Abacus: Learn the Technique to Calculate Faster. https:\/\/enthu.com\/blog\/abacus\/finger-abacus\/"},{"key":"e_1_2_2_4_1","unstructured":"2022. How to use Palm Gesture to take selfie on Samsung mobile?. https:\/\/www.samsung.com\/sg\/support\/mobile-devices\/how-to-use-palm-gesture-to-take-selfie-on-samsung-mobile-device\/"},{"key":"e_1_2_2_5_1","unstructured":"2022. Kinect for Windows. https:\/\/learn.microsoft.com\/en-us\/windows\/apps\/design\/devices\/kinect-for-windows"},{"key":"e_1_2_2_6_1","unstructured":"2022. Leap Motion Controller. https:\/\/www.ultraleap.com\/product\/leap-motion-controller\/"},{"key":"e_1_2_2_7_1","unstructured":"Roland Aigner Daniel Wigdor Hrvoje Benko Michael Haller David Lindbauer Alexandra Ion Shengdong Zhao and JTKV Koh. 2012. Understanding mid-air hand gestures: A study of human preferences in usage of gesture types for hci. Microsoft Research TechReport MSR-TR-2012-111 2 (2012) 30."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X08005578"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858385"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753414"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2012.05.006"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208576"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/2042118.2042143"},{"key":"e_1_2_2_14_1","volume-title":"Thinking aloud: Reconciling theory and practice","author":"Boren Ted","year":"2000","unstructured":"Ted Boren and Judith Ramey. 2000. Thinking aloud: Reconciling theory and practice. IEEE transactions on professional communication 43, 3 (2000), 261--278."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3064663.3064766"},{"key":"e_1_2_2_16_1","volume-title":"A history of mathematics","author":"Boyer Carl B","unstructured":"Carl B Boyer and Uta C Merzbach. 2011. A history of mathematics. John Wiley & Sons."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2805823"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3286978.3287005"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502016"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.nima.2006.08.101"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502035"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2017.1342943"},{"key":"e_1_2_2_23_1","volume-title":"A feel for numbers: The changing role of gesture in manipulating the mental representation of an abacus among children at different skill levels. Frontiers in psychology 9","author":"Cho Philip S","year":"2018","unstructured":"Philip S Cho and Wing Chee So. 2018. A feel for numbers: The changing role of gesture in manipulating the mental representation of an abacus among children at different skill levels. Frontiers in psychology 9 (2018), 1267."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2011.00242"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/169891.169968"},{"key":"e_1_2_2_26_1","volume-title":"Number: The language of science","author":"Dantzig Tobias","year":"2007","unstructured":"Tobias Dantzig and Joseph Mazur. 2007. Number: The language of science. Penguin."},{"key":"e_1_2_2_27_1","unstructured":"Stanislas Dehaene. 2011. The number sense: How the mind creates mathematics. OUP USA."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2325616.2325623"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2015.2432679"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979010"},{"key":"e_1_2_2_31_1","volume-title":"The child's understanding of number","author":"Gelman Rochel","unstructured":"Rochel Gelman and Charles R Gallistel. 1986. The child's understanding of number. Harvard University Press."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047255"},{"key":"e_1_2_2_33_1","volume-title":"Advances in psychology.","author":"Hart Sandra G","unstructured":"Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139--183."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1899475.1899491"},{"key":"e_1_2_2_35_1","volume-title":"On the rate of gain of information. Quarterly Journal of experimental psychology 4, 1","author":"Hick William E","year":"1952","unstructured":"William E Hick. 1952. On the rate of gain of information. Quarterly Journal of experimental psychology 4, 1 (1952), 11--26."},{"key":"e_1_2_2_36_1","volume-title":"Enhanced white matter tracts integrity in children with abacus training. Human brain mapping 32, 1","author":"Hu Yuzheng","year":"2011","unstructured":"Yuzheng Hu, Fengji Geng, Lixia Tao, Nantu Hu, Fenglei Du, Kuang Fu, and Feiyan Chen. 2011. Enhanced white matter tracts integrity in children with abacus training. Human brain mapping 32, 1 (2011), 10--21."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-59144-5_7"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380139"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2019.1572352"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557122"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1152\/jn.00480.2004"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2009.5373803"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/CNE.2003.1196886"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR.2011.5759479"},{"key":"e_1_2_2_45_1","volume-title":"The complete book of fingermath","author":"Lieberthal Edwin M","unstructured":"Edwin M Lieberthal. 1979. The complete book of fingermath. McGraw-Hill."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807489"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10055-011-0195-9"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11548-016-1375-6"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1177\/0145482X8307700505"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331148"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-40483-2_28"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2556964"},{"key":"e_1_2_2_53_1","unstructured":"James Michael McDougal. 1979. The effect of Chisanbop mathematics calculation on the achievement of fourth grade students. Ph. D. Dissertation. Citeseer."},{"key":"e_1_2_2_54_1","volume-title":"ACM SIGGRAPH ASIA 2009 Art Gallery & Emerging Technologies: Adaptation. 85--85","author":"Mistry Pranav","year":"2009","unstructured":"Pranav Mistry and Pattie Maes. 2009. SixthSense: a wearable gestural interface. In ACM SIGGRAPH ASIA 2009 Art Gallery & Emerging Technologies: Adaptation. 85--85."},{"key":"e_1_2_2_55_1","volume-title":"Effects of finger counting on numerical development--the opposing views of neurocognition and mathematics education. Frontiers in psychology 2","author":"Moeller Korbinian","year":"2011","unstructured":"Korbinian Moeller, Laura Martignon, Silvia Wessolowski, Joachim Engel, and Hans-Christoph Nuerk. 2011. Effects of finger counting on numerical development--the opposing views of neurocognition and mathematics education. Frontiers in psychology 2 (2011), 328."},{"key":"e_1_2_2_56_1","volume-title":"Reducing legacy bias in gesture elicitation studies. interactions 21, 3","author":"Morris Meredith Ringel","year":"2014","unstructured":"Meredith Ringel Morris, Andreea Danielescu, Steven Drucker, Danyel Fisher, Bongshin Lee, MC Schraefel, and Jacob O Wobbrock. 2014. Reducing legacy bias in gesture elicitation studies. interactions 21, 3 (2014), 40--45."},{"key":"e_1_2_2_57_1","volume-title":"Proceedings of graphics interface","author":"Morris Meredith Ringel","year":"2010","unstructured":"Meredith Ringel Morris, Jacob O Wobbrock, and Andrew D Wilson. 2010. Understanding users' preferences for surface gestures. In Proceedings of graphics interface 2010. 261--268."},{"key":"e_1_2_2_58_1","volume-title":"Speech, Olfactory, and Other Nontraditional Interfaces","author":"Nielsen Michael","year":"2008","unstructured":"Michael Nielsen, Thomas B Moeslund, Moritz St\u00f6rring, and Erik Granum. 2008. Gesture interfaces. HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces, Elsevier (2008)."},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2994310.2994348"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2006.297830"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753458"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132272.3134118"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2014.6945140"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557113"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979341"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1978971"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047235"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3064663.3064695"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2015.02.010"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208585"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.5964\/jnc.v4i1.85"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0168636"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2465958.2465972"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-017-0247-x"},{"key":"e_1_2_2_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/2602299.2602316"},{"key":"e_1_2_2_76_1","volume-title":"Repeated measures design for empirical researchers","author":"Verma JP","unstructured":"JP Verma. 2015. Repeated measures design for empirical researchers. John Wiley & Sons."},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/2788940.2788950"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557151"},{"key":"e_1_2_2_79_1","volume-title":"The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index.php?title=Mental_abacus&oldid=1043409368 [Online","author":"Wikipedia","year":"2022","unstructured":"Wikipedia contributors. 2021. Mental abacus --- Wikipedia, The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index.php?title=Mental_abacus&oldid=1043409368 [Online; accessed 15-September-2022]."},{"key":"e_1_2_2_80_1","volume-title":"The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index.php?title=Abacus& oldid=1108064048 [Online","author":"Wikipedia Wikipedia","year":"2022","unstructured":"Wikipedia contributors. 2022. Abacus --- Wikipedia, The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index.php?title=Abacus& oldid=1108064048 [Online; accessed 15-September-2022]."},{"key":"e_1_2_2_81_1","volume-title":"The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index.php?title=Chisanbop& oldid=1096817061 [Online","author":"Wikipedia Wikipedia","year":"2022","unstructured":"Wikipedia contributors. 2022. Chisanbop --- Wikipedia, The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index.php?title=Chisanbop& oldid=1096817061 [Online; accessed 15-September-2022]."},{"key":"e_1_2_2_82_1","volume-title":"The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index.php?title=English_Braille&oldid=1122582380 [Online","author":"Wikipedia","year":"2022","unstructured":"Wikipedia contributors. 2022. English Braille --- Wikipedia, The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index.php?title=English_Braille&oldid=1122582380 [Online; accessed 16-December-2022]."},{"key":"e_1_2_2_83_1","volume-title":"The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index.php?title= Mental_calculation&oldid=1125009549 [Online","author":"Wikipedia","year":"2022","unstructured":"Wikipedia contributors. 2022. Mental calculation --- Wikipedia, The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index.php?title= Mental_calculation&oldid=1125009549 [Online; accessed 5-December-2022]."},{"key":"e_1_2_2_84_1","volume-title":"The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index. php?title=Mental_Calculation_World_Cup&oldid=1101504387 [Online","author":"Wikipedia","year":"2022","unstructured":"Wikipedia contributors. 2022. Mental Calculation World Cup --- Wikipedia, The Free Encyclopedia. https:\/\/en.wikipedia.org\/w\/index. php?title=Mental_Calculation_World_Cup&oldid=1101504387 [Online; accessed 5-December-2022]."},{"key":"e_1_2_2_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518866"},{"key":"e_1_2_2_86_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-014-2323-5"},{"key":"e_1_2_2_87_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00259-008-0949-0"},{"key":"e_1_2_2_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376306"},{"key":"e_1_2_2_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/3332165.3347865"},{"key":"e_1_2_2_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397869"},{"key":"e_1_2_2_91_1","volume-title":"Mediapipe hands: On-device real-time hand tracking. arXiv preprint arXiv:2006.10214","author":"Zhang Fan","year":"2020","unstructured":"Fan Zhang, Valentin Bazarevsky, Andrey Vakunov, Andrei Tkachenka, George Sung, Chuo-Ling Chang, and Matthias Grundmann. 2020. Mediapipe hands: On-device real-time hand tracking. arXiv preprint arXiv:2006.10214 (2020)."},{"key":"e_1_2_2_92_1","doi-asserted-by":"publisher","DOI":"10.1145\/3490099.3511103"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610898","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610898","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T16:31:07Z","timestamp":1753720267000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610898"}},"subtitle":["A Large Set of Math-Based Usable Finger-Counting Gestures for Mid-Air Interactions"],"short-title":[],"issued":{"date-parts":[[2023,9,27]]},"references-count":92,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,9,27]]}},"alternative-id":["10.1145\/3610898"],"URL":"https:\/\/doi.org\/10.1145\/3610898","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,27]]},"assertion":[{"value":"2023-09-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}