{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,23]],"date-time":"2025-08-23T05:23:48Z","timestamp":1755926628901,"version":"3.41.0"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"ISS","license":[{"start":{"date-parts":[[2021,11,3]],"date-time":"2021-11-03T00:00:00Z","timestamp":1635897600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSERC Discovery Grant","award":["2018-05187"],"award-info":[{"award-number":["2018-05187"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,11,3]]},"abstract":"<jats:p>We propose a style of hand postures to trigger commands on a laptop. The key idea is to perform hand-postures while keeping the hands on, beside, or below the keyboard, to align with natural laptop usage. 36 hand-posture variations are explored considering three resting locations, left or right hand, open or closed hand, and three wrist rotation angles. A 30-participant formative study measures posture preferences and generates a dataset of nearly 350K images under different lighting conditions and backgrounds. A deep learning recognizer achieves over 97% accuracy when classifying all 36 postures with 2 additional non-posture classes for typing and non-typing. A second experiment with 20 participants validates the recognizer under real-time usage and compares posture invocation time with keyboard shortcuts. Results find low error rates and fast formation time, indicating postures are close to current typing and pointing postures. Finally, practical use case demonstrations are presented, and further extensions discussed.<\/jats:p>","DOI":"10.1145\/3486952","type":"journal-article","created":{"date-parts":[[2021,11,5]],"date-time":"2021-11-05T22:15:49Z","timestamp":1636150549000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Typealike"],"prefix":"10.1145","volume":"5","author":[{"given":"Nalin","family":"Chhibber","sequence":"first","affiliation":[{"name":"University of Waterloo, Waterloo, ON, Canada"}]},{"given":"Hemant Bhaskar","family":"Surale","sequence":"additional","affiliation":[{"name":"University of Waterloo, Waterloo, ON, Canada"}]},{"given":"Fabrice","family":"Matulic","sequence":"additional","affiliation":[{"name":"Preferred Networks Inc., Tokyo, Japan"}]},{"given":"Daniel","family":"Vogel","sequence":"additional","affiliation":[{"name":"University of Waterloo, Waterloo, ON, Canada"}]}],"member":"320","published-online":{"date-parts":[[2021,11,5]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1519052"},{"key":"e_1_2_2_2_1","volume-title":"Proceedings of the Fourth International Symposium on Chinese CHI. 1--10","author":"Kin-Chung Au Oscar","year":"2016","unstructured":"Oscar Kin-Chung Au , Kira Yip-Wo Yeung , and Jacky Kit Cheung . 2016 . DownChord and UpChord: A New Style of Keyboard Shortcuts Based on Simultaneous Key-down and Key-up Events . In Proceedings of the Fourth International Symposium on Chinese CHI. 1--10 . Oscar Kin-Chung Au, Kira Yip-Wo Yeung, and Jacky Kit Cheung. 2016. DownChord and UpChord: A New Style of Keyboard Shortcuts Based on Simultaneous Key-down and Key-up Events. In Proceedings of the Fourth International Symposium on Chinese CHI. 1--10."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470734"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.226"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.3115\/1219044.1219075"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753498"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173595"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2350046.2350073"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300395"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1622176.1622187"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1182475.1182538"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.3390\/info11020108"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1622176.1622202"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858452"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327590ijhc1802_1"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470680"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1055036"},{"key":"e_1_2_2_20_1","volume-title":"INTERACT'03","author":"McLoone Hugh","year":"2003","unstructured":"Hugh McLoone , Ken Hinckley , and Edward Cutrell . 2003 . Bimanual interaction on the microsoft office keyboard . In INTERACT'03 . 49--56. Hugh McLoone, Ken Hinckley, and Edward Cutrell. 2003. Bimanual interaction on the microsoft office keyboard. In INTERACT'03. 49--56."},{"key":"e_1_2_2_21_1","volume-title":"Mouseless. In Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 441--442","author":"Mistry Pranav","year":"2010","unstructured":"Pranav Mistry and Patricia Maes . 2010 . Mouseless. In Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 441--442 . Pranav Mistry and Patricia Maes. 2010. Mouseless. In Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 441--442."},{"key":"e_1_2_2_22_1","volume-title":"in Proc. of Int'l Conf. on Automatic Face and Gesture Recognition. Citeseer.","author":"Mysliwiec Thomas A","year":"1994","unstructured":"Thomas A Mysliwiec . 1994 . Fingermouse: A freehand computer pointing interface . In in Proc. of Int'l Conf. on Automatic Face and Gesture Recognition. Citeseer. Thomas A Mysliwiec. 1994. Fingermouse: A freehand computer pointing interface. In in Proc. of Int'l Conf. on Automatic Face and Gesture Recognition. Citeseer."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-03658-3_28"},{"key":"e_1_2_2_24_1","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","author":"Pedregosa Fabian","year":"2011","unstructured":"Fabian Pedregosa , Ga\u00ebl Varoquaux , Alexandre Gramfort , Vincent Michel , Bertrand Thirion , Olivier Grisel , Mathieu Blondel , Peter Prettenhofer , RonWeiss, Vincent Dubourg , 2011 . Scikit-learn: Machine learning in Python . Journal of machine learning research 12 , Oct (2011), 2825 -- 2830 . Fabian Pedregosa, Ga\u00ebl Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, RonWeiss, Vincent Dubourg, et al. 2011. Scikit-learn: Machine learning in Python. Journal of machine learning research 12, Oct (2011), 2825--2830.","journal-title":"Journal of machine learning research 12"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2670444.2670447"},{"key":"e_1_2_2_26_1","unstructured":"P Pramod Kumar Prahlad Vadakkepat and Loh Ai Poh. 2017. The NUS hand posture datasets I. (2017).  P Pramod Kumar Prahlad Vadakkepat and Loh Ai Poh. 2017. The NUS hand posture datasets I. (2017)."},{"key":"e_1_2_2_27_1","unstructured":"P Pramod Kumar Prahlad Vadakkepat and Loh Ai Poh. 2017. The NUS hand posture datasets II. (2017).  P Pramod Kumar Prahlad Vadakkepat and Loh Ai Poh. 2017. The NUS hand posture datasets II. (2017)."},{"key":"e_1_2_2_28_1","volume-title":"Keyboard surface interaction: Making the keyboard into a pointing device. arXiv preprint arXiv:1601.04029","author":"Ramos Julian","year":"2016","unstructured":"Julian Ramos , Zhen Li , Johana Rosas , Nikola Banovic , Jennifer Mankoff , and Anind Dey . 2016. Keyboard surface interaction: Making the keyboard into a pointing device. arXiv preprint arXiv:1601.04029 ( 2016 ). Julian Ramos, Zhen Li, Johana Rosas, Nikola Banovic, Jennifer Mankoff, and Anind Dey. 2016. Keyboard surface interaction: Making the keyboard into a pointing device. arXiv preprint arXiv:1601.04029 (2016)."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/964696.964719"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174170"},{"key":"e_1_2_2_32_1","volume-title":"A disciplined approach to neural network hyper-parameters: Part 1--learning rate, batch size, momentum, and weight decay. arXiv preprint arXiv:1803.09820","author":"Smith Leslie N","year":"2018","unstructured":"Leslie N Smith . 2018. A disciplined approach to neural network hyper-parameters: Part 1--learning rate, batch size, momentum, and weight decay. arXiv preprint arXiv:1803.09820 ( 2018 ). Leslie N Smith. 2018. A disciplined approach to neural network hyper-parameters: Part 1--learning rate, batch size, momentum, and weight decay. arXiv preprint arXiv:1803.09820 (2018)."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300426"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557030"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702582"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1166253.1166292"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1294211.1294238"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2628363.2628383"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557362"},{"key":"e_1_2_2_40_1","doi-asserted-by":"crossref","unstructured":"Jingjie Zheng Blaine Lewis Jeff Avery and Daniel Vogel. 2018. FingerArc and FingerChord: Supporting Novice to Expert Transitions with Guided Finger-Aware Shortcuts. (2018).  Jingjie Zheng Blaine Lewis Jeff Avery and Daniel Vogel. 2018. FingerArc and FingerChord: Supporting Novice to Expert Transitions with Guided Finger-Aware Shortcuts. (2018).","DOI":"10.1145\/3242587.3242589"},{"key":"e_1_2_2_41_1","volume-title":"Finger-Aware Shortcuts. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 4274--4285","author":"Zheng Jingjie","year":"2016","unstructured":"Jingjie Zheng and Daniel Vogel . 2016 . Finger-Aware Shortcuts. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 4274--4285 . Jingjie Zheng and Daniel Vogel. 2016. Finger-Aware Shortcuts. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 4274--4285."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3486952","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3486952","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:47Z","timestamp":1750191527000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3486952"}},"subtitle":["Near-Keyboard Hand Postures for Expanded Laptop Interaction"],"short-title":[],"issued":{"date-parts":[[2021,11,3]]},"references-count":40,"journal-issue":{"issue":"ISS","published-print":{"date-parts":[[2021,11,3]]}},"alternative-id":["10.1145\/3486952"],"URL":"https:\/\/doi.org\/10.1145\/3486952","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2021,11,3]]},"assertion":[{"value":"2021-11-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}