{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T20:31:14Z","timestamp":1792787474651,"version":"4.5.0"},"reference-count":61,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T00:00:00Z","timestamp":1790726400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"funder":[{"name":"Deutsche Forschungsgemeinschaft","award":["425868555"],"award-info":[{"award-number":["425868555"]}],"id":[{"id":"https:\/\/ror.org\/018mejw64","id-type":"ROR","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2026,9,30]]},"abstract":"<jats:p>Mid-air gestures are increasingly used as a natural modality in interactive systems, ranging from smart home controls and automotive interfaces to augmented reality and public displays. Despite their growing adoption across diverse domains, we still lack a comprehensive understanding of what makes gestures effective, expressive, and robust across participants and application domains. We conducted a data collection study in which we captured a novel dataset of 18 widely used mid-air gestures, each performed by 42 participants. A total of 4,265 gesture samples were recorded using synchronized electromagnetic sensors and depth cameras. We analyzed gestures using kinematic and geometric measures, and quantified consistency in terms of hand shape and palm trajectory using Multidimensional Dynamic Time Warping. We further trained LSTM-based classifiers as recognition baselines and computed a deep-feature consistency measure from their learned embedding space. Results revealed that consistency and recognizability vary substantially across gesture types, and consistency scores were positively associated with recognition performance. These findings provide empirical guidance for the design and selection of mid-air gesture vocabularies in real-world interaction systems.<\/jats:p>","DOI":"10.1145\/3831634","type":"journal-article","created":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T16:31:59Z","timestamp":1790785919000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["MAGIC: A Dataset Capturing Mid-Air Gesture Performance for Interaction and Feature Analysis"],"prefix":"10.1145","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7610-9430","authenticated-orcid":false,"given":"Masoumehsadat","family":"Hosseini","sequence":"first","affiliation":[{"name":"University of Oldenburg, Oldenburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-8568-5750","authenticated-orcid":false,"given":"Dimitar","family":"Valkov","sequence":"additional","affiliation":[{"name":"Saarland University, Saarbr\u00fccken, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1029-931X","authenticated-orcid":false,"given":"Donald","family":"Degraen","sequence":"additional","affiliation":[{"name":"HIT Lab NZ, University of Canterbury, Christchurch, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4654-2644","authenticated-orcid":false,"given":"Heiko","family":"M\u00fcller","sequence":"additional","affiliation":[{"name":"OFFIS, Oldenburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5931-3218","authenticated-orcid":false,"given":"Marion","family":"Koelle","sequence":"additional","affiliation":[{"name":"DCSM, Hochschule RheinMain, Wiesbaden, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4293-1623","authenticated-orcid":false,"given":"Susanne","family":"Boll","sequence":"additional","affiliation":[{"name":"Media Informatics and Multimedia Systems, University of Oldenburg, Oldenburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,9,30]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74048-3_4"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2628363.2628381"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of Graphics Interface","author":"Anthony Lisa","year":"2013","unstructured":"Lisa Anthony, Radu-Daniel Vatavu, and Jacob O Wobbrock. 2013. Understanding the consistency of users' pen and finger stroke gesture articulation. In Proceedings of Graphics Interface 2013. 87\u201394."},{"key":"e_1_2_1_4_1","volume-title":"Simone Elsig, Giorgio Giatsidis, Franco Bassetto, and Henning M\u00fcller.","author":"Atzori Manfredo","year":"2014","unstructured":"Manfredo Atzori, Arjan Gijsberts, Claudio Castellini, Barbara Caputo, Anne-Gabrielle Mittaz Hager, Simone Elsig, Giorgio Giatsidis, Franco Bassetto, and Henning M\u00fcller. 2014. Electromyography data for non-invasive naturally-controlled robotic hand prostheses. Scientific data 1, 1 (2014), 1\u201313."},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Mark Billinghurst Adrian Clark Gun Lee et al. 2015. A survey of augmented reality. Foundations and Trends\u00ae in Human-Computer Interaction 8 2-3 (2015) 73\u2013272.","DOI":"10.1561\/1100000049"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.28"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/800250.807503"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10209-016-0483-y"},{"key":"e_1_2_1_9_1","first-page":"7060491","article-title":"The Influence of Speed and Position in Dynamic Gesture Recognition for Human-Robot Interaction","volume":"2019","author":"Castillo Jos\u00e9 Carlos","year":"2019","unstructured":"Jos\u00e9 Carlos Castillo, Fernando Alonso-Mart\u00edn, David C\u00e1ceres-Dom\u00ednguez, Mar\u00eda Malfaz, and Miguel A Salichs. 2019. The Influence of Speed and Position in Dynamic Gesture Recognition for Human-Robot Interaction. Journal of Sensors 2019, 1 (2019), 7060491.","journal-title":"Journal of Sensors"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/2503308.2503313"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/SMC42975.2020.9283431"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901790.2901834"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.3390\/s17030458"},{"key":"e_1_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Barrett Ens Aaron Quigley Hui-Shyong Yeo Pourang Irani Thammathip Piumsomboon and Mark Billinghurst. 2018. Counterpoint: exploring mixed-scale gesture interaction for AR applications. In Extended abstracts of the 2018 CHI conference on human factors in computing systems. 1\u20136.","DOI":"10.1145\/3170427.3188513"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2522848.2532597"},{"key":"e_1_2_1_16_1","volume-title":"Using the Intel\u00ae RealSenseTM Depth cameras D4xx in Multi-Camera Configurations","author":"Grunnet-Jepsen Anders","year":"2018","unstructured":"Anders Grunnet-Jepsen, Paul Winer, Aki Takagi, John Sweetser, Kevin Zhao, Tri Khuong, Dan Nie, and John Woodfill. 2018. Using the Intel\u00ae RealSenseTM Depth cameras D4xx in Multi-Camera Configurations. New Technologies Group, Intel Corporation, Rev 1 (2018)."},{"key":"e_1_2_1_17_1","volume-title":"Gunar Schirner, Ta\u015fk\u0131n Pad\u0131r, and Deniz Erdo\u011fmus.","author":"Han Mo","year":"2020","unstructured":"Mo Han, Sezen Ya\u011fmur G\u00fcnay, Gunar Schirner, Ta\u015fk\u0131n Pad\u0131r, and Deniz Erdo\u011fmus. 2020. HANDS: a multimodal dataset for modeling toward human grasp intent inference in prosthetic hands. Intelligent service robotics 13 (2020), 179\u2013185."},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Yana Hasson G\u00fcl Varol Dimitrios Tzionas Igor Kalevatykh Michael J. Black Ivan Laptev and Cordelia Schmid. 2019. Learning joint reconstruction of hands and manipulated objects. In CVPR.","DOI":"10.1109\/CVPR.2019.01208"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3242971"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557130"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581420"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642687"},{"key":"e_1_2_1_23_1","unstructured":"Intel RealSense. [n. d.]. Intel RealSense Depth Camera D455. https:\/\/www.intelrealsense.com\/depth-camera-d455\/. Accessed: 2025-08-17."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.13026\/dzhr-nj10"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.21307\/ijssis-2020-008"},{"key":"e_1_2_1_26_1","volume-title":"Developing a 3D gestural interface for anesthesia-related human-computer interaction tasks using both experts and novices. Human factors 60, 7","author":"Jurewicz Katherina A","year":"2018","unstructured":"Katherina A Jurewicz, David M Neyens, Ken Catchpole, and Scott T Reeves. 2018. Developing a 3D gestural interface for anesthesia-related human-computer interaction tasks using both experts and novices. Human factors 60, 7 (2018), 992\u20131007."},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision. 4572\u20134581","author":"Kapitanov Alexander","year":"2024","unstructured":"Alexander Kapitanov, Karina Kvanchiani, Alexander Nagaev, Roman Kraynov, and Andrei Makhliarchuk. 2024. HaGRID-HAnd Gesture Recognition Image Dataset. In Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision. 4572\u20134581."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2007.383137"},{"key":"e_1_2_1_29_1","article-title":"Segment, track, extract, recognize and convert sign language videos to voice\/text","volume":"3","author":"Kishore PVV","year":"2012","unstructured":"PVV Kishore and P Rajesh Kumar. 2012. Segment, track, extract, recognize and convert sign language videos to voice\/text. International Journal of Advanced Computer Science and Applications 3, 6 (2012).","journal-title":"International Journal of Advanced Computer Science and Applications"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 10th Nordic Conference on Human-Computer Interaction. 473\u2013481","author":"Koelle Marion","year":"2018","unstructured":"Marion Koelle, Swamy Ananthanarayan, Simon Czupalla, Wilko Heuten, and Susanne Boll. 2018. Your smart glasses' camera bothers me! exploring opt-in and opt-out gestures for privacy mediation. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction. 473\u2013481."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 4182\u20134193","author":"Leiva Luis A","year":"2017","unstructured":"Luis A Leiva, Daniel Mart\u00edn-Albo, and Radu-Daniel Vatavu. 2017. Synthesizing stroke gestures across user populations: A case for users with visual impairments. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 4182\u20134193."},{"key":"e_1_2_1_32_1","volume-title":"IJCAI","volume":"1","author":"Liu Lijun","year":"2013","unstructured":"Lijun Liu and Ling Shao. 2013. Learning Discriminative Representations from RGB-D Video Data. In IJCAI, Vol. 1. Beijing, People's Republic of China, 3."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-015-2451-6"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00349"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","unstructured":"Nuno Mendes and Pedro Neto. 2018. Arm gesture dataset based on IMU data captured from the Technaid human-robot interaction system. doi:10.5281\/zenodo.1458250","DOI":"10.5281\/zenodo.1458250"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.456"},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1162\/pres.1994.3.3.236","article-title":"Gesture recognition based upon statistical similarity. Presence","volume":"3","author":"Newby Gregory B","year":"1994","unstructured":"Gregory B Newby. 1994. Gesture recognition based upon statistical similarity. Presence: Teleoperators & Virtual Environments 3, 3 (1994), 236\u2013243.","journal-title":"Teleoperators & Virtual Environments"},{"key":"e_1_2_1_38_1","volume-title":"2017 International Conference on Rehabilitation Robotics (ICORR). IEEE, 1154\u20131159","author":"Palermo Francesca","year":"2017","unstructured":"Francesca Palermo, Matteo Cognolato, Arjan Gijsberts, Henning M\u00fcller, Barbara Caputo, and Manfredo Atzori. 2017. Repeatability of grasp recognition for robotic hand prosthesis control based on sEMG data. In 2017 International Conference on Rehabilitation Robotics (ICORR). IEEE, 1154\u20131159."},{"key":"e_1_2_1_39_1","unstructured":"Polhemus. [n. d.]. Viper16 Electromagnetic Motion Tracking System. https:\/\/polhemus.com\/motion-tracking\/all-trackers\/viper\/. Accessed: 2025-08-17."},{"key":"e_1_2_1_40_1","volume-title":"Recognizing 50 human action categories of web videos. Machine vision and applications 24, 5","author":"Reddy Kishore K","year":"2013","unstructured":"Kishore K Reddy and Mubarak Shah. 2013. Recognizing 50 human action categories of web videos. Machine vision and applications 24, 5 (2013), 971\u2013981."},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the 19th ACM international conference on Multimedia. 1093\u20131096","author":"Ren Zhou","year":"2011","unstructured":"Zhou Ren, Junsong Yuan, and Zhengyou Zhang. 2011. Robust hand gesture recognition based on finger-earth mover's distance with a commodity depth camera. In Proceedings of the 19th ACM international conference on Multimedia. 1093\u20131096."},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"67","author":"Sanders Nathan","year":"2023","unstructured":"Nathan Sanders, Elif Sener, and Karen B Chen. 2023. Eliciting Ergonomic User-Defined Gestures for Virtual Reality: A Pilot Study. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 67. SAGE Publications Sage CA: Los Angeles, CA, 1510\u20131515."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2004.1334462"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993148.2993179"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995316"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2629500"},{"key":"e_1_2_1_47_1","volume-title":"Dinh Phung Dinh Phung, and S Venkatesh.","author":"Trang Pham Trang Pham","year":"2017","unstructured":"Trang Pham Trang Pham, Truyen Tran Truyen Tran, Dinh Phung Dinh Phung, and S Venkatesh. 2017. Predicting healthcare trajectories from medical records: a deep learning approach. (2017)."},{"key":"e_1_2_1_48_1","unstructured":"Dimitar Valkov. 2025. pint-public (GitLab repository). https:\/\/umtl-git.dfki.de\/dimitar.valkov\/pint-public. Accessed: 2025-10-30."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544549.3585773"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.3390\/s22249613"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2017.1278897"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501964"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357236.3395511"},{"key":"e_1_2_1_54_1","doi-asserted-by":"crossref","first-page":"4088","DOI":"10.3390\/s20154088","article-title":"Analysis of precision and stability of hand tracking with leap motion sensor","volume":"20","author":"Vysocky Ale\u0161","year":"2020","unstructured":"Ale\u0161 Vysocky, Stefan Grushko, Petr O\u0161\u010d\u00e1dal, Tom\u00e1\u0161 Kot, Jan Babjak, Rudolf J\u00e1no\u0161, Marek Sukop, and Zdenko Bobovsky. 2020. Analysis of precision and stability of hand tracking with leap motion sensor. Sensors 20, 15 (2020), 4088.","journal-title":"Sensors"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2016.100"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.3390\/s130506380"},{"key":"e_1_2_1_57_1","volume-title":"An introduction to human factors engineering","author":"Wickens Christopher D","unstructured":"Christopher D Wickens, Sallie E Gordon, Yili Liu, and J Lee. 2004. An introduction to human factors engineering. Vol. 2. Pearson Prentice Hall Upper Saddle River, NJ."},{"key":"e_1_2_1_58_1","volume-title":"Brave NUI world: designing natural user interfaces for touch and gesture","author":"Wigdor Daniel","unstructured":"Daniel Wigdor and Dennis Wixon. 2011. Brave NUI world: designing natural user interfaces for touch and gesture. Elsevier."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518866"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2018.12.050"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597638.3608430"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3831634","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T16:33:19Z","timestamp":1790785999000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3831634"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,30]]},"references-count":61,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,9,30]]}},"alternative-id":["10.1145\/3831634"],"URL":"https:\/\/doi.org\/10.1145\/3831634","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,30]]},"assertion":[{"value":"2026-09-30","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}