{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T06:50:11Z","timestamp":1777099811609,"version":"3.51.4"},"reference-count":75,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T00:00:00Z","timestamp":1645747200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T00:00:00Z","timestamp":1645747200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["17J05489"],"award-info":[{"award-number":["17J05489"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Lang Resources &amp; Evaluation"],"published-print":{"date-parts":[[2022,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Gesture and multimodal communication researchers typically annotate video data manually, even though this can be a very time-consuming task. In the present work, a method to detect gestures is proposed as a fundamental step towards a semi-automatic gesture annotation tool. The proposed method can be applied to RGB videos and requires annotations of part of a video as input. The technique deploys a pose estimation method and active learning. In the experiment, it is shown that if about 27% of the video is annotated, the remaining parts of the video can be annotated automatically with an F-score of at least 0.85. Users can run this tool with a small number of annotations first. If the predicted annotations for the remainder of the video are not satisfactory, users can add further annotations and run the tool again. The code has been released so that other researchers and practitioners can use the results of this research. This tool has been confirmed to work in conjunction with ELAN.<\/jats:p>","DOI":"10.1007\/s10579-022-09586-4","type":"journal-article","created":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T13:02:47Z","timestamp":1645794167000},"page":"673-700","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Semi-automation of gesture annotation by machine learning and human collaboration"],"prefix":"10.1007","volume":"56","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4420-6361","authenticated-orcid":false,"given":"Naoto","family":"Ienaga","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alice","family":"Cravotta","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3914-248X","authenticated-orcid":false,"given":"Kei","family":"Terayama","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8243-2223","authenticated-orcid":false,"given":"Bryan W.","family":"Scotney","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2421-9862","authenticated-orcid":false,"given":"Hideo","family":"Saito","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5336-5009","authenticated-orcid":false,"given":"M. Grazia","family":"Bus\u00e0","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,2,25]]},"reference":[{"key":"9586_CR1","doi-asserted-by":"publisher","unstructured":"Bressem, J., & M\u00fcller, C. (2014). The family of away gestures: Negation, refusal, and negative assessment. Body\u2013language\u2013communication: An International Handbook on Multimodality in Human Interaction, 2, 1592\u20131604. https:\/\/doi.org\/10.1515\/9783110302028.1592","DOI":"10.1515\/9783110302028.1592"},{"issue":"1","key":"9586_CR2","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1075\/gest.3.1.03cal","volume":"3","author":"G Calbris","year":"2003","unstructured":"Calbris, G. (2003). From cutting an object to a clear cut analysis: Gesture as the representation of a preconceptual schema linking concrete actions to abstract notions. Gesture, 3(1), 19\u201346. https:\/\/doi.org\/10.1075\/gest.3.1.03cal","journal-title":"Gesture"},{"key":"9586_CR3","doi-asserted-by":"publisher","unstructured":"Camgoz, N. C., Hadfield, S., Koller, O., & Bowden, R. (2016). Using convolutional 3d neural networks for user-independent continuous gesture recognition. In 2016 23rd international conference on pattern recognition, pp. 49\u201354. https:\/\/doi.org\/10.1109\/ICPR.2016.7899606","DOI":"10.1109\/ICPR.2016.7899606"},{"key":"9586_CR4","doi-asserted-by":"publisher","unstructured":"Camgoz, N. C., Hadfield, S., Koller, O., & Bowden, R. (2017). Subunets: End-to-end hand shape and continuous sign language recognition. In 2017 IEEE international conference on computer vision, pp. 3075\u20133084. https:\/\/doi.org\/10.1109\/ICCV.2017.332","DOI":"10.1109\/ICCV.2017.332"},{"key":"9586_CR5","doi-asserted-by":"crossref","unstructured":"Cao, Z., Simon, T., Wei, S. E., & Sheikh, Y. (2017). Realtime multi-person 2d pose estimation using part affinity fields. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 7291\u20137299.","DOI":"10.1109\/CVPR.2017.143"},{"key":"9586_CR6","doi-asserted-by":"publisher","unstructured":"Chen, T. & Guestrin, C. (2016). Xgboost: A scalable tree boosting system. In Proceedings of the 22nd ACM Sigkdd international conference on knowledge discovery and data mining, pp. 785\u2013794. https:\/\/doi.org\/10.1145\/2939672.2939785","DOI":"10.1145\/2939672.2939785"},{"key":"9586_CR7","doi-asserted-by":"publisher","unstructured":"Chen, X. & Koskela, M. (2013). Online RGB-D gesture recognition with extreme learning machines. In Proceedings of the 15th ACM on international conference on multimodal interaction, 467\u2013474. https:\/\/doi.org\/10.1145\/2522848.2532591","DOI":"10.1145\/2522848.2532591"},{"issue":"2","key":"9586_CR8","doi-asserted-by":"publisher","first-page":"694","DOI":"10.1037\/a0033861","volume":"143","author":"M Chu","year":"2014","unstructured":"Chu, M., Meyer, A., Foulkes, L., & Kita, S. (2014). Individual differences in frequency and saliency of speech-accompanying gestures: The role of cognitive abilities and empathy. Journal of Experimental Psychology: General, 143(2), 694. https:\/\/doi.org\/10.1037\/a0033861","journal-title":"Journal of Experimental Psychology: General"},{"key":"9586_CR9","doi-asserted-by":"publisher","DOI":"10.1075\/gs.7","volume-title":"Why gesture? How the hands function in speaking, thinking and communicating","author":"RB Church","year":"2017","unstructured":"Church, R. B., Alibali, M. W., & Kelly, S. D. (2017). Why gesture? How the hands function in speaking, thinking and communicating. Amsterdam: John Benjamins Publishing Company."},{"key":"9586_CR10","doi-asserted-by":"publisher","first-page":"23","DOI":"10.3389\/fcomm.2018.00023","volume":"3","author":"K Cooperrider","year":"2018","unstructured":"Cooperrider, K., Abner, N., & Goldin-Meadow, S. (2018). The palm-up puzzle: Meanings and origins of a widespread form in gesture and sign. Frontiers in Communication, 3, 23. https:\/\/doi.org\/10.3389\/fcomm.2018.00023","journal-title":"Frontiers in Communication"},{"issue":"9","key":"9586_CR11","doi-asserted-by":"publisher","first-page":"3204","DOI":"10.1044\/2019_JSLHR-S-18-0493","volume":"62","author":"A Cravotta","year":"2019","unstructured":"Cravotta, A., Bus\u00e0, M. G., & Prieto, P. (2019). Effects of encouraging the use of gestures on speech. Journal of Speech, Language, and Hearing Research, 62(9), 3204\u20133219. https:\/\/doi.org\/10.1044\/2019_JSLHR-S-18-0493","journal-title":"Journal of Speech, Language, and Hearing Research"},{"key":"9586_CR12","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.175","author":"R Cui","year":"2017","unstructured":"Cui, R., Liu, H., & Zhang, C. (2017). Recurrent convolutional neural networks for continuous sign language recognition by staged optimization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. https:\/\/doi.org\/10.1109\/CVPR.2017.175","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition"},{"issue":"2","key":"9586_CR13","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1007\/s10579-017-9404-9","volume":"52","author":"S De Beugher","year":"2018","unstructured":"De Beugher, S., Br\u00f4ne, G., & Goedem\u00e9, T. (2018). A semi-automatic annotation tool for unobtrusive gesture analysis. Language Resources and Evaluation, 52(2), 433\u2013460. https:\/\/doi.org\/10.1007\/s10579-017-9404-9","journal-title":"Language Resources and Evaluation"},{"key":"9586_CR14","unstructured":"Dorogush, A. V., Ershov, V., & Gulin, A. (2018). CatBoost: gradient boosting with categorical features support. arXiv preprint arXiv:1810.11363."},{"key":"9586_CR15","doi-asserted-by":"publisher","unstructured":"Droeschel, D., St\u00fcckler, J., Holz, D., & Behnke, S. (2011). Towards joint attention for a domestic service robot-person awareness and gesture recognition using time-of-flight cameras. In 2011 IEEE international conference on robotics and automation (pp. 1205\u20131210). https:\/\/doi.org\/10.1109\/ICRA.2011.5980067","DOI":"10.1109\/ICRA.2011.5980067"},{"key":"9586_CR16","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31534-3_32","author":"E Efthimiou","year":"2012","unstructured":"Efthimiou, E., Fotinea, S. E., Hanke, T., Glauert, J., Bowden, R., Braffort, A., & Lefebvre-Albaret, F. (2012). The dicta-sign wiki: Enabling web communication for the deaf. International Conference on Computers for Handicapped Persons. https:\/\/doi.org\/10.1007\/978-3-642-31534-3_32","journal-title":"International Conference on Computers for Handicapped Persons"},{"key":"9586_CR17","unstructured":"Forster, J., Schmidt, C., Koller, O., Bellgardt, M., & Ney, H. (2014). Extensions of the sign language recognition and translation corpus RWTH-PHOENIX-weather. In International conference on language resources and evaluation (pp. 1911\u20131916)."},{"key":"9586_CR18","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-77129-6_47","author":"H Francke","year":"2007","unstructured":"Francke, H., Ruiz-del-Solar, J., & Verschae, R. (2007). Real-time hand gesture detection and recognition using boosted classifiers and active learning. Pacific-Rim Symposium on Image and Video Technology. https:\/\/doi.org\/10.1007\/978-3-540-77129-6_47","journal-title":"Pacific-Rim Symposium on Image and Video Technology"},{"key":"9586_CR19","doi-asserted-by":"publisher","unstructured":"Fukui, R., Watanabe, M., Gyota, T., Shimosaka, M., & Sato, T. (2011). Hand shape classification with a wrist contour sensor: Development of a prototype device. In Proceedings of the 13th international conference on ubiquitous computing (pp. 311\u2013314). https:\/\/doi.org\/10.1145\/2030112.2030154","DOI":"10.1145\/2030112.2030154"},{"key":"9586_CR20","unstructured":"Gebre, B. G., Wittenburg, P., & Lenkiewicz, P. (2012). Towards automatic gesture stroke detection. In LREC 2012: 8th international conference on language resources and evaluation (pp. 231\u2013235). http:\/\/hdl.handle.net\/11858\/00-001M-0000-000F-8479-7"},{"issue":"12","key":"9586_CR21","doi-asserted-by":"publisher","first-page":"1565","DOI":"10.1016\/S0028-3932(03)00120-9","volume":"41","author":"G Goldenberg","year":"2003","unstructured":"Goldenberg, G., Hartmann, K., & Schlott, I. (2003). Defective pantomime of object use in left brain damage: Apraxia or asymbolia? Neuropsychologia, 41(12), 1565\u20131573. https:\/\/doi.org\/10.1016\/S0028-3932(03)00120-9","journal-title":"Neuropsychologia"},{"issue":"12","key":"9586_CR22","doi-asserted-by":"publisher","first-page":"3827","DOI":"10.1007\/s00521-016-2277-9","volume":"28","author":"T He","year":"2017","unstructured":"He, T., Mao, H., & Yi, Z. (2017). Moving object recognition using multi-view three-dimensional convolutional neural networks. Neural Computing and Applications, 28(12), 3827\u20133835. https:\/\/doi.org\/10.1007\/s00521-016-2277-9","journal-title":"Neural Computing and Applications"},{"key":"9586_CR23","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1016\/j.cortex.2016.02.009","volume":"78","author":"S Humphries","year":"2016","unstructured":"Humphries, S., Holler, J., Crawford, T. J., Herrera, E., & Poliakoff, E. (2016). A third-person perspective on co-speech action gestures in Parkinson\u2019s disease. Cortex, 78, 44\u201354. https:\/\/doi.org\/10.1016\/j.cortex.2016.02.009","journal-title":"Cortex"},{"key":"9586_CR24","unstructured":"Ienaga, N., Scotney, B. W., Saito, H., Cravotta, A., & Bus\u00e0, M. G. (2018). Natural gesture extraction based on hand trajectory. In Irish machine vision and image processing conference (pp. 81\u201388)."},{"key":"9586_CR25","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1016\/j.pragma.2019.02.011","volume":"143","author":"A Inbar","year":"2019","unstructured":"Inbar, A., & Shor, L. (2019). Covert negation in Israeli Hebrew: Evidence from co-speech gestures. Journal of Pragmatics, 143, 85\u201395. https:\/\/doi.org\/10.1016\/j.pragma.2019.02.011","journal-title":"Journal of Pragmatics"},{"key":"9586_CR26","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1016\/j.patrec.2013.05.024","volume":"36","author":"MG Jacob","year":"2014","unstructured":"Jacob, M. G., & Wachs, J. P. (2014). Context-based hand gesture recognition for the operating room. Pattern Recognition Letters, 36, 196\u2013203. https:\/\/doi.org\/10.1016\/j.patrec.2013.05.024","journal-title":"Pattern Recognition Letters"},{"key":"9586_CR27","first-page":"3146","volume":"30","author":"G Ke","year":"2017","unstructured":"Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., & Liu, T. Y. (2017). Lightgbm: A highly efficient gradient boosting decision tree. Advances in Neural Information Processing Systems, 30, 3146\u20133154.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9586_CR28","doi-asserted-by":"publisher","DOI":"10.1515\/9783110813098.207","author":"A Kendon","year":"1980","unstructured":"Kendon, A. (1980). Gesticulation and speech: Two aspects of the process of utterance. The Relationship of Verbal and Nonverbal Communication, 207\u2013227,. https:\/\/doi.org\/10.1515\/9783110813098.207","journal-title":"The Relationship of Verbal and Nonverbal Communication"},{"issue":"1","key":"9586_CR29","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1525\/jlin.1992.2.1.92","volume":"2","author":"A Kendon","year":"1992","unstructured":"Kendon, A. (1992). Some recent work from Italy on quotable gestures (emblems). Journal of Linguistic Anthropology, 2(1), 92\u2013108. https:\/\/doi.org\/10.1525\/jlin.1992.2.1.92","journal-title":"Journal of Linguistic Anthropology"},{"key":"9586_CR30","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511807572","volume-title":"Gesture: Visible action as utterance","author":"A Kendon","year":"2004","unstructured":"Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge University Press."},{"key":"9586_CR31","doi-asserted-by":"publisher","unstructured":"Kettebekov, S. (2004). Exploiting prosodic structuring of coverbal gesticulation. In Proceedings of the 6th international conference on multimodal interfaces (pp. 105\u2013112). https:\/\/doi.org\/10.1145\/1027933.1027953","DOI":"10.1145\/1027933.1027953"},{"issue":"2","key":"9586_CR32","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1109\/TMM.2004.840590","volume":"7","author":"S Kettebekov","year":"2005","unstructured":"Kettebekov, S., Yeasin, M., & Sharma, R. (2005). Prosody based audiovisual coanalysis for coverbal gesture recognition. IEEE Transactions on Multimedia, 7(2), 234\u2013242. https:\/\/doi.org\/10.1109\/TMM.2004.840590","journal-title":"IEEE Transactions on Multimedia"},{"key":"9586_CR33","doi-asserted-by":"publisher","unstructured":"Kim, D., Hilliges, O., Izadi, S., Butler, A. D., Chen, J., Oikonomidis, I., & Olivier, P. (2012). Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor. In Proceedings of the 25th annual ACM symposium on user interface software and technology (pp. 167\u2013176). https:\/\/doi.org\/10.1145\/2380116.2380139","DOI":"10.1145\/2380116.2380139"},{"key":"9586_CR34","doi-asserted-by":"crossref","unstructured":"Kipp, M. (2001). Anvil-a generic annotation tool for multimodal dialogue. In: Seventh European conference on speech communication and technology.","DOI":"10.21437\/Eurospeech.2001-354"},{"key":"9586_CR35","doi-asserted-by":"publisher","DOI":"10.4324\/9781410607744","volume-title":"Pointing: Where language, culture, and cognition meet","author":"S Kita","year":"2003","unstructured":"Kita, S. (2003). Pointing: Where language, culture, and cognition meet. Psychology Press."},{"key":"9586_CR36","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1016\/j.cviu.2015.09.013","volume":"141","author":"O Koller","year":"2015","unstructured":"Koller, O., Forster, J., & Ney, H. (2015). Continuous sign language recognition: Towards large vocabulary statistical recognition systems handling multiple signers. Computer Vision and Image Understanding, 141, 108\u2013125. https:\/\/doi.org\/10.1016\/j.cviu.2015.09.013","journal-title":"Computer Vision and Image Understanding"},{"issue":"3","key":"9586_CR37","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1075\/gest.11.3.01lem","volume":"11","author":"M Lempert","year":"2011","unstructured":"Lempert, M. (2011). Barack Obama, being sharp: Indexical order in the pragmatics of precision-grip gesture. Gesture, 11(3), 241\u2013270. https:\/\/doi.org\/10.1075\/gest.11.3.01lem","journal-title":"Gesture"},{"key":"9586_CR38","doi-asserted-by":"publisher","unstructured":"Liu, R., Chen, T., & Huang, L. (2010). Research on human activity recognition based on active learning. In 2010 international conference on machine learning and cybernetics (pp. 285\u2013290). https:\/\/doi.org\/10.1109\/ICMLC.2010.5581050","DOI":"10.1109\/ICMLC.2010.5581050"},{"key":"9586_CR39","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1016\/j.knosys.2013.11.017","volume":"56","author":"V L\u00f3pez-Lude\u00f1a","year":"2014","unstructured":"L\u00f3pez-Lude\u00f1a, V., Gonz\u00e1lez-Morcillo, C., L\u00f3pez, J. C., Ferreiro, E., Ferreiros, J., & San-Segundo, R. (2014). Methodology for developing an advanced communications system for the Deaf in a new domain. Knowledge-Based Systems, 56, 240\u2013252. https:\/\/doi.org\/10.1016\/j.knosys.2013.11.017","journal-title":"Knowledge-Based Systems"},{"key":"9586_CR40","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1016\/j.eswa.2016.02.021","volume":"56","author":"RCB Madeo","year":"2016","unstructured":"Madeo, R. C. B., Peres, S. M., & de Moraes Lima, C. A. (2016). Gesture phase segmentation using support vector machines. Expert Systems with Applications, 56, 100\u2013115. https:\/\/doi.org\/10.1016\/j.eswa.2016.02.021","journal-title":"Expert Systems with Applications"},{"key":"9586_CR41","volume-title":"Hand and mind: What gestures reveal about thought","author":"D McNeill","year":"1992","unstructured":"McNeill, D. (1992). Hand and mind: What gestures reveal about thought. University of Chicago Press."},{"key":"9586_CR42","doi-asserted-by":"publisher","DOI":"10.7208\/chicago\/9780226514642.001.0001","author":"D McNeill","year":"2005","unstructured":"McNeill, D. (2005). Gesture and thought. University of Chicago Press. https:\/\/doi.org\/10.7208\/chicago\/9780226514642.001.0001","journal-title":"University of Chicago Press"},{"key":"9586_CR43","first-page":"233","volume":"9","author":"C M\u00fcller","year":"2004","unstructured":"M\u00fcller, C. (2004). Forms and uses of the Palm Up Open Hand: A case of a gesture family. The Semantics and Pragmatics of Everyday Gestures, 9, 233\u2013256.","journal-title":"The Semantics and Pragmatics of Everyday Gestures"},{"issue":"2","key":"9586_CR44","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1075\/gest.16.2.05mul","volume":"16","author":"C M\u00fcller","year":"2017","unstructured":"M\u00fcller, C. (2017). How recurrent gestures mean: Conventionalized contexts-of-use and embodied motivation. Gesture, 16(2), 277\u2013304. https:\/\/doi.org\/10.1075\/gest.16.2.05mul","journal-title":"Gesture"},{"key":"9586_CR45","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.eswa.2018.03.063","volume":"106","author":"F Negin","year":"2018","unstructured":"Negin, F., Rodriguez, P., Koperski, M., Kerboua, A., Gonz\u00e0lez, J., Bourgeois, J., & Bremond, F. (2018). PRAXIS: Towards automatic cognitive assessment using gesture recognition. Expert Systems with Applications, 106, 21\u201335. https:\/\/doi.org\/10.1016\/j.eswa.2018.03.063","journal-title":"Expert Systems with Applications"},{"key":"9586_CR46","unstructured":"Neidle, C., Thangali, A., & Sclaroff, S. (2012). Challenges in development of the american sign language lexicon video dataset (asllvd) corpus. In 5th workshop on the representation and processing of sign languages: Interactions between corpus and lexicon, language resources and evaluation conference."},{"key":"9586_CR47","unstructured":"Neidle, C. & Vogler, C. (2012). A new web interface to facilitate access to corpora: Development of the ASLLRP data access interface (DAI). In Proceedings of 5th workshop on the representation and processing of sign languages: Interactions between corpus and lexicon, language resources and evaluation conference."},{"key":"9586_CR48","doi-asserted-by":"publisher","unstructured":"Okada, S., Bono, M., Takanashi, K., Sumi, Y., & Nitta, K. (2013). Context-based conversational hand gesture classification in narrative interaction. In Proceedings of the 15th ACM on international conference on multimodal interaction (pp. 303\u2013310). https:\/\/doi.org\/10.1145\/2522848.2522898","DOI":"10.1145\/2522848.2522898"},{"key":"9586_CR49","doi-asserted-by":"publisher","unstructured":"Okada, S. & Otsuka, K. (2017). Recognizing words from gestures: Discovering gesture descriptors associated with spoken utterances. In 2017 12th IEEE international conference on automatic face & gesture recognition (pp. 430\u2013437). https:\/\/doi.org\/10.1109\/FG.2017.60.","DOI":"10.1109\/FG.2017.60"},{"issue":"06","key":"9586_CR50","first-page":"873","volume":"27","author":"SC Ong","year":"2005","unstructured":"Ong, S. C., & Ranganath, S. (2005). Automatic sign language analysis: A survey and the future beyond lexical meaning. IEEE Computer Architecture Letters, 27(06), 873\u2013891.","journal-title":"IEEE Computer Architecture Letters"},{"issue":"6","key":"9586_CR51","doi-asserted-by":"publisher","first-page":"754","DOI":"10.1177\/1362361315605921","volume":"20","author":"\u015e \u00d6z\u00e7al\u0131\u015fkan","year":"2016","unstructured":"\u00d6z\u00e7al\u0131\u015fkan, \u015e, Adamson, L. B., & Dimitrova, N. (2016). Early deictic but not other gestures predict later vocabulary in both typical development and autism. Autism, 20(6), 754\u2013763. https:\/\/doi.org\/10.1177\/1362361315605921","journal-title":"Autism"},{"issue":"3","key":"9586_CR52","doi-asserted-by":"publisher","first-page":"B101","DOI":"10.1016\/j.cognition.2005.01.001","volume":"96","author":"\u015e \u00d6z\u00e7al\u0131\u015fkan","year":"2005","unstructured":"\u00d6z\u00e7al\u0131\u015fkan, \u015e, & Goldin-Meadow, S. (2005). Gesture is at the cutting edge of early language development. Cognition, 96(3), B101\u2013B113. https:\/\/doi.org\/10.1016\/j.cognition.2005.01.001","journal-title":"Cognition"},{"key":"9586_CR53","doi-asserted-by":"publisher","DOI":"10.1007\/11492429_73","author":"HS Park","year":"2005","unstructured":"Park, H. S., Kim, E. Y., Jang, S. S., Park, S. H., Park, M. H., & Kim, H. J. (2005). HMM-based gesture recognition for robot control. In Iberian Conference on Pattern Recognition and Image Analysis, 607\u2013614,. https:\/\/doi.org\/10.1007\/11492429_73","journal-title":"In Iberian Conference on Pattern Recognition and Image Analysis"},{"issue":"4","key":"9586_CR54","doi-asserted-by":"publisher","first-page":"504","DOI":"10.9717\/KMMS.2011.14.4.504","volume":"14","author":"SY Park","year":"2011","unstructured":"Park, S. Y., & Lee, E. J. (2011). Hand gesture recognition using optical flow field segmentation and boundary complexity comparison based on hidden Markov models. Journal of Korea Multimedia Society, 14(4), 504\u2013516. https:\/\/doi.org\/10.9717\/KMMS.2011.14.4.504","journal-title":"Journal of Korea Multimedia Society"},{"key":"9586_CR55","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1007\/s10339-014-0606-4","volume":"15","author":"M Parzuchowski","year":"2014","unstructured":"Parzuchowski, M., Szymkow, A., Baryla, W., & Wojciszke, B. (2014). From the heart: Hand over heart as an embodiment of honesty. Cognitive Processing, 15, 237\u2013244. https:\/\/doi.org\/10.1007\/s10339-014-0606-4","journal-title":"Cognitive Processing"},{"key":"9586_CR56","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-16178-5_36","author":"X Peng","year":"2014","unstructured":"Peng, X., Wang, L., Cai, Z., & Qiao, Y. (2014). Action and gesture temporal spotting with super vector representation. In European Conference on Computer Vision, 518\u2013527,. https:\/\/doi.org\/10.1007\/978-3-319-16178-5_36","journal-title":"In European Conference on Computer Vision"},{"key":"9586_CR57","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2017.365","author":"L Pigou","year":"2017","unstructured":"Pigou, L., Van Herreweghe, M., & Dambre, J. (2017). Gesture and sign language recognition with temporal residual networks. In Proceedings of the IEEE International Conference on Computer Vision Workshops, 3086\u20133093,. https:\/\/doi.org\/10.1109\/ICCVW.2017.365","journal-title":"In Proceedings of the IEEE International Conference on Computer Vision Workshops"},{"key":"9586_CR58","doi-asserted-by":"publisher","first-page":"723","DOI":"10.3758\/s13428-019-01271-9","volume":"52","author":"W Pouw","year":"2020","unstructured":"Pouw, W., Trujillo, J. P., & Dixon, J. A. (2020). The quantification of gesture\u2013speech synchrony: A tutorial and validation of multimodal data acquisition using device-based and video-based motion tracking. Behavior Research Methods, 52, 723\u2013740. https:\/\/doi.org\/10.3758\/s13428-019-01271-9","journal-title":"Behavior Research Methods"},{"key":"9586_CR59","doi-asserted-by":"crossref","unstructured":"Rautaray, S. S. (2012). Real time hand gesture recognition system for dynamic applications. International Journal of UbiComp, 3(1). https:\/\/ssrn.com\/abstract=3702844","DOI":"10.5121\/iju.2012.3103"},{"issue":"1","key":"9586_CR60","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10462-012-9356-9","volume":"43","author":"SS Rautaray","year":"2015","unstructured":"Rautaray, S. S., & Agrawal, A. (2015). Vision based hand gesture recognition for human computer interaction: A survey. Artificial Intelligence Review, 43(1), 1\u201354. https:\/\/doi.org\/10.1007\/s10462-012-9356-9","journal-title":"Artificial Intelligence Review"},{"key":"9586_CR61","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2001.962092","author":"J Rekimoto","year":"2001","unstructured":"Rekimoto, J. (2001). Gesturewrist and gesturepad: Unobtrusive wearable interaction devices. Proceedings Fifth International Symposium on Wearable Computers. https:\/\/doi.org\/10.1109\/ISWC.2001.962092","journal-title":"Proceedings Fifth International Symposium on Wearable Computers"},{"issue":"4","key":"9586_CR62","doi-asserted-by":"publisher","first-page":"1783","DOI":"10.3758\/s13428-020-01350-2","volume":"52","author":"J Ripperda","year":"2020","unstructured":"Ripperda, J., Drijvers, L., & Holler, J. (2020). Speeding up the detection of non-iconic and iconic gestures (SPUDNIG): A toolkit for the automatic detection of hand movements and gestures in video data. Behavior Research Methods, 52(4), 1783\u20131794. https:\/\/doi.org\/10.3758\/s13428-020-01350-2","journal-title":"Behavior Research Methods"},{"key":"9586_CR63","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07230-2_33","author":"S Ruffieux","year":"2014","unstructured":"Ruffieux, S., Lalanne, D., Mugellini, E., & Abou Khaled, O. (2014). A survey of datasets for human gesture recognition. International Conference on Human-Computer Interaction. https:\/\/doi.org\/10.1007\/978-3-319-07230-2_33","journal-title":"International Conference on Human-Computer Interaction"},{"key":"9586_CR64","doi-asserted-by":"publisher","DOI":"10.1109\/AFGR.2000.840671","author":"H Sagawa","year":"2000","unstructured":"Sagawa, H., & Takeuchi, M. (2000). A method for recognizing a sequence of sign language words represented in a Japanese sign language sentence. Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition. https:\/\/doi.org\/10.1109\/AFGR.2000.840671","journal-title":"Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition"},{"key":"9586_CR65","unstructured":"Schreer, O. & Masneri, S. (2014). Automatic video analysis for annotation of human body motion in humanities research. In Workshop on multimodal corpora in conjunction with language resources and evaluation conference (pp. 29\u201332)."},{"key":"9586_CR66","doi-asserted-by":"publisher","unstructured":"Schumacher, J., Saki\u010d, D., Grumpe, A., Fink, G. A., & W\u00f6hler, C. (2012). Active learning of ensemble classifiers for gesture recognition. In Joint DAGM (German Association for Pattern Recognition) and OAGM symposium (pp. 498\u2013507). https:\/\/doi.org\/10.1007\/978-3-642-32717-9_50","DOI":"10.1007\/978-3-642-32717-9_50"},{"key":"9586_CR67","doi-asserted-by":"publisher","DOI":"10.1109\/AFGR.2000.840669","author":"R Sharma","year":"2000","unstructured":"Sharma, R., Cai, J., Chakravarthy, S., Poddar, I., & Sethi, Y. (2000). Exploiting speech\/gesture co-occurrence for improving continuous gesture recognition in weather narration. Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition. https:\/\/doi.org\/10.1109\/AFGR.2000.840669","journal-title":"Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition"},{"issue":"2","key":"9586_CR68","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1080\/08351810802028662","volume":"41","author":"J Streeck","year":"2008","unstructured":"Streeck, J. (2008). Gesture in political communication: A case study of the democratic presidential candidates during the 2004 primary campaign. Research on Language and Social Interaction, 41(2), 154\u2013186. https:\/\/doi.org\/10.1080\/08351810802028662","journal-title":"Research on Language and Social Interaction"},{"issue":"2","key":"9586_CR69","doi-asserted-by":"publisher","first-page":"769","DOI":"10.3758\/s13428-018-1086-8","volume":"51","author":"JP Trujillo","year":"2019","unstructured":"Trujillo, J. P., Vaitonyte, J., Simanova, I., & \u00d6zy\u00fcrek, A. (2019). Toward the markerless and automatic analysis of kinematic features: A toolkit for gesture and movement research. Behavior Research Methods, 51(2), 769\u2013777. https:\/\/doi.org\/10.3758\/s13428-018-1086-8","journal-title":"Behavior Research Methods"},{"key":"9586_CR70","doi-asserted-by":"publisher","unstructured":"Vardy, A., Robinson, J., & Cheng, L. T. (1999). The wristcam as input device. In Digest of papers. Third international symposium on wearable computers (pp. 199\u2013202). https:\/\/doi.org\/10.1109\/ISWC.1999.806928","DOI":"10.1109\/ISWC.1999.806928"},{"key":"9586_CR71","doi-asserted-by":"publisher","unstructured":"Von Agris, U., Knorr, M., & Kraiss, K. F. (2008). The significance of facial features for automatic sign language recognition. In 2008 8th IEEE international conference on automatic face & gesture recognition (pp. 1\u20136). https:\/\/doi.org\/10.1109\/AFGR.2008.4813472","DOI":"10.1109\/AFGR.2008.4813472"},{"issue":"2","key":"9586_CR72","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1023\/A:1008918401478","volume":"9","author":"S Waldherr","year":"2000","unstructured":"Waldherr, S., Romero, R., & Thrun, S. (2000). A gesture based interface for human-robot interaction. Autonomous Robots, 9(2), 151\u2013173. https:\/\/doi.org\/10.1023\/A:1008918401478","journal-title":"Autonomous Robots"},{"key":"9586_CR73","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2020.3012092","author":"J Wan","year":"2020","unstructured":"Wan, J., Lin, C., Wen, L., Li, Y., Miao, Q., Escalera, S., & Li, S. Z. (2020). ChaLearn looking at people: IsoGD and ConGD Large-Scale RGB-D gesture recognition. IEEE Transactions on Cybernetics (early Access). https:\/\/doi.org\/10.1109\/TCYB.2020.3012092","journal-title":"IEEE Transactions on Cybernetics (early Access)"},{"key":"9586_CR74","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2016.100","author":"J Wan","year":"2016","unstructured":"Wan, J., Zhao, Y., Zhou, S., Guyon, I., Escalera, S., & Li, S. Z. (2016). Chalearn looking at people rgb-d isolated and continuous datasets for gesture recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. https:\/\/doi.org\/10.1109\/CVPRW.2016.100","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops"},{"key":"9586_CR75","unstructured":"Wittenburg, P., Brugman, H., Russel, A., Klassmann, A., & Sloetjes, H. (2006). Elan: A professional framework for multimodality research. Proceedings of the fifth international conference on language resources and evaluation (pp. 1556\u20131559)."}],"updated-by":[{"DOI":"10.1007\/s10579-022-09599-z","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2022,6,5]],"date-time":"2022-06-05T00:00:00Z","timestamp":1654387200000}}],"container-title":["Language Resources and Evaluation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-022-09586-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10579-022-09586-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-022-09586-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,18]],"date-time":"2022-08-18T10:09:16Z","timestamp":1660817356000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10579-022-09586-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,25]]},"references-count":75,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,9]]}},"alternative-id":["9586"],"URL":"https:\/\/doi.org\/10.1007\/s10579-022-09586-4","relation":{"correction":[{"id-type":"doi","id":"10.1007\/s10579-022-09599-z","asserted-by":"object"}]},"ISSN":["1574-020X","1574-0218"],"issn-type":[{"value":"1574-020X","type":"print"},{"value":"1574-0218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,25]]},"assertion":[{"value":"7 February 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 February 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 June 2022","order":3,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":4,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":5,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s10579-022-09599-z","URL":"https:\/\/doi.org\/10.1007\/s10579-022-09599-z","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"There are no conflicts of interest to declare.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}