{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:03:15Z","timestamp":1760234595724,"version":"build-2065373602"},"reference-count":48,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,5,27]],"date-time":"2021-05-27T00:00:00Z","timestamp":1622073600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["71901061","71871056"],"award-info":[{"award-number":["71901061","71871056"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Science and Technology on Avionics Integration Laboratory and Aeronautical Science Fund","award":["20185569008"],"award-info":[{"award-number":["20185569008"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Continuous movements of the hand contain discrete expressions of meaning, forming a variety of semantic gestures. For example, it is generally considered that the bending of the finger includes three semantic states of bending, half bending, and straightening. However, there is still no research on the number of semantic states that can be conveyed by each movement primitive of the hand, especially the interval of each semantic state and the representative movement angle. To clarify these issues, we conducted experiments of perception and expression. Experiments 1 and 2 focused on perceivable semantic levels and boundaries of different motion primitive units from the perspective of visual semantic perception. Experiment 3 verified and optimized the segmentation results obtained above and further determined the typical motion values of each semantic state. Furthermore, in Experiment 4, the empirical application of the above semantic state segmentation was illustrated by using Leap Motion as an example. We ended up with the discrete gesture semantic expression space both in the real world and Leap Motion Digital World, containing the clearly defined number of semantic states of each hand motion primitive unit and boundaries and typical motion angle values of each state. Construction of this quantitative semantic expression will play a role in guiding and advancing research in the fields of gesture coding, gesture recognition, and gesture design.<\/jats:p>","DOI":"10.3390\/s21113735","type":"journal-article","created":{"date-parts":[[2021,5,27]],"date-time":"2021-05-27T11:07:02Z","timestamp":1622113622000},"page":"3735","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Research on Discrete Semantics in Continuous Hand Joint Movement Based on Perception and Expression"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3950-0905","authenticated-orcid":false,"given":"Lesong","family":"Jia","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, Southeast University, Nanjing 211189, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0370-2369","authenticated-orcid":false,"given":"Xiaozhou","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Southeast University, Nanjing 211189, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9522-4669","authenticated-orcid":false,"given":"Hao","family":"Qin","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Southeast University, Nanjing 211189, China"}]},{"given":"Ruidong","family":"Bai","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Southeast University, Nanjing 211189, China"}]},{"given":"Liuqing","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Southeast University, Nanjing 211189, China"}]},{"given":"Chengqi","family":"Xue","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Southeast University, Nanjing 211189, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Gao, Q., Liu, J., and Ju, Z. (2020). Hand gesture recognition using multimodal data fusion and multiscale parallel convolutional neural network for human\u2013robot interaction. Expert Syst., e12490.","DOI":"10.1111\/exsy.12490"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1134\/S1019331618010094","article-title":"Multimodal Interfaces of Human\u2013Computer Interaction","volume":"88","author":"Karpov","year":"2018","journal-title":"Her. Russ. Acad. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Kim, J., Laine, T., and \u00c5hlund, C. (2021). Multimodal Interaction Systems Based on Internet of Things and Augmented Reality: A Systematic Literature Review. Appl. Sci., 11.","DOI":"10.3390\/app11041738"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"105188","DOI":"10.1016\/j.clinbiomech.2020.105188","article-title":"Quantitative analysis of metacarpophalangeal joints during active flexion using four-dimensional computed tomography","volume":"80","author":"Ishii","year":"2020","journal-title":"Clin. Biomech."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"e5763","DOI":"10.7717\/peerj.5763","article-title":"Thumbs up: Movements made by the thumb are smoother and larger than fingers in finger-thumb opposition tasks","volume":"6","author":"Rachaveti","year":"2018","journal-title":"PeerJ"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Jarque-Bou, N.J., Vergara, M., and Sancho-Bru, J. (2021). Estimation of the Abduction\/Adduction Movement of the Metacarpophalangeal Joint of the Thumb. Appl. Sci., 11.","DOI":"10.3390\/app11073158"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"28","DOI":"10.35784\/jteme.536","article-title":"Biomechanics of the human hand","volume":"3","author":"Jaworski","year":"2017","journal-title":"J. Technol. Exploit. Mech. Eng."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhao, K.D., Robinson, C.A., and Hilliard, M.J. (2019). Biomechanics of the Upper Limb. Atlas of Orthoses and Assistive Devices, Elsevier.","DOI":"10.1016\/B978-0-323-48323-0.00011-1"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.shaw.2014.09.002","article-title":"Ergonomic Evaluation of Biomechanical Hand Function","volume":"6","author":"Lee","year":"2015","journal-title":"Saf. Health Work"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.apergo.2018.09.007","article-title":"Case study on the effects of fit and material of sports gloves on hand performance","volume":"75","author":"Yu","year":"2019","journal-title":"Appl. Ergon."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1016\/j.jht.2016.08.001","article-title":"Functional range of motion of the hand joints in activities of the International Classification of Functioning, Disability and Health","volume":"30","author":"Vergara","year":"2017","journal-title":"J. Hand Ther."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1177\/1753193414533754","article-title":"The functional range of motion of the finger joints","volume":"40","author":"Bain","year":"2015","journal-title":"J. Hand Surg."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"109975","DOI":"10.1016\/j.jbiomech.2020.109975","article-title":"Biomechanical function requirements of the wrist. Circumduction versus flexion\/abduction range of motion","volume":"110","author":"Vergara","year":"2020","journal-title":"J. Biomech."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1038\/s41597-019-0175-6","article-title":"Human hand kinematic data during feeding and cooking tasks","volume":"6","author":"Vergara","year":"2019","journal-title":"Sci. Data"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1412","DOI":"10.1109\/TIM.2016.2518360","article-title":"Quantification of the Finger Functional Range via Explicit Descriptions of Reachable Subspaces","volume":"65","author":"Pham","year":"2016","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1016\/j.jos.2018.01.013","article-title":"Functional range of motion in the metacarpophalangeal joints of the hand measured by single axis electric goniometers","volume":"23","author":"Murai","year":"2018","journal-title":"J. Orthop. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.procs.2018.07.008","article-title":"Recognition of Sign Language Alphabets and Numbers based on Hand Kinematics using A Data Glove","volume":"133","author":"Kakoty","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.robot.2016.12.004","article-title":"Teleoperation of the SCHUNK S5FH under-actuated anthropomorphic hand using human hand motion tracking","volume":"89","author":"Cerulo","year":"2017","journal-title":"Robot. Auton. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Bhuyan, M.K., Talukdar, A.K., Gupta, P., and Laskar, R.H. (2020, January 4\u20136). Low Cost Data Glove for Hand Gesture Recognition by Finger Bend Measurement. Proceedings of the 2020 International Conference on Wireless Communications Signal Processing and Networking (WiSPNET), Chennai, India.","DOI":"10.1109\/WiSPNET48689.2020.9198521"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"18","DOI":"10.9758\/cpn.2018.16.1.18","article-title":"From Neurons to Social Beings: Short Review of the Mirror Neuron System Research and Its Socio-Psychological and Psychiatric Implications","volume":"16","author":"Jeon","year":"2018","journal-title":"Clin. Psychopharmacol. Neurosci."},{"key":"ref_21","first-page":"1713","article-title":"Cortical and subcortical connections of parietal and premotor nodes of the monkey hand mirror neuron network","volume":"223","author":"Bruni","year":"2018","journal-title":"Brain Struct. Funct."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Errante, A., and Fogassi, L. (2021). Functional Lateralization of the Mirror Neuron System in Monkey and Humans. Symmetry, 13.","DOI":"10.3390\/sym13010077"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.copsyc.2018.04.001","article-title":"What neuromodulation and lesion studies tell us about the function of the mirror neuron system and embodied cognition","volume":"24","author":"Keysers","year":"2018","journal-title":"Curr. Opin. Psychol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2063","DOI":"10.3389\/fpsyg.2019.02063","article-title":"Language, Gesture, and Emotional Communication: An Embodied View of Social Interaction","volume":"10","year":"2019","journal-title":"Front. Psychol."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Oudah, M., Al-Naji, A., and Chahl, J. (2020). Hand Gesture Recognition Based on Computer Vision: A Review of Techniques. J. Imaging, 6.","DOI":"10.3390\/jimaging6080073"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Brock, H., Sabanovic, S., Nakamura, K., and Gomez, R. (September, January 31). Robust Real-Time Hand Gestural Recognition for Non-Verbal Commu-nication with Tabletop Robot Haru. Proceedings of the 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), Naples, Italy.","DOI":"10.1109\/RO-MAN47096.2020.9223566"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1080\/10447318.2020.1809248","article-title":"Evaluation of a Hybrid of Hand Gesture and Controller Inputs in Virtual Reality","volume":"37","author":"Huang","year":"2021","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/978-981-10-2750-5_3","article-title":"Human Computer Interaction Through Hand Gestures for Home Automation Using Microsoft Kinect","volume":"Volume 508","author":"Modi","year":"2017","journal-title":"Proceedings of International Conference on Communication and Networks"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mahmoud, N.M., Fouad, H., and Soliman, A.M. (2020). Smart healthcare solutions using the internet of medical things for hand gesture recognition system. Complex Intell. Syst., 1\u201312.","DOI":"10.1007\/s40747-020-00194-9"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"826","DOI":"10.1016\/j.tics.2020.07.001","article-title":"All in Good Time: Long-Lasting Postdictive Effects Reveal Discrete Perception","volume":"24","author":"Herzog","year":"2020","journal-title":"Trends Cogn. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1265","DOI":"10.1038\/s41562-020-00946-0","article-title":"A unified account of numerosity perception","volume":"4","author":"Cheyette","year":"2020","journal-title":"Nat. Hum. Behav."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1007\/s12193-020-00333-z","article-title":"Psychophysical comparison of the auditory and tactile perception: A survey","volume":"14","author":"Merchel","year":"2020","journal-title":"J. Multimodal User Interfaces"},{"key":"ref_33","unstructured":"Hanke, T. (2021, May 27). HamNoSys\u2014Representing Sign Language Data in Language Resources and Language Processing Contexts. Available online: https:\/\/d1wqtxts1xzle7.cloudfront.net\/45535382\/HamNoSysRepresenting_sign_language_data_20160511-27828-nq6576.pdf?1462962410=&response-content-disposition=inline%3B+filename%3DHamNoSys_Representing_sign_language_data.pdf&Expires=1622085551&Signature=G0ON~p-8P-Gz9b8zFX4whi~9BrmXHsPNQvPz5rztiVKSPUkIr9FG7o1diSh~MLg0Zup3cmJ3HyzQ6YGoeiPxgXHEj8v~XhWdDAV~21Hb~UB6snazxe00nlMG~k~YY4DcizXSKJ9ZKW498NE3~FEzGrqmKcI1-xs6dJoqLZHmrz9HGgS3AUyJKn8eK-SbdNTBNC7CYsnDDeerHUGP-8EUfNISHNa~k5eBWREKveX~MA3xXkqD7bbGblnK5bO~JStNODqAwsJF~s2MAGA6aAffxUuvd4zahi---~5ijznsPhF0mjOCAVocXSRxBnylHnOEveJlMH-cY3punmlIKjjK6A__&Key-Pair-Id=APKAJLOHF5GGSLRBV4ZA."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Stanlaw, J. (2020). The International Encyclopedia of Linguistic Anthropology, Wiley. [1st ed.].","DOI":"10.1002\/9781118786093"},{"key":"ref_35","unstructured":"Sevilla, A.F.G., Esteban, A.D., and Lahoz-Bengoechea, J.M. (2020, January 11\u201316). Tools for the Use of SignWriting as a Language Resource. Proceedings of the 9th Workshop on the Representation and Processing of Sign Languages, Marseille, France."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"191100","DOI":"10.1098\/rsos.191100","article-title":"Evolutionary dynamics in the dispersal of sign languages","volume":"7","author":"Power","year":"2020","journal-title":"R. Soc. Open Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1007\/s42235-017-0005-5","article-title":"A synthetic framework for evaluating and designing an anthropomorphic prosthetic hand","volume":"15","author":"Jiang","year":"2018","journal-title":"J. Bionic Eng."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Lindworsky, J. (2015). Experimental Psychology, Psychology Press.","DOI":"10.4324\/9781315658162"},{"key":"ref_39","unstructured":"Sawada, T., and Koshmanova, E. (2017). Modifying the Method of Constant Stimuli to Analyze the Perception of a Complex Stimulus, Institute of Practical Psychology and Psychoanalysis."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"15290","DOI":"10.1364\/OE.23.015290","article-title":"Bayesian approach to color-difference models based on threshold and constant-stimuli methods","volume":"23","author":"Brusola","year":"2015","journal-title":"Opt. Express"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.visres.2015.11.005","article-title":"Location and direction specificity in motion direction learning associated with a single-level method of constant stimuli","volume":"119","author":"Xiong","year":"2016","journal-title":"Vis. Res."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Cort\u00e9s-P\u00e9rez, I., Zagalaz-Anula, N., Montoro-C\u00e1rdenas, D., Lomas-Vega, R., Obrero-Gait\u00e1n, E., and Osuna-P\u00e9rez, M. (2021). Leap Motion Controller Video Game-Based Therapy for Upper Extremity Motor Recovery in Patients with Central Nervous System Diseases. A Systematic Review with Meta-Analysis. Sensors, 21.","DOI":"10.3390\/s21062065"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Yeamkuan, S., and Chamnongthai, K. (2021). 3D Point-of-Intention Determination Using a Multimodal Fusion of Hand Pointing and Eye Gaze for a 3D Display. Sensors, 21.","DOI":"10.3390\/s21041155"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Bird, J.J., Ek\u00e1rt, A., and Faria, D.R. (2020). British Sign Language Recognition via Late Fusion of Computer Vision and Leap Motion with Transfer Learning to American Sign Language. Sensors, 20.","DOI":"10.20944\/preprints202008.0209.v1"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Nizamis, K., Rijken, N.H.M., Mendes, A., Janssen, M.M.H.P., Bergsma, A., and Koopman, B.F.J.M. (2018). A Novel Setup and Protocol to Measure the Range of Motion of the Wrist and the Hand. Sensors, 18.","DOI":"10.3390\/s18103230"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2734","DOI":"10.1002\/sim.7679","article-title":"Performance of intraclass correlation coefficient (ICC) as a reliability index under various distributions in scale reliability studies","volume":"37","author":"Mehta","year":"2018","journal-title":"Stat. Med."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1186\/s13018-019-1177-y","article-title":"Minimal detectable difference of the finger and wrist range of motion: Comparison of goniometry and 3D motion analysis","volume":"14","author":"Reissner","year":"2019","journal-title":"J. Orthop. Surg. Res."},{"key":"ref_48","unstructured":"David, H. (2021, May 27). Systems and Methods for Capturing Motion in Three-Dimensional Space. Available online: https:\/\/patents.google.com\/patent\/US8638989B2\/en."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/11\/3735\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:09:07Z","timestamp":1760162947000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/11\/3735"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,27]]},"references-count":48,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["s21113735"],"URL":"https:\/\/doi.org\/10.3390\/s21113735","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,5,27]]}}}