{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T22:46:29Z","timestamp":1769208389582,"version":"3.49.0"},"reference-count":79,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2019,3,1]],"date-time":"2019-03-01T00:00:00Z","timestamp":1551398400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2019,3,31]]},"abstract":"<jats:p>Recent trends in computer-mediated communication (CMC) have not only led to expanded instant messaging through the use of images and videos but have also expanded traditional text messaging with richer content in the form of visual communication markers (VCMs) such as emoticons, emojis, and stickers. VCMs could prevent a potential loss of subtle emotional conversation in CMC, which is delivered by nonverbal cues that convey affective and emotional information. However, as the number of VCMs grows in the selection set, the problem of VCM entry needs to be addressed. Furthermore, conventional means of accessing VCMs continue to rely on input entry methods that are not directly and intimately tied to expressive nonverbal cues. In this work, we aim to address this issue by facilitating the use of an alternative form of VCM entry: hand gestures. To that end, we propose a user-defined hand gesture set that is highly representative of a number of VCMs and a two-stage hand gesture recognition system (trajectory-based, shape-based) that can identify these user-defined hand gestures with an accuracy of 82%. By developing such a system, we aim to allow people using low-bandwidth forms of CMCs to still enjoy their convenient and discreet properties while also allowing them to experience more of the intimacy and expressiveness of higher-bandwidth online communication.<\/jats:p>","DOI":"10.1145\/3297277","type":"journal-article","created":{"date-parts":[[2019,3,4]],"date-time":"2019-03-04T13:31:47Z","timestamp":1551706307000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":23,"title":["Developing a Hand Gesture Recognition System for Mapping Symbolic Hand Gestures to Analogous Emojis in Computer-Mediated Communication"],"prefix":"10.1145","volume":"9","author":[{"given":"Jung In","family":"Koh","sequence":"first","affiliation":[{"name":"Texas A8M University, College Station, TX"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Josh","family":"Cherian","sequence":"additional","affiliation":[{"name":"Texas A8M University, College Station, TX"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul","family":"Taele","sequence":"additional","affiliation":[{"name":"Texas A8M University, College Station, TX"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tracy","family":"Hammond","sequence":"additional","affiliation":[{"name":"Texas A8M University, College Station, TX"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,3]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"2013 IEEE Conference on Information Communication Technologies (ICT\u201913)","author":"Agrawal A."},{"key":"e_1_2_1_2_1","unstructured":"Apple. 2017. Use Animoji on your iPhone X and iPad Pro. Retrieved on February 2 2019 from https:\/\/support.apple.com\/en-us\/HT208190.  Apple. 2017. Use Animoji on your iPhone X and iPad Pro. Retrieved on February 2 2019 from https:\/\/support.apple.com\/en-us\/HT208190."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/159544.159562"},{"key":"e_1_2_1_4_1","volume-title":"IEEE Conference on Cybernetics and Intelligent Systems (CIS\u201906)","author":"Bhuyan M. K."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-014-0165-0"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/524467.796046"},{"key":"e_1_2_1_7_1","unstructured":"Mona Chalabi. 2014. The 100 Most-Used Emojis. Web. Retrieved on August 8 2015 from http:\/\/fivethirtyeight.com\/datalab\/the-100-most-used-emojis\/.  Mona Chalabi. 2014. The 100 Most-Used Emojis. Web. Retrieved on August 8 2015 from http:\/\/fivethirtyeight.com\/datalab\/the-100-most-used-emojis\/."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5121\/ijcses.2011.2109"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2935334.2935370"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.4304\/jnw.6.5.697-704"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053086"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/964442.964493"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1125451.1125601"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2628363.2633576"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/FGR.2006.101"},{"key":"e_1_2_1_16_1","volume-title":"International Conference on Emerging Trends in Communication, Control, Signal Processing 8 Computing Applications (C2SPCA\u201913)","author":"Geetha M."},{"key":"e_1_2_1_17_1","unstructured":"Karissa Giuliano. 2015. This is the most-used emoji on Instagram. Web. Retrieved on August 8 2015 from http:\/\/www.cnbc.com\/2015\/06\/05\/this-is-the-most-used-emoji-on-instagram.html.  Karissa Giuliano. 2015. This is the most-used emoji on Instagram. Web. Retrieved on August 8 2015 from http:\/\/www.cnbc.com\/2015\/06\/05\/this-is-the-most-used-emoji-on-instagram.html."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctv1w9m9ds"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.0963-7214.2006.00402.x"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1656274.1656278"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-5104"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557215"},{"key":"e_1_2_1_23_1","volume-title":"IEEE 2nd International Conference on Software Engineering and Service Science (ICSESS\u201911)","author":"He Guan-Feng","year":"2011"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CIT.2012.62"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07863-2_38"},{"key":"e_1_2_1_26_1","first-page":"1","article-title":"Real-time hand gesture recognition using finger segmentation","volume":"2014","author":"Kim Jung-Tae","year":"2014","journal-title":"The Scientific World Journal"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.im.2008.07.001"},{"key":"e_1_2_1_28_1","unstructured":"iEmoji. 2010. Most popular emoji. Retrieved on February 2 2019 from http:\/\/www.iemoji.com\/popular\/emoji.  iEmoji. 2010. Most popular emoji. Retrieved on February 2 2019 from http:\/\/www.iemoji.com\/popular\/emoji."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2013.6525608"},{"key":"e_1_2_1_30_1","unstructured":"Jeff Johnson. 2013. Designing with the Mind in Mind: Simple Guide to Understanding User Interface Design Guidelines. Elsevier Waltham MA.   Jeff Johnson. 2013. Designing with the Mind in Mind: Simple Guide to Understanding User Interface Design Guidelines. Elsevier Waltham MA."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0065-2601(08)60241-5"},{"key":"e_1_2_1_32_1","volume-title":"2013 IEEE Symposium on 3D User Interfaces (3DUI\u201913)","author":"Kulshreshth A."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2957265.2961858"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.18297\/etd\/823"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/JETCAS.2013.2256830"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327957PSPR0401_6"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2003.09.007"},{"key":"e_1_2_1_39_1","unstructured":"David McNeill. 2008. Gesture and Thought. University of Chicago Press Chicago IL.  David McNeill. 2008. Gesture and Thought. University of Chicago Press Chicago IL."},{"key":"e_1_2_1_40_1","volume-title":"Web. Retrieved","year":"2018"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1056808.1056994"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-06932-6_35"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207785"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124900"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2559206.2581347"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2935334.2935382"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557198"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/CIMSim.2011.51"},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the 5th Eurographics Conference on Sketch-Based Interfaces and Modeling (SBM\u201911)","author":"Rajan Pankaj","year":"2008"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the Workshop on Sketch Recognition at the 14th International Conference of Intelligent User Interfaces Posters (IUI). ACM, Sanibel (IUI\u201909)","author":"Rajan Pankaj","year":"2009"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the 16th International Conference on Distributed Multimedia Systems (DMS\u201910)","author":"Rajan Pankaj","year":"2010"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/STSIVA.2012.6340575"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.protcy.2012.05.095"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2013.2246148"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/257089.257180"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/985921.986052"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/127719.122753"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2011.11.004"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197231.3197259"},{"key":"e_1_2_1_60_1","article-title":"The effects of text, audio, video, and in-person communication on bonding between friends. Cyberpsychology","volume":"7","author":"Sherman Lauren E.","year":"2013","journal-title":"Journal of Psychosocial Research on Cyberspace"},{"key":"e_1_2_1_61_1","volume-title":"Human Interface and the Management of Information. Interacting in Information Environments","author":"Shin Heesook"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-016-2525-z"},{"key":"e_1_2_1_63_1","volume-title":"Say It With Stickers. Retrieved on","author":"Tabuchi Hiroko","year":"2014"},{"key":"e_1_2_1_64_1","volume-title":"Smart Graphics (SG\u201915)","author":"Taele Paul"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2449396.2449427"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/2957265.2961844"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2011.2172450"},{"key":"e_1_2_1_68_1","volume-title":"17th International Conference on Systems, Signals and Image Processing (IWSSIP\u201910)","author":"Thiago"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/2030112.2030114"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.4018\/ijmdem.2014010102"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/1897816.1897838"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1177\/089443930101900307"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/985921.986016"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557060"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1109\/HAVE.2012.6374441"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/1056808.1057043"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-014-0039-4"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/1125451.1125737"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/357994.358023"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2014.6889481"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3297277","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3297277","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:02:14Z","timestamp":1750208534000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3297277"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3]]},"references-count":79,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,3,31]]}},"alternative-id":["10.1145\/3297277"],"URL":"https:\/\/doi.org\/10.1145\/3297277","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3]]},"assertion":[{"value":"2018-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}