{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T00:23:37Z","timestamp":1781310217593,"version":"3.54.1"},"reference-count":47,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2019,7,23]],"date-time":"2019-07-23T00:00:00Z","timestamp":1563840000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Ambient Intelligence and Smart Environments"],"published-print":{"date-parts":[[2019,7,23]]},"abstract":"<jats:p>This paper reports on work that explores natural gesture inputs from end-users for television use in a typical living room setting. First, we derive a set of 19 user-defined freehand gestures for regular TV control tasks. This study helps us to determine the gestures preferred by TV viewers and reduce the risk of developing an unusable, ineffective system. Then, based on this user-defined gesture set, we propose a unified framework to address specific problems in a complex real-world TV viewing environment, including 1)\u00a0the automatic exclusion of many meaningless daily actions by TV viewers, 2)\u00a0the capability to recognize both static and dynamic gestures simultaneously, as well as one- and two-handed gestures simultaneously, and 3)\u00a0the continuous recognition of multiple dynamic gestures in the air (e.g., a channel switching gesture for channel 127). Experimental results show that our approach allows users to interact with TV-based applications more flexibly and effectively, with improved user experience and user satisfaction. Finally, we highlight the implications of our work for the design and development of related freehand gesture applications.<\/jats:p>","DOI":"10.3233\/ais-190528","type":"journal-article","created":{"date-parts":[[2019,7,23]],"date-time":"2019-07-23T13:36:52Z","timestamp":1563889012000},"page":"335-354","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":15,"title":["Beyond remote control: Exploring natural gesture inputs for smart TV systems"],"prefix":"10.1177","volume":"11","author":[{"given":"Huiyue","family":"Wu","sequence":"first","affiliation":[{"name":"Sun Yat-sen University","place":["China"]},{"name":"Guangdong Key Laboratory for Big Data Analysis and Simulation of Public Opinion","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liuqingqing","family":"Yang","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shengqian","family":"Fu","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaolong (Luke)","family":"Zhang","sequence":"additional","affiliation":[{"name":"Pennsylvania State University","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2019,7,23]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"crossref","unstructured":"A.\u00a0Aly and A.\u00a0Tapus Prosody-based adaptive metaphoric head and arm gestures synthesis in human\u2013robot interaction in: International Conference on Advanced Robotics 2014 pp.\u00a01\u20138.","DOI":"10.1109\/ICAR.2013.6766507"},{"key":"e_1_3_2_3_2","doi-asserted-by":"crossref","unstructured":"M.\u00a0Brand N.\u00a0Oliver and A.\u00a0Pentland Coupled hidden Markov models for complex action recognition in: IEEE Int Conf on Computer Vision and Pattern Recognition Tokyo 1997 pp.\u00a0994\u2013999.","DOI":"10.1109\/CVPR.1997.609450"},{"key":"e_1_3_2_4_2","doi-asserted-by":"crossref","unstructured":"M.C.\u00a0Cabral C.H.\u00a0Morimoto and M.K.\u00a0Zuffo On the usability of gesture interfaces in virtual reality environments in: Proceedings of the 2005 Latin America Conference on Human\u2013Computer Interaction 2005 pp.\u00a0100\u2013108.","DOI":"10.1145\/1111360.1111370"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2015.2469551"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/34.1000236"},{"key":"e_1_3_2_7_2","unstructured":"M.\u00a0Elmezain A.\u00a0Al-Hamadi J.\u00a0Appenrodt and B.\u00a0Michaelis Real-time capable system for hand gesture recognition using hidden Markov models in stereo color image sequences British Journal of Dermatology 144(2) (2008) 424."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-010-0452-z"},{"key":"e_1_3_2_9_2","unstructured":"W.T.\u00a0Freeman and C.\u00a0Weissman Television control by hand gestures in: Proceedings of IEEE International Workshop on Automatic Face and Gesture Recognition 1995."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/32206.32212"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1069362752"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2013.2265378"},{"key":"e_1_3_2_13_2","doi-asserted-by":"crossref","unstructured":"O.\u00a0Hilliges S.\u00a0Izadi A.D.\u00a0Wilson S.\u00a0Hodges A.G.\u00a0Mendoza and A.\u00a0Butz Interactions in the air: Adding further depth to interactive tabletops in: Proceedings of the ACM Symposium of User Interface Software and Technology (UIST\u2019 09) 2009 pp.\u00a0139\u2013148.","DOI":"10.1145\/1622176.1622203"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/1039539.1039568"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.3233\/AIS-160383"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1177\/154193120304700427"},{"key":"e_1_3_2_17_2","doi-asserted-by":"crossref","unstructured":"M.\u00a0K\u00f6lsch M.\u00a0Turk and T.\u00a0H\u00f6llerer Vision-based interfaces for mobility in: Proceedings of IEEE International Conference on Mobile and Ubiquitous Systems (Mobiquitous\u201904) 2004 pp.\u00a086\u201394.","DOI":"10.1109\/MOBIQ.2004.1331713"},{"key":"e_1_3_2_18_2","doi-asserted-by":"crossref","unstructured":"P.O.\u00a0Kristensson T.F.W.\u00a0Nicholson and A.\u00a0Quigley Continuous recognition of one-handed and two-handed gestures using 3D full-body motion tracking sensors in: Proceedings of the 17th International Conference on Intelligent User Interfaces (IUI\u201912) 2012 pp.\u00a089\u201392.","DOI":"10.1145\/2166966.2166983"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2011.04.005"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2016.12.004"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/34.799904"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2013.11.007"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCOM.1980.1094577"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-011-0240-2"},{"key":"e_1_3_2_25_2","doi-asserted-by":"crossref","unstructured":"Z.Y.\u00a0Mo J.P.\u00a0Lewis and U.\u00a0Neumann SmartCanvas: A gesture-driven intelligent drawing desk in: Proc. IUI 2005 ACM Press 2005 pp.\u00a0239\u2013243.","DOI":"10.1145\/1040830.1040881"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/2591689"},{"key":"e_1_3_2_27_2","unstructured":"M.R.\u00a0Morris J.O.\u00a0Wobbrock and A.D.\u00a0Wilson Understanding users\u2019 preferences for surface gestures in: GI\u201910 2010 pp.\u00a0261\u2013268."},{"key":"e_1_3_2_28_2","doi-asserted-by":"crossref","unstructured":"M.\u00a0Nielsen M.\u00a0St\u00f6rring T.\u00a0Moeslund and E.A.\u00a0Granum Procedure for developing intuitive and ergonomic gesture interfaces for HCI in: GW 2003 pp.\u00a0409\u2013420.","DOI":"10.1007\/978-3-540-24598-8_38"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-014-0921-x"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-012-9356-9"},{"key":"e_1_3_2_31_2","doi-asserted-by":"crossref","unstructured":"Z.\u00a0Ren J.S.\u00a0Yuan and Z.Y.\u00a0Zhang Robust hand gesture recognition based on finger-earth movers distance with a commodity depth camera in: ACM International Conference on Multimedia 2013 pp.\u00a01093\u20131096.","DOI":"10.1145\/2072298.2071946"},{"key":"e_1_3_2_32_2","doi-asserted-by":"crossref","unstructured":"J.\u00a0Ruiz Y.\u00a0Li and E.\u00a0Lank User-defined motion gestures for mobile interaction in: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI\u201911) 2011 pp.\u00a0197\u2013206.","DOI":"10.1145\/1978942.1978971"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-011-0870-6"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","unstructured":"R.D.\u00a0Vatavu User-defined gestures for free-hand TV control in: Proceedings of the 10th European Conference on Interactive TV and Video (EuroITV\u201912) 2012 pp.\u00a045\u201348. doi:10.1145\/2325616.2325626.","DOI":"10.1145\/2325616.2325626"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.3233\/AIS-130200"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1967.1054010"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.3233\/AIS-150325"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","unstructured":"J.O.\u00a0Wobbrock M.R.\u00a0Morris and A.D.\u00a0Wilson User-defined gestures for surface computing in: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI\u2019 09) 2009 pp.\u00a01083\u20131092. doi:10.1145\/1518701.1518866.","DOI":"10.1145\/1518701.1518866"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","unstructured":"J.O.\u00a0Wobbrock A.D.\u00a0Wilson and Y.\u00a0Li Gestures without libraries toolkits or training: A $1 recognizer for user interface prototypes in: Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST\u201907) 2007 pp.\u00a0159\u2013168. doi:10.1145\/1294211.1294238.","DOI":"10.1145\/1294211.1294238"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-014-2323-5"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-014-1060-0"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-015-1147-2"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2006.889491"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.172"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(00)00096-0"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-015-0863-y"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF01210504"},{"issue":"12","key":"e_1_3_2_48_2","first-page":"2130","article-title":"Hand gesture recognition based on structure analysis","volume":"29","author":"Zhu J.Y.","year":"2006","unstructured":"J.Y.\u00a0Zhu, X.Y.\u00a0Wang, W.X.\u00a0Wang and G.Z.\u00a0Dai, Hand gesture recognition based on structure analysis, Chinese Journal of Computers 29(12) (2006), 2130\u20132137.","journal-title":"Chinese Journal of Computers"}],"container-title":["Journal of Ambient Intelligence and Smart Environments"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/AIS-190528","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/AIS-190528","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/AIS-190528","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T09:18:47Z","timestamp":1777367927000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/AIS-190528"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,23]]},"references-count":47,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019,7,23]]}},"alternative-id":["10.3233\/AIS-190528"],"URL":"https:\/\/doi.org\/10.3233\/ais-190528","relation":{},"ISSN":["1876-1364","1876-1372"],"issn-type":[{"value":"1876-1364","type":"print"},{"value":"1876-1372","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,23]]}}}