{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T15:19:21Z","timestamp":1761059961214,"version":"build-2065373602"},"reference-count":25,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2015,7,9]],"date-time":"2015-07-09T00:00:00Z","timestamp":1436400000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Touchscreen interaction has become a fundamental means of controlling mobile phones and smartwatches. However, the small form factor of a smartwatch limits the available interactive surface area. To overcome this limitation, we propose the expansion of the touch region of the screen to the back of the user\u2019s hand. We developed a touch module for sensing the touched finger position on the back of the hand using infrared (IR) line image sensors, based on the calibrated IR intensity and the maximum intensity region of an IR array. For complete touch-sensing solution, a gyroscope installed in the smartwatch is used to read the wrist gestures. The gyroscope incorporates a dynamic time warping gesture recognition algorithm for eliminating unintended touch inputs during the free motion of the wrist while wearing the smartwatch. The prototype of the developed sensing module was implemented in a commercial smartwatch, and it was confirmed that the sensed positional information of the finger when it was used to touch the back of the hand could be used to control the smartwatch graphical user interface. Our system not only affords a novel experience for smartwatch users, but also provides a basis for developing other useful interfaces.<\/jats:p>","DOI":"10.3390\/s150716642","type":"journal-article","created":{"date-parts":[[2015,7,10]],"date-time":"2015-07-10T02:02:23Z","timestamp":1436493743000},"page":"16642-16653","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Expansion of Smartwatch Touch Interface from Touchscreen to Around Device Interface Using Infrared Line Image Sensors"],"prefix":"10.3390","volume":"15","author":[{"given":"Soo-Chul","family":"Lim","sequence":"first","affiliation":[{"name":"Device & System Research Center, Samsung Advanced Institute of Technology, 130 Samsung-ro, Yeongtong-gu, Suwon-si, Gyeonggi-do 443-803, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jungsoon","family":"Shin","sequence":"additional","affiliation":[{"name":"Device & System Research Center, Samsung Advanced Institute of Technology, 130 Samsung-ro, Yeongtong-gu, Suwon-si, Gyeonggi-do 443-803, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Seung-Chan","family":"Kim","sequence":"additional","affiliation":[{"name":"Device & System Research Center, Samsung Advanced Institute of Technology, 130 Samsung-ro, Yeongtong-gu, Suwon-si, Gyeonggi-do 443-803, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joonah","family":"Park","sequence":"additional","affiliation":[{"name":"Device & System Research Center, Samsung Advanced Institute of Technology, 130 Samsung-ro, Yeongtong-gu, Suwon-si, Gyeonggi-do 443-803, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2015,7,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1145\/2629633","article-title":"Wearables: Has the age of smartwatches finally arrived?","volume":"58","author":"Rawassizadeh","year":"2014","journal-title":"Commun. ACM"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1109\/MPRV.2014.77","article-title":"Text input on a smart watch","volume":"13","author":"Komninos","year":"2014","journal-title":"IEEE Pervasive Comput."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Profita, H.P., Clawson, J., Gilliland, S., Zeagler, C., Starner, T., Budd, J., and Do, E.Y.-L. (2013, January 9\u201312). Don\u2019t mind me touching my wrist: A case study of interacting with on-body technology in public. Proceedings of the 2013 International Symposium on Wearable Computers, Zurich, Switzerland.","DOI":"10.1145\/2493988.2494331"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1145\/1978542.1978564","article-title":"Skinput: Appropriating the skin as an interactive canvas","volume":"54","author":"Harrison","year":"2011","journal-title":"Commun. ACM"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Laput, G., Xiao, R., Chen, X.A., Hudson, S.E., and Harrison, C. (2014, January 5\u20138). Skin buttons: Cheap, small, low-powered and clickable fixed-icon laser projectors. Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, Honolulu, HI, USA.","DOI":"10.1145\/2642918.2647356"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kratz, S., and Rohs, M. (2009, January 15\u201318). Hoverflow: Expanding the design space of around-device interaction. Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, Bonn, Germany.","DOI":"10.1145\/1613858.1613912"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Nakatsuma, K., Shinoda, H., Makino, Y., Sato, K., and Maeno, T. (2011, January 7\u201311). Touch interface on back of the hand. Proceedings of the ACM SIGGRAPH 2011 Emerging Technologies, Vancouver, BC, Canada.","DOI":"10.1145\/2048259.2048278"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Butler, A., Izadi, S., and Hodges, S. (2008, January 19\u201322). Sidesight: Multi-\u201ctouch\u201d interaction around small devices. Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology, Monterey, CA, USA.","DOI":"10.1145\/1449715.1449746"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xu, C., Pathak, P.H., and Mohapatra, P. (2015, January 12\u201313). Finger-writing with smartwatch: A case for finger and hand gesture recognition using smartwatch. Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications, Santa Fe, NM, USA.","DOI":"10.1145\/2699343.2699350"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Song, J., S\u00f6r\u00f6s, G., Pece, F., Fanello, S.R., Izadi, S., Keskin, C., and Hilliges, O. (2014, January 5\u20138). In-air gestures around unmodified mobile devices. Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, Honolulu, HI, USA.","DOI":"10.1145\/2642918.2647373"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Knibbe, J., Seah, S.A., and Fraser, M. (2015). Videohandles: Searching through action camera videos by replicating hand gestures. Comput. Graph., 48.","DOI":"10.1016\/j.cag.2015.01.004"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"912","DOI":"10.1016\/j.patrec.2013.02.004","article-title":"Experiencing real 3D gestural interaction with mobile devices","volume":"34","author":"Yousefi","year":"2013","journal-title":"Pattern Recognit. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"11842","DOI":"10.3390\/s130911842","article-title":"Human-computer interaction based on hand gestures using RGB-D sensors","volume":"13","author":"Palacios","year":"2013","journal-title":"Sensors"},{"key":"ref_14","unstructured":"Kondori, F.A., Yousefi, S., Kouma, J.-P., Liu, L., and Li, H. (2015). Direct hand pose estimation for immersive gestural interaction. Pattern Recognit. Lett., in press."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"135","DOI":"10.3390\/s150100135","article-title":"Sign language recognition with the Kinect sensor based on conditional random fields","volume":"15","author":"Yang","year":"2014","journal-title":"Sensors"},{"key":"ref_16","unstructured":"Kim, D., Hilliges, O., Izadi, S., Butler, A.D., Chen, J., Oikonomidis, I., and Olivier, P. (2012, January 7\u201310). Digits: Freehand 3D interactions anywhere using a wrist-worn gloveless sensor. Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, Cambridge, MA, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Liang, R.-H., Lin, S.-Y., Su, C.-H., Cheng, K.-Y., Chen, B.-Y., and Yang, D.-N. (2011, January 13\u201315). Sonarwatch: Appropriating the forearm as a slider bar. SIGGRAPH Asia 2011 Emerging Technologies, Hong Kong, China.","DOI":"10.1145\/2073370.2073374"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lin, S.-Y., Su, C.-H., Cheng, K.-Y., Liang, R.-H., Kuo, T.-H., and Chen, B.-Y. (2011, January 16\u201319). PUB\u2014Point upon body: Exploring eyes-free interaction and methods on an arm. Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, Santa Barbara, CA, USA.","DOI":"10.1145\/2047196.2047259"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ketabdar, H., Yuksel, K.A., and Roshandel, M. (2010, January 7\u201310). Magitact: Interaction with mobile devices based on compass (magnetic) sensor. Proceedings of the 15th International Conference on Intelligent User Interfaces, Hong Kong, China.","DOI":"10.1145\/1719970.1720048"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"5775","DOI":"10.3390\/s120505775","article-title":"Magic ring: A finger-worn device for multiple appliances control using static finger gestures","volume":"12","author":"Jing","year":"2012","journal-title":"Sensors"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"394","DOI":"10.3390\/s150100394","article-title":"A real-time pinch-to-zoom motion detection by means of a surface EMG-based human-computer interface","volume":"15","author":"Kim","year":"2014","journal-title":"Sensors"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Kim, J., Jiasheng, H., Lyons, K., and Starner, T. (2007, January 11\u201313). The gesture watch: A wireless contact-free gesture based wrist interface. Proceedings of the 11th IEEE International Symposium on Wearable Computers, Boston, MA, USA.","DOI":"10.1109\/ISWC.2007.4373770"},{"key":"ref_23","unstructured":"Howard, B., and Howard, S. (2001, January 8\u20139). Lightglove: Wrist-worn virtual typing and pointing. Proceedings of the 5th IEEE International Symposium on Wearable Computers, Zurich, Switzerland."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1007\/s10115-004-0154-9","article-title":"Exact indexing of dynamic time warping","volume":"7","author":"Keogh","year":"2005","journal-title":"Knowl. Inf. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/TASSP.1978.1163055","article-title":"Dynamic programming algorithm optimization for spoken word recognition","volume":"26","author":"Hiroaki","year":"1978","journal-title":"IEEE Trans. Acoust. Speech Signal Process."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/7\/16642\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:48:57Z","timestamp":1760215737000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/7\/16642"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,7,9]]},"references-count":25,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2015,7]]}},"alternative-id":["s150716642"],"URL":"https:\/\/doi.org\/10.3390\/s150716642","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2015,7,9]]}}}