{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T18:14:55Z","timestamp":1763057695110,"version":"3.41.0"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2012,1,1]],"date-time":"2012-01-01T00:00:00Z","timestamp":1325376000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100004895","name":"European Social Fund","doi-asserted-by":"publisher","award":["MICINN BFU2009-08473 and TIN2010-19607"],"award-info":[{"award-number":["MICINN BFU2009-08473 and TIN2010-19607"]}],"id":[{"id":"10.13039\/501100004895","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2012,1]]},"abstract":"<jats:p>Eye movements can be consciously controlled by humans to the extent of performing sequences of predefined movement patterns, or 'gaze gestures'. Gaze gestures can be tracked noninvasively employing a video-based eye tracking system. Gaze gestures hold the potential to become an emerging input paradigm in the context of human-computer interaction (HCI) as low-cost eye trackers become more ubiquitous. The viability of gaze gestures as an innovative way to control a computer rests on how easily they can be assimilated by potential users and also on the ability of machine learning algorithms to discriminate in real time intentional gaze gestures from typical gaze activity performed during standard interaction with electronic devices. In this work, through a set of experiments and user studies, we evaluate the performance of two different gaze gestures modalities, gliding gaze gestures and saccadic gaze gestures, and their corresponding real-time recognition algorithms, Hierarchical Temporal Memory networks and the Needleman-Wunsch algorithm for sequence alignment. Our results show that a specific combination of gaze gesture modality, namely saccadic gaze gestures, and recognition algorithm, Needleman-Wunsch, allows for reliable usage of intentional gaze gestures to interact with a computer with accuracy rates higher than 95% and completion speeds of around 1.5 to 2.5 seconds per gesture. The optimal gaze gesture modality and recognition algorithm do not interfere with otherwise standard human-computer gaze interaction, generating very few false positives during real time recognition and positive feedback from the users. These encouraging results and the low cost eye tracking equipment used, open up a new HCI paradigm for the fields of accessibility and interaction with smartphones, tablets, projected displays and traditional desktop computers.<\/jats:p>","DOI":"10.1145\/2070719.2070723","type":"journal-article","created":{"date-parts":[[2012,6,1]],"date-time":"2012-06-01T15:51:28Z","timestamp":1338565888000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":24,"title":["Gliding and saccadic gaze gesture recognition in real time"],"prefix":"10.1145","volume":"1","author":[{"given":"David","family":"Rozado","sequence":"first","affiliation":[{"name":"Universidad Aut\u00f3noma de Madrid, Spain"}]},{"given":"Javier S.","family":"Agustin","sequence":"additional","affiliation":[{"name":"IT University of Copenhagen, Denmark"}]},{"given":"Francisco B.","family":"Rodriguez","sequence":"additional","affiliation":[{"name":"Universidad Aut\u00f3noma de Madrid, Spain"}]},{"given":"Pablo","family":"Varona","sequence":"additional","affiliation":[{"name":"Universidad Aut\u00f3noma de Madrid, Spain"}]}],"member":"320","published-online":{"date-parts":[[2012,1,13]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-69369-7_13"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1899950.1899984"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409635.1409647"},{"key":"e_1_2_1_4_1","first-page":"1","article-title":"Real time eye tracking and blink detection with usb cameras","volume":"12","author":"Chau M.","year":"2005","unstructured":"Chau , M. and Betke , M. 2005 . Real time eye tracking and blink detection with usb cameras . Boston U. Compu. Sci. 12 , 1 -- 10 . Chau, M. and Betke, M. 2005. Real time eye tracking and blink detection with usb cameras. Boston U. Compu. Sci. 12, 1--10.","journal-title":"Boston U. Compu. Sci."},{"volume-title":"Proceedings of the 11th IFIP TC 13 International Conference on Human-Computer Interaction (INTERACT'07)","author":"Drewes H.","key":"e_1_2_1_6_1","unstructured":"Drewes , H. and Schmidt , A . 2007. Interacting with the computer using gaze gestures . In Proceedings of the 11th IFIP TC 13 International Conference on Human-Computer Interaction (INTERACT'07) . Springer-Verlag, Berlin, 475--488. Drewes, H. and Schmidt, A. 2007. Interacting with the computer using gaze gestures. In Proceedings of the 11th IFIP TC 13 International Conference on Human-Computer Interaction (INTERACT'07). Springer-Verlag, Berlin, 475--488."},{"volume-title":"Eye Tracking Methodology: Theory and Practice","author":"Duchowski A.","key":"e_1_2_1_7_1","unstructured":"Duchowski , A. 2007. Eye Tracking Methodology: Theory and Practice . Springer-Verlag , Berlin, USA. Duchowski, A. 2007. Eye Tracking Methodology: Theory and Practice. Springer-Verlag, Berlin, USA."},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN'05)","volume":"3","author":"George D.","year":"1812","unstructured":"George , D. and Hawkins , J . 2005. A hierarchical bayesian model of invariant pattern recognition in the visual cortex . In Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN'05) . Vol. 3 . 1812 --1817. George, D. and Hawkins, J. 2005. A hierarchical bayesian model of invariant pattern recognition in the visual cortex. In Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN'05). Vol. 3. 1812--1817."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1000532"},{"key":"e_1_2_1_10_1","unstructured":"George D. and Jarosy B. 2007. The HTM learning algorithms. Tech. rep. Numenta.  George D. and Jarosy B. 2007. The HTM learning algorithms. Tech. rep. Numenta."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/5326.923274"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2007.911378"},{"volume-title":"Proceedings of the International Conference on Signal and Image Processing (SIP'00)","author":"Holden E.","key":"e_1_2_1_13_1","unstructured":"Holden , E. , Owens , R. , and Geoffrey , G . 1999. Adaptive fuzzy expert system for sign recognition . In Proceedings of the International Conference on Signal and Image Processing (SIP'00) . Holden, E., Owens, R., and Geoffrey, G. 1999. Adaptive fuzzy expert system for sign recognition. In Proceedings of the International Conference on Signal and Image Processing (SIP'00)."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/355017.355020"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743666.1743740"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/123078.128728"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1117309.1117350"},{"key":"e_1_2_1_18_1","first-page":"2","article-title":"Dasher - an efficient keyboard alternative","volume":"3","author":"Mackay D.","year":"2003","unstructured":"Mackay , D. 2003 . Dasher - an efficient keyboard alternative . Adv. Clin. Newr. Rehab. 3 , 2 , 24. Mackay, D. 2003. Dasher - an efficient keyboard alternative. Adv. Clin. Newr. Rehab. 3, 2, 24.","journal-title":"Adv. Clin. Newr. Rehab."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1520340.1520699"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743666.1743710"},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1--8.","author":"Morency L.-P.","key":"e_1_2_1_22_1","unstructured":"Morency , L.-P. , Quattoni , A. , and Darrell , T . 2007. Latent-dynamic discriminative models for continuous gesture recognition . Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1--8. Morency, L.-P., Quattoni, A., and Darrell, T. 2007. Latent-dynamic discriminative models for continuous gesture recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1--8."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/0022-2836(70)90057-4"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/0001-6918(75)90020-7"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1055004"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1113\/jphysiol.1965.sp007718"},{"key":"e_1_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Rozado D. Rodriguez F. and \n      Varona P\n  . \n  2010\n  . Optimizing hierarchical temporal memory for multivariable time series. In Proceedings of the International Conference on Artificial Neural Networks (ICANN'10). K. Diamantaras W. Duch and L. Iliadis Eds. Lecture Notes in Computer Science vol. \n  6353\n  . \n  Springer Berlin 506--518.   Rozado D. Rodriguez F. and Varona P. 2010. Optimizing hierarchical temporal memory for multivariable time series. In Proceedings of the International Conference on Artificial Neural Networks (ICANN'10). K. Diamantaras W. Duch and L. Iliadis Eds. Lecture Notes in Computer Science vol. 6353. Springer Berlin 506--518.","DOI":"10.1007\/978-3-642-15822-3_62"},{"key":"e_1_2_1_28_1","volume-title":"Eds. Lecture Notes in Computer Science","volume":"6691","author":"Rozado D.","unstructured":"Rozado , D. , Rodriguez , F. , and Varona , P . 2011. Gaze gesture recognition with hierarchical temporal memory networks. In Advances in Computational Intelligence, J. Cabestany, I. Rojas, and G. Joya , Eds. Lecture Notes in Computer Science , vol. 6691 . Springer Berlin, 1--8. Rozado, D., Rodriguez, F., and Varona, P. 2011. Gaze gesture recognition with hierarchical temporal memory networks. In Advances in Computational Intelligence, J. Cabestany, I. Rojas, and G. Joya, Eds. Lecture Notes in Computer Science, vol. 6691. Springer Berlin, 1--8."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743666.1743685"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/238386.238619"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1038\/418838a"},{"volume-title":"Proceedings of the 3rd Conference on Communication by Gaze Interaction (COGAIN'07)","author":"Wobbrock J.","key":"e_1_2_1_33_1","unstructured":"Wobbrock , J. , Rubinstein , J. , Sawyer , M. , and Duchowski , A . 2007. Gaze-based creativity not typing but writing: Eye-based text entry using letter-like gestures . In Proceedings of the 3rd Conference on Communication by Gaze Interaction (COGAIN'07) . Wobbrock, J., Rubinstein, J., Sawyer, M., and Duchowski, A. 2007. Gaze-based creativity not typing but writing: Eye-based text entry using letter-like gestures. In Proceedings of the 3rd Conference on Communication by Gaze Interaction (COGAIN'07)."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1344471.1344475"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2070719.2070723","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2070719.2070723","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T10:06:25Z","timestamp":1750241185000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2070719.2070723"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,1]]},"references-count":31,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2012,1]]}},"alternative-id":["10.1145\/2070719.2070723"],"URL":"https:\/\/doi.org\/10.1145\/2070719.2070723","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"type":"print","value":"2160-6455"},{"type":"electronic","value":"2160-6463"}],"subject":[],"published":{"date-parts":[[2012,1]]},"assertion":[{"value":"2010-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-01-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}