{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:32:45Z","timestamp":1750307565923,"version":"3.41.0"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2010,3,1]],"date-time":"2010-03-01T00:00:00Z","timestamp":1267401600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2010,3]]},"abstract":"<jats:p>This study is to investigate the fundamental problems of, (1) facial feature detection and localization, especially eye features; and (2) eye dynamics, including tracking and blink detection. We first describe our contribution to eye localization. Following that, we discuss a simultaneous eye tracking and blink detection system. Facial feature detection is solved in a general object detection framework and its performance for eye localization is presented. A binary tree representation based on feature dependency partitions the object feature space in a coarse to fine manner. In each compact feature subspace, independent component analysis (ICA) is used to get the independent sources, whose probability density functions (PDFs) are modeled by Gaussian mixtures. When applying this representation for the task of eye detection, a subwindow is used to scan the entire image and each obtained image patch is examined using Bayesian criteria to determine the presence of an eye subject. After the eyes are automatically located with binary tree-based probability learning, interactive particle filters are used for simultaneously tracking the eyes and detecting the blinks. The particle filters use classification-based observation models, in which the posterior probabilities are evaluated by logistic regressions in tensor subspaces. Extensive experiments are used to evaluate the performance from two aspects, (1) blink detection rate and the accuracy of blink duration in terms of the frame numbers; (2) eye tracking accuracy. We also present an experimental setup for obtaining the benchmark data in tracking accuracy evaluation. The experimental evaluation demonstrates the capability of this approach.<\/jats:p>","DOI":"10.1145\/1671962.1671964","type":"journal-article","created":{"date-parts":[[2010,3,19]],"date-time":"2010-03-19T19:22:47Z","timestamp":1269026567000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["An eye localization, tracking and blink pattern recognition system"],"prefix":"10.1145","volume":"6","author":[{"given":"Junwen","family":"Wu","sequence":"first","affiliation":[{"name":"University of California, San Diego, La Jolla, CA"}]},{"given":"Mohan M.","family":"Trivedi","sequence":"additional","affiliation":[{"name":"University of California, San Diego, La Jolla, CA"}]}],"member":"320","published-online":{"date-parts":[[2010,3,23]]},"reference":[{"volume-title":"Proceedings of the European Conference on Computer Vision.","author":"Alex M.","key":"e_1_2_1_1_1","unstructured":"Alex , M. , Vasilescu , O. , and Terzopoulos , D . 2002. Multilinear analysis of image ensembles: Tensorfaces . In Proceedings of the European Conference on Computer Vision. Alex, M., Vasilescu, O., and Terzopoulos, D. 2002. Multilinear analysis of image ensembles: Tensorfaces. In Proceedings of the European Conference on Computer Vision."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1995.7.6.1129"},{"volume-title":"Adaptive Control Processes","author":"Bellman R. E.","key":"e_1_2_1_3_1","unstructured":"Bellman , R. E. 1961. Adaptive Control Processes . Princeton University Press . Bellman, R. E. 1961. Adaptive Control Processes. Princeton University Press."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2004.842254"},{"key":"e_1_2_1_5_1","first-page":"2005","article-title":"Real time eye tracking and blink detection with USB cameras","author":"Chau M.","year":"2005","unstructured":"Chau , M. and Betke , M. 2005 . Real time eye tracking and blink detection with USB cameras . Tech. Rep. Boston University Computer Science , 2005 - 2012 . Chau, M. and Betke, M. 2005. Real time eye tracking and blink detection with USB cameras. Tech. Rep. Boston University Computer Science, 2005-12.","journal-title":"Tech. Rep. Boston University Computer Science"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03195519"},{"key":"e_1_2_1_7_1","unstructured":"Duda R. Hart P. and Stork D. 2000. Pattern Classification (2nd ed.). Wiley Interscience.   Duda R. Hart P. and Stork D. 2000. Pattern Classification (2nd ed.). Wiley Interscience."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2003.1200722"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1314303.1314304"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the International Association of Science and Technology for Development (IASTED) Conference on Visualization, Imaging and Image Processing (VIIP).","author":"Gorodnichy D.","year":"2003","unstructured":"Gorodnichy , D. 2003 . Second order change detection, and its application to blink-controlled perceptual interfaces . In Proceedings of the International Association of Science and Technology for Development (IASTED) Conference on Visualization, Imaging and Image Processing (VIIP). Gorodnichy, D. 2003. Second order change detection, and its application to blink-controlled perceptual interfaces. In Proceedings of the International Association of Science and Technology for Development (IASTED) Conference on Visualization, Imaging and Image Processing (VIIP)."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10209-003-0062-x"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11222-006-6966-6"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/78.978396"},{"volume-title":"Proceedings of the Conference on Neural Information Processing Systems (NIPS).","author":"He X.","key":"e_1_2_1_14_1","unstructured":"He , X. , Cai , D. , and Niyogi , P . 2005a. Tensor subspace analysis . In Proceedings of the Conference on Neural Information Processing Systems (NIPS). He, X., Cai, D., and Niyogi, P. 2005a. Tensor subspace analysis. In Proceedings of the Conference on Neural Information Processing Systems (NIPS)."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2005.55"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.1000242"},{"volume-title":"Proceedings of the 4th IEEE International Workshop on Applications and Science of Soft Computing.","author":"Huang K.","key":"e_1_2_1_17_1","unstructured":"Huang , K. and Trivedi , M. M . 2001. Networked omnivision arrays for intelligent environment . In Proceedings of the 4th IEEE International Workshop on Applications and Science of Soft Computing. Huang, K. and Trivedi, M. M. 2001. Networked omnivision arrays for intelligent environment. In Proceedings of the 4th IEEE International Workshop on Applications and Science of Soft Computing."},{"volume-title":"Proceedings of the 1st International Workshop on In-Vehicle Cognitive Computer Vision Systems, in Conjunction with the 3rd International Conference on Computer Vision Systems.","author":"Huang K.","key":"e_1_2_1_18_1","unstructured":"Huang , K. and Trivedi , M. M . 2003. Driver head pose and view estimation with single omnidirectional video stream . In Proceedings of the 1st International Workshop on In-Vehicle Cognitive Computer Vision Systems, in Conjunction with the 3rd International Conference on Computer Vision Systems. Huang, K. and Trivedi, M. M. 2003. Driver head pose and view estimation with single omnidirectional video stream. In Proceedings of the 1st International Workshop on In-Vehicle Cognitive Computer Vision Systems, in Conjunction with the 3rd International Conference on Computer Vision Systems."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008078328650"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1006\/rtim.2002.0279"},{"volume-title":"Proceedings of the IEEE International Vehicle Electronics Conference.","author":"Kojima N.","key":"e_1_2_1_21_1","unstructured":"Kojima , N. , Kozuka , K. , Nakano , T. , and Yamamoto , S . 2001. Detection of consciousness degradation and concentration of a driver for friendly information service . In Proceedings of the IEEE International Vehicle Electronics Conference. Kojima, N., Kozuka, K., Nakano, T., and Yamamoto, S. 2001. Detection of consciousness degradation and concentration of a driver for friendly information service. In Proceedings of the IEEE International Vehicle Electronics Conference."},{"volume-title":"Proceedings of the IEEE Workshop on Motion and Video Computing.","author":"Lee M.","key":"e_1_2_1_22_1","unstructured":"Lee , M. , Cohen , I. , and Jung , S . 2002. Particle filter with analytical inference for human body tracking . In Proceedings of the IEEE Workshop on Motion and Video Computing. Lee, M., Cohen, I., and Jung, S. 2002. Particle filter with analytical inference for human body tracking. In Proceedings of the IEEE Workshop on Motion and Video Computing."},{"volume-title":"Proceedings of the International Conference on Pattern Recognition (ICPR).","author":"Moriyama T.","key":"e_1_2_1_23_1","unstructured":"Moriyama , T. , Kanade , T. , Cohn , J. F. , Xiao , J. , Ambadar , Z. , Gao , J. , and Imamura , H . 2002. Automatic recognition of eye blinking in spontaneously occurring behavior . In Proceedings of the International Conference on Pattern Recognition (ICPR). Moriyama, T., Kanade, T., Cohn, J. F., Xiao, J., Ambadar, Z., Gao, J., and Imamura, H. 2002. Automatic recognition of eye blinking in spontaneously occurring behavior. In Proceedings of the International Conference on Pattern Recognition (ICPR)."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1084-8045(02)90130-X"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/507072.507099"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sigpro.2005.07.030"},{"volume-title":"Proceedings of the European Conference on Computer Vision.","author":"Okuma K.","key":"e_1_2_1_27_1","unstructured":"Okuma , K. , Taleghani , A. , de Freitas , N. , Little , J. J. , and Lowe , D. G . 2004. A boosted particle filter: Multitarget detection and tracking . In Proceedings of the European Conference on Computer Vision. Okuma, K., Taleghani, A., de Freitas, N., Little, J. J., and Lowe, D. G. 2004. A boosted particle filter: Multitarget detection and tracking. In Proceedings of the European Conference on Computer Vision."},{"volume-title":"Proceedings of the 14th International Conference on Pattern Recognition.","author":"Onoe Y.","key":"e_1_2_1_28_1","unstructured":"Onoe , Y. , Yokoya , N. , Yamazawa , K. , and Takemura , H . 1998. Visual surveillance and monitoring system using an omnidirectional video camera . In Proceedings of the 14th International Conference on Pattern Recognition. Onoe, Y., Yokoya, N., Yamazawa, K., and Takemura, H. 1998. Visual surveillance and monitoring system using an omnidirectional video camera. In Proceedings of the 14th International Conference on Pattern Recognition."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180995.1181044"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.879790"},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Roweis S. T. and Saul L. K. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science 290.  Roweis S. T. and Saul L. K. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science 290.","DOI":"10.1126\/science.290.5500.2323"},{"volume-title":"Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Rui Y.","key":"e_1_2_1_32_1","unstructured":"Rui , Y. and Chen , Y . 2001. Better proposal distributions: Object tracking using unscented particle filter . In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). Rui, Y. and Chen, Y. 2001. Better proposal distributions: Object tracking using unscented particle filter. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)."},{"volume-title":"Proceedings of the International Workshop on Very Low Bitrate Video.","author":"Rurainsky","key":"e_1_2_1_33_1","unstructured":"Rurainsky , and Eisert, P . 2003. Template-based eye and mouth detection for 3D video conferencing . In Proceedings of the International Workshop on Very Low Bitrate Video. Rurainsky, and Eisert, P. 2003. Template-based eye and mouth detection for 3D video conferencing. In Proceedings of the International Workshop on Very Low Bitrate Video."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/1896300.1896392"},{"volume-title":"Proceedings of the IEEE International Conference on Image Processing.","author":"Shen C.","key":"e_1_2_1_35_1","unstructured":"Shen , C. , Brooks , M. J. , and van den Hengel, A. 2005. Augmented particle filtering for efficient visual tracking . In Proceedings of the IEEE International Conference on Image Processing. Shen, C., Brooks, M. J., and van den Hengel, A. 2005. Augmented particle filtering for efficient visual tracking. In Proceedings of the IEEE International Conference on Image Processing."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.5555\/876868.877937"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2004.838480"},{"key":"e_1_2_1_38_1","unstructured":"Veeraraghavan H. and Papanikolopoulos N. P. 2001. Detecting driver fatique through the use of advanced face monitoring techniques. Tech. rep. University of Minnesota Center for Transportation Studies.  Veeraraghavan H. and Papanikolopoulos N. P. 2001. Detecting driver fatique through the use of advanced face monitoring techniques. Tech. rep. University of Minnesota Center for Transportation Studies."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.570"},{"key":"e_1_2_1_40_1","unstructured":"Welch G. and Bishop G. 1995. An introduction to the Kalman filter. Tech. rep. University of North Carolina at Chapel Hill Chapel Hill NC.  Welch G. and Bishop G. 1995. An introduction to the Kalman filter. Tech. rep. University of North Carolina at Chapel Hill Chapel Hill NC."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2003.1201820"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1671962.1671964","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1671962.1671964","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T12:40:53Z","timestamp":1750250453000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1671962.1671964"}},"subtitle":["Algorithm and evaluation"],"short-title":[],"issued":{"date-parts":[[2010,3]]},"references-count":41,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2010,3]]}},"alternative-id":["10.1145\/1671962.1671964"],"URL":"https:\/\/doi.org\/10.1145\/1671962.1671964","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2010,3]]},"assertion":[{"value":"2008-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2010-03-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}