{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T15:28:15Z","timestamp":1761060495473,"version":"3.41.0"},"reference-count":75,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2018,1,8]],"date-time":"2018-01-08T00:00:00Z","timestamp":1515369600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2018,1,8]]},"abstract":"<jats:p>We introduce hEYEbrid, a calibration-free method for spontaneous and long-term eye gaze tracking, with competitive gaze estimation. It is based on a hybrid concept that combines infrared eye images with corneal imaging. For this, two eye cameras are mounted on a glasses frame. In this way, the pupil can be tracked quickly with high precision. This information is translated into the corneal image, which is used to create a connection to the environment, acting like a scene camera. In a user study with 20 participants, we evaluated our approach against an extended version of the system, called 3C-hEYEbrid, and a state-of-the-art head-mounted Pupil Labs eye tracker. We show that hEYEbrid provides accurate gaze estimation in unconstrained environments and is robust against calibration drift (e.g. caused by taking off and putting on the device). In addition, we present a mobile and wearable implementation of hEYEbrid and 3C-hEYEbrid, that is also usable with a monocular Pupil Labs eye tracker. It connects the head-mounted device to a mobile phone, enabling gaze estimation in real time. hEYEbrid represents a significant step towards pervasive gaze-based interfaces.<\/jats:p>","DOI":"10.1145\/3161166","type":"journal-article","created":{"date-parts":[[2018,1,9]],"date-time":"2018-01-09T13:26:11Z","timestamp":1515504371000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["hEYEbrid"],"prefix":"10.1145","volume":"1","author":[{"given":"Christian","family":"Lander","sequence":"first","affiliation":[{"name":"German Research Center for Artificial Intelligence (DFKI GmbH), Saarland Informatics Campus, Saarbr\u00fccken, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Markus","family":"l\u00f6chtefeld","sequence":"additional","affiliation":[{"name":"Aalborg University, Aalborg, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antonio","family":"Kr\u00fcger","sequence":"additional","affiliation":[{"name":"German Research Center for Artificial Intelligence (DFKI GmbH), Saarland Informatics Campus, Saarbr\u00fccken, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,1,8]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_2_2_1_1","DOI":"10.5244\/C.27.13"},{"doi-asserted-by":"publisher","key":"e_1_2_2_2_1","DOI":"10.1364\/JOSAA.33.002264"},{"doi-asserted-by":"publisher","key":"e_1_2_2_3_1","DOI":"10.1109\/MPRV.2010.86"},{"doi-asserted-by":"publisher","key":"e_1_2_2_4_1","DOI":"10.1145\/2240156.2240158"},{"doi-asserted-by":"publisher","key":"e_1_2_2_5_1","DOI":"10.1145\/2168556.2168595"},{"doi-asserted-by":"publisher","key":"e_1_2_2_6_1","DOI":"10.1109\/CVPR.2011.5995675"},{"volume-title":"The American Heritage Medical Dictionary","author":"Dictionary American Heritage","unstructured":"American Heritage Dictionary . 2007. The American Heritage Medical Dictionary . Houghton Mifflin Company . American Heritage Dictionary. 2007. The American Heritage Medical Dictionary. Houghton Mifflin Company.","key":"e_1_2_2_7_1"},{"volume-title":"Eye Tracking Methodology: Theory and Practice","author":"Duchowski Andrew T.","unstructured":"Andrew T. Duchowski . 2007. Eye Tracking Methodology: Theory and Practice . Springer-Verlag New York, Inc. , Secaucus, NJ, USA . Andrew T. Duchowski. 2007. Eye Tracking Methodology: Theory and Practice. Springer-Verlag New York, Inc., Secaucus, NJ, USA.","key":"e_1_2_2_8_1"},{"volume-title":"ExCuSe: Robust Pupil Detection in Real-World Scenarios","author":"Fuhl Wolfgang","unstructured":"Wolfgang Fuhl , Thomas K\u00fcbler , Katrin Sippel , Wolfgang Rosenstiel , and Enkelejda Kasneci . 2015. ExCuSe: Robust Pupil Detection in Real-World Scenarios . Springer International Publishing , Cham , 39--51. https:\/\/doi.org\/10.1007\/978-3-319-23192-1_4 10.1007\/978-3-319-23192-1_4 Wolfgang Fuhl, Thomas K\u00fcbler, Katrin Sippel, Wolfgang Rosenstiel, and Enkelejda Kasneci. 2015. ExCuSe: Robust Pupil Detection in Real-World Scenarios. Springer International Publishing, Cham, 39--51. https:\/\/doi.org\/10.1007\/978-3-319-23192-1_4","key":"e_1_2_2_9_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_10_1","DOI":"10.1145\/2857491.2857505"},{"doi-asserted-by":"publisher","key":"e_1_2_2_11_1","DOI":"10.1007\/s00138-016-0776-4"},{"doi-asserted-by":"publisher","key":"e_1_2_2_12_1","DOI":"10.1049\/ibc.2016.0033"},{"doi-asserted-by":"publisher","key":"e_1_2_2_13_1","DOI":"10.1007\/978-3-540-75412-1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_14_1","DOI":"10.1109\/TPAMI.2009.30"},{"doi-asserted-by":"publisher","key":"e_1_2_2_15_1","DOI":"10.1017\/CBO9780511811685"},{"key":"e_1_2_2_16_1","volume-title":"Eye Tracking: A Comprehensive Guide to Methods and Measures.","author":"Holmqvist K.","year":"2011","unstructured":"K. Holmqvist , M. Nystr\u00f6m , R. Andersson , R. Dewhurst , H. Jarodzka , and J. van de Weijer . 2011 . Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford : Oxford University Press . K. Holmqvist, M. Nystr\u00f6m, R. Andersson, R. Dewhurst, H. Jarodzka, and J. van de Weijer. 2011. Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford: Oxford University Press."},{"doi-asserted-by":"publisher","key":"e_1_2_2_17_1","DOI":"10.1145\/2858036.2858404"},{"doi-asserted-by":"publisher","key":"e_1_2_2_18_1","DOI":"10.1145\/1785455.1785480"},{"doi-asserted-by":"publisher","key":"e_1_2_2_19_1","DOI":"10.1145\/97243.97246"},{"doi-asserted-by":"publisher","key":"e_1_2_2_20_1","DOI":"10.3389\/fneng.2015.00004"},{"doi-asserted-by":"publisher","key":"e_1_2_2_21_1","DOI":"10.1006\/rtim.2002.0279"},{"doi-asserted-by":"publisher","key":"e_1_2_2_22_1","DOI":"10.1145\/2638728.2641695"},{"key":"e_1_2_2_23_1","volume-title":"Shavi","author":"Kaufman Arie E.","year":"1993","unstructured":"Arie E. Kaufman , Amit Bandopadhay , and Bernard D . Shavi . 1993 . An Eye Tracking Computer User Interface . Arie E. Kaufman, Amit Bandopadhay, and Bernard D. Shavi. 1993. An Eye Tracking Computer User Interface."},{"key":"e_1_2_2_24_1","volume-title":"Pupil Labs Store. (2017). Retrieved","author":"Labs Pupil","year":"2017","unstructured":"Pupil Labs . 2017. Pupil Labs Store. (2017). Retrieved Oct 2017 from https:\/\/pupil-labs.com\/store\/ Pupil Labs. 2017. Pupil Labs Store. (2017). Retrieved Oct 2017 from https:\/\/pupil-labs.com\/store\/"},{"doi-asserted-by":"publisher","key":"e_1_2_2_25_1","DOI":"10.1145\/2807442.2807479"},{"doi-asserted-by":"publisher","key":"e_1_2_2_26_1","DOI":"10.1145\/2857491.2857513"},{"doi-asserted-by":"publisher","key":"e_1_2_2_27_1","DOI":"10.1145\/2968219.2968337"},{"doi-asserted-by":"publisher","key":"e_1_2_2_28_1","DOI":"10.1145\/2757710.2757734"},{"doi-asserted-by":"publisher","key":"e_1_2_2_29_1","DOI":"10.1145\/3027063.3053201"},{"doi-asserted-by":"publisher","key":"e_1_2_2_30_1","DOI":"10.1109\/CVPR.2005.531"},{"doi-asserted-by":"publisher","key":"e_1_2_2_31_1","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"doi-asserted-by":"publisher","key":"e_1_2_2_32_1","DOI":"10.1016\/j.cviu.2004.07.010"},{"doi-asserted-by":"publisher","key":"e_1_2_2_33_1","DOI":"10.1186\/s40662-015-0014-6"},{"doi-asserted-by":"publisher","key":"e_1_2_2_34_1","DOI":"10.5555\/2964398.2964411"},{"doi-asserted-by":"publisher","key":"e_1_2_2_35_1","DOI":"10.1109\/ICMEW.2015.7169846"},{"doi-asserted-by":"publisher","key":"e_1_2_2_36_1","DOI":"10.1145\/507072.507099"},{"doi-asserted-by":"publisher","key":"e_1_2_2_37_1","DOI":"10.1109\/ICCV.2005.243"},{"doi-asserted-by":"publisher","key":"e_1_2_2_38_1","DOI":"10.1145\/1186562.1015783"},{"doi-asserted-by":"publisher","key":"e_1_2_2_39_1","DOI":"10.1109\/CVPR.2004.1315066"},{"doi-asserted-by":"publisher","key":"e_1_2_2_40_1","DOI":"10.1007\/s11263-006-6274-9"},{"doi-asserted-by":"publisher","key":"e_1_2_2_41_1","DOI":"10.1109\/ACPR.2013.84"},{"doi-asserted-by":"publisher","key":"e_1_2_2_42_1","DOI":"10.1016\/j.cviu.2011.02.008"},{"key":"e_1_2_2_43_1","volume-title":"Image-Based Eye Pose and Reflection Analysis for Advanced Interaction Techniques and Scene Understanding. Computer Vision and Image Media (CVIM)","author":"Nitschke Christian","year":"2011","unstructured":"Christian Nitschke , Atsushi Nakazawa , and Haruo Takemura . 2011. Image-Based Eye Pose and Reflection Analysis for Advanced Interaction Techniques and Scene Understanding. Computer Vision and Image Media (CVIM) ( 2011 ), 1--16. http:\/\/ci.nii.ac.jp\/naid\/110008584047\/en\/ Christian Nitschke, Atsushi Nakazawa, and Haruo Takemura. 2011. Image-Based Eye Pose and Reflection Analysis for Advanced Interaction Techniques and Scene Understanding. Computer Vision and Image Media (CVIM) (2011), 1--16. http:\/\/ci.nii.ac.jp\/naid\/110008584047\/en\/"},{"key":"e_1_2_2_44_1","first-page":"389","article-title":"Corneal Imaging Revisited: An Overview of Corneal Reflection Analysis and Applications","volume":"8","author":"Nitschke Christian","year":"2013","unstructured":"Christian Nitschke , Atsushi Nakazawa , and Haruo Takemura . 2013 . Corneal Imaging Revisited: An Overview of Corneal Reflection Analysis and Applications . Information and Media Technologies 8 , 2 (2013), 389 -- 406 . https:\/\/doi.org\/10.11185\/imt.8.389 10.11185\/imt.8.389 Christian Nitschke, Atsushi Nakazawa, and Haruo Takemura. 2013. Corneal Imaging Revisited: An Overview of Corneal Reflection Analysis and Applications. Information and Media Technologies 8, 2 (2013), 389--406. https:\/\/doi.org\/10.11185\/imt.8.389","journal-title":"Information and Media Technologies"},{"doi-asserted-by":"publisher","key":"e_1_2_2_45_1","DOI":"10.3758\/s13428-012-0247-4"},{"doi-asserted-by":"publisher","key":"e_1_2_2_46_1","DOI":"10.1145\/2501988.2501998"},{"doi-asserted-by":"publisher","key":"e_1_2_2_47_1","DOI":"10.1145\/2993369.2996300"},{"key":"e_1_2_2_48_1","volume-title":"Faster, Stronger.","author":"Redmon Joseph","year":"2016","unstructured":"Joseph Redmon and Ali Farhadi . 2016. YOLO9000 : Better , Faster, Stronger. ( 2016 ). arXiv:arXiv:1612.08242 Joseph Redmon and Ali Farhadi. 2016. YOLO9000: Better, Faster, Stronger. (2016). arXiv:arXiv:1612.08242"},{"doi-asserted-by":"publisher","key":"e_1_2_2_49_1","DOI":"10.1109\/TBMEL.1963.4322822"},{"doi-asserted-by":"publisher","key":"e_1_2_2_50_1","DOI":"10.1145\/3025453.3025950"},{"doi-asserted-by":"publisher","key":"e_1_2_2_51_1","DOI":"10.1109\/CVPR.2010.5539799"},{"doi-asserted-by":"publisher","key":"e_1_2_2_52_1","DOI":"10.1145\/633292.633452"},{"key":"e_1_2_2_53_1","volume-title":"Winchester Hursley Human Factors Laboratory, and IBM UK Hursley Human Factors Laboratory","author":"Scott D.","year":"1991","unstructured":"D. Scott , J.M. Findlay , Winchester Hursley Human Factors Laboratory, and IBM UK Hursley Human Factors Laboratory . 1991 . Visual Search, Eye Movements and Display Units. IBM UK Hursley Human Factors Laboratory . D. Scott, J.M. Findlay, Winchester Hursley Human Factors Laboratory, and IBM UK Hursley Human Factors Laboratory. 1991. Visual Search, Eye Movements and Display Units. IBM UK Hursley Human Factors Laboratory."},{"unstructured":"SMI 2017. SMI Eye Tracking Glasses 2. SMI. https:\/\/www.smivision.com\/wp-content\/uploads\/2017\/05\/smi_prod_ETG_120Hz_asgm.pdf.  SMI 2017. SMI Eye Tracking Glasses 2. SMI. https:\/\/www.smivision.com\/wp-content\/uploads\/2017\/05\/smi_prod_ETG_120Hz_asgm.pdf.","key":"e_1_2_2_54_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_55_1","DOI":"10.3758\/BF03204486"},{"doi-asserted-by":"publisher","key":"e_1_2_2_56_1","DOI":"10.1145\/2750858.2807520"},{"doi-asserted-by":"publisher","key":"e_1_2_2_57_1","DOI":"10.1145\/2750858.2807520"},{"doi-asserted-by":"publisher","key":"e_1_2_2_58_1","DOI":"10.1145\/2807442.2807445"},{"doi-asserted-by":"publisher","key":"e_1_2_2_59_1","DOI":"10.1109\/TPAMI.2012.101"},{"doi-asserted-by":"publisher","key":"e_1_2_2_60_1","DOI":"10.1145\/2168556.2168585"},{"key":"e_1_2_2_61_1","volume-title":"Proceedings of ECEM","author":"\u015awirski Lech","year":"2013","unstructured":"Lech \u015awirski and Neil Dodgson . 2013 . A Fully-Automatic, Temporal Approach to Single Camera, Glint-Free 3D Eye Model Fitting [Abstract] . In Proceedings of ECEM 2013. http:\/\/www.cl.cam.ac.uk\/research\/rainbow\/projects\/eyemodelfit\/ Lech \u015awirski and Neil Dodgson. 2013. A Fully-Automatic, Temporal Approach to Single Camera, Glint-Free 3D Eye Model Fitting [Abstract]. In Proceedings of ECEM 2013. http:\/\/www.cl.cam.ac.uk\/research\/rainbow\/projects\/eyemodelfit\/"},{"doi-asserted-by":"publisher","key":"e_1_2_2_62_1","DOI":"10.1145\/2578153.2578197"},{"key":"e_1_2_2_63_1","volume-title":"Estimating Focused Object Using Corneal Surface Image for Eye-Based Interaction. In 3rd International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction.","author":"Takemura Kentaro","year":"2013","unstructured":"Kentaro Takemura , Tomohisa Yamakawa , Jun Takamatsu , and Tsukasa Ogasawara . 2013 . Estimating Focused Object Using Corneal Surface Image for Eye-Based Interaction. In 3rd International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction. Kentaro Takemura, Tomohisa Yamakawa, Jun Takamatsu, and Tsukasa Ogasawara. 2013. Estimating Focused Object Using Corneal Surface Image for Eye-Based Interaction. In 3rd International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction."},{"volume-title":"Google Buys Eyefluence Eye-Tracking Startup. (2016). Retrieved","year":"2017","unstructured":"Techcrunch. 2016. Google Buys Eyefluence Eye-Tracking Startup. (2016). Retrieved Oct 2017 from https:\/\/techcrunch.com\/2016\/10\/24\/google-buys-eyefluence-eye-tracking-startup\/ Techcrunch. 2016. Google Buys Eyefluence Eye-Tracking Startup. (2016). Retrieved Oct 2017 from https:\/\/techcrunch.com\/2016\/10\/24\/google-buys-eyefluence-eye-tracking-startup\/","key":"e_1_2_2_64_1"},{"volume-title":"Apple Acquires SMI Eye-Tracking Company. (2017). Retrieved","year":"2017","unstructured":"Techcrunch. 2017. Apple Acquires SMI Eye-Tracking Company. (2017). Retrieved Oct 2017 from https:\/\/techcrunch.com\/2017\/06\/26\/apple-acquires-smi-eye-tracking-company\/ Techcrunch. 2017. Apple Acquires SMI Eye-Tracking Company. (2017). Retrieved Oct 2017 from https:\/\/techcrunch.com\/2017\/06\/26\/apple-acquires-smi-eye-tracking-company\/","key":"e_1_2_2_65_1"},{"key":"e_1_2_2_66_1","volume-title":"Tobii Pro Glasses 2. (2017). Retrieved","author":"Technology Tobii","year":"2017","unstructured":"Tobii Technology . 2017. Tobii Pro Glasses 2. (2017). Retrieved Oct 2017 from https:\/\/www.tobiipro.com\/product-listing\/tobii-pro-glasses-2\/ Tobii Technology. 2017. Tobii Pro Glasses 2. (2017). Retrieved Oct 2017 from https:\/\/www.tobiipro.com\/product-listing\/tobii-pro-glasses-2\/"},{"unstructured":"Tobii 2015. Pro Glasses 2 Manual. Tobii. https:\/\/www.tobiipro.com\/siteassets\/tobii-pro\/user-manuals\/tobii-pro-glasses-2-user-manual.pdf\/?v=1.20.2.  Tobii 2015. Pro Glasses 2 Manual. Tobii. https:\/\/www.tobiipro.com\/siteassets\/tobii-pro\/user-manuals\/tobii-pro-glasses-2-user-manual.pdf\/?v=1.20.2.","key":"e_1_2_2_67_1"},{"unstructured":"Tobii Gaming 2017. Tobii 4C Calibration. Tobii Gaming. https:\/\/help.tobii.com\/hc\/en-us\/articles\/209530409-Create-a-new-user-profile.  Tobii Gaming 2017. Tobii 4C Calibration. Tobii Gaming. https:\/\/help.tobii.com\/hc\/en-us\/articles\/209530409-Create-a-new-user-profile.","key":"e_1_2_2_68_1"},{"unstructured":"Tobii Gaming 2017. Tobii 4C Controller. Tobii Gaming. https:\/\/tobiigaming.com\/eye-tracker-4c.  Tobii Gaming 2017. Tobii 4C Controller. Tobii Gaming. https:\/\/tobiigaming.com\/eye-tracker-4c.","key":"e_1_2_2_69_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_70_1","DOI":"10.1145\/2702123.2702355"},{"doi-asserted-by":"publisher","key":"e_1_2_2_71_1","DOI":"10.1145\/636772.636794"},{"doi-asserted-by":"publisher","key":"e_1_2_2_72_1","DOI":"10.1109\/TSMCB.2008.926606"},{"doi-asserted-by":"publisher","key":"e_1_2_2_73_1","DOI":"10.3758\/BF03201553"},{"doi-asserted-by":"publisher","key":"e_1_2_2_74_1","DOI":"10.1109\/TBME.2004.831523"},{"key":"e_1_2_2_75_1","volume-title":"Appearance-Based Gaze Estimation in the Wild. CoRR abs\/1504.02863","author":"Zhang Xucong","year":"2015","unstructured":"Xucong Zhang , Yusuke Sugano , Mario Fritz , and Andreas Bulling . 2015. Appearance-Based Gaze Estimation in the Wild. CoRR abs\/1504.02863 ( 2015 ). http:\/\/arxiv.org\/abs\/1504.02863 Xucong Zhang, Yusuke Sugano, Mario Fritz, and Andreas Bulling. 2015. Appearance-Based Gaze Estimation in the Wild. CoRR abs\/1504.02863 (2015). http:\/\/arxiv.org\/abs\/1504.02863"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3161166","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3161166","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:13:30Z","timestamp":1750212810000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3161166"}},"subtitle":["A hybrid approach for mobile calibration-free gaze estimation"],"short-title":[],"issued":{"date-parts":[[2018,1,8]]},"references-count":75,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,1,8]]}},"alternative-id":["10.1145\/3161166"],"URL":"https:\/\/doi.org\/10.1145\/3161166","relation":{},"ISSN":["2474-9567"],"issn-type":[{"type":"electronic","value":"2474-9567"}],"subject":[],"published":{"date-parts":[[2018,1,8]]},"assertion":[{"value":"2017-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-01-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}