{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T15:44:08Z","timestamp":1783439048896,"version":"3.54.6"},"reference-count":72,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2017,9,11]],"date-time":"2017-09-11T00:00:00Z","timestamp":1505088000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Cluster of Excellence on Multimodal Computing and Interaction, Saarland University"},{"name":"Alexander von Humboldt-Foundation"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2017,9,11]]},"abstract":"<jats:p>Analysis of everyday human gaze behaviour has significant potential for ubiquitous computing, as evidenced by a large body of work in gaze-based human-computer interaction, attentive user interfaces, and eye-based user modelling. However, current mobile eye trackers are still obtrusive, which not only makes them uncomfortable to wear and socially unacceptable in daily life, but also prevents them from being widely adopted in the social and behavioural sciences. To address these challenges we present InvisibleEye, a novel approach for mobile eye tracking that uses millimetre-size RGB cameras that can be fully embedded into normal glasses frames. To compensate for the cameras\u2019 low image resolution of only a few pixels, our approach uses multiple cameras to capture different views of the eye, as well as learning-based gaze estimation to directly regress from eye images to gaze directions. We prototypically implement our system and characterise its performance on three large-scale, increasingly realistic, and thus challenging datasets: 1) eye images synthesised using a recent computer graphics eye region model, 2) real eye images recorded of 17 participants under controlled lighting, and 3) eye images recorded of four participants over the course of four recording sessions in a mobile setting. We show that InvisibleEye achieves a top person-specific gaze estimation accuracy of 1.79\u00b0 using four cameras with a resolution of only 5 \u00d7 5 pixels. Our evaluations not only demonstrate the feasibility of this novel approach but, more importantly, underline its significant potential for finally realising the vision of invisible mobile eye tracking and pervasive attentive user interfaces.<\/jats:p>","DOI":"10.1145\/3130971","type":"journal-article","created":{"date-parts":[[2017,9,11]],"date-time":"2017-09-11T12:12:26Z","timestamp":1505131946000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":78,"title":["InvisibleEye"],"prefix":"10.1145","volume":"1","author":[{"given":"Marc","family":"Tonsen","sequence":"first","affiliation":[{"name":"Max Planck Institute for Informatics, Saarland Informatics Campus, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julian","family":"Steil","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Informatics, Saarland Informatics Campus, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yusuke","family":"Sugano","sequence":"additional","affiliation":[{"name":"Osaka University, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"Bulling","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Informatics, Saarland Informatics Campus, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,9,11]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Tensorflow: Large-scale Machine Learning on Heterogeneous Distributed Systems. arXiv preprint arXiv:1603.04467","author":"Abadi Mart\u00edn","year":"2016"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2892306"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702613.2732816"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2015.7163121"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2857491.2857493"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2168556.2168569"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2857491.2857496"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2010.86"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2030112.2030172"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409635.1409647"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/1735835.1735842"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2010.49"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-79576-6_2"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1620545.1620552"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.86"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470697"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2014.42"},{"key":"e_1_2_1_19_1","unstructured":"Fran\u00e7ois Chollet. 2015. Keras. (2015).  Fran\u00e7ois Chollet. 2015. Keras. (2015)."},{"key":"e_1_2_1_20_1","first-page":"2121","article-title":"Adaptive Subgradient Methods for Online Learning and Stochastic Optimization","author":"Duchi John","year":"2011","journal-title":"Journal of Machine Learning Research 12"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807499"},{"key":"e_1_2_1_22_1","volume-title":"ExCuSe: Robust Pupil Detection in Real-World Scenarios. In International Conference on Computer Analysis of Images and Patterns (CAIP). Springer, 39--51","author":"Fuhl Wolfgang","year":"2015"},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Wolfgang Fuhl Thiago Santini Gjergji Kasneci and Enkelejda Kasneci. 2016. PupilNet: Convolutional Neural Networks for Robust Pupil Detection. arXiv preprint arXiv:1601.04902 (2016).  Wolfgang Fuhl Thiago Santini Gjergji Kasneci and Enkelejda Kasneci. 2016. PupilNet: Convolutional Neural Networks for Robust Pupil Detection. arXiv preprint arXiv:1601.04902 (2016).","DOI":"10.1145\/2857491.2857505"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2857491.2857505"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2800835.2800910"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1785455.1785480"},{"key":"e_1_2_1_27_1","volume-title":"SET: A Pupil Detection Method Using Sinusoidal Approximation. Frontiers in neuroengineering 8","author":"Javadi Amir-Homayoun","year":"2015"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2638728.2641695"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2578153.2578209"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.239"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807479"},{"key":"e_1_2_1_32_1","volume-title":"Proc. of the COGAIN Conference","volume":"17","author":"Li Dongheng","year":"2006"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.531"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2007.4353043"},{"key":"e_1_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Feng Lu Yusuke Sugano Takahiro Okabe and Yoichi Sato. 2014. Adaptive Linear Regression for Appearance-Based Gaze Estimation. IEEE transactions on pattern analysis and machine intelligence (TPAMI) 36 10 (2014) 2033--2046.  Feng Lu Yusuke Sugano Takahiro Okabe and Yoichi Sato. 2014. Adaptive Linear Regression for Appearance-Based Gaze Estimation. IEEE transactions on pattern analysis and machine intelligence (TPAMI) 36 10 (2014) 2033--2046.","DOI":"10.1109\/TPAMI.2014.2313123"},{"key":"e_1_2_1_36_1","doi-asserted-by":"crossref","unstructured":"P\u00e4ivi Majaranta and Andreas Bulling. 2014. Eye Tracking and Eye-Based Human-Computer Interaction. Springer Publishing London 39--65.  P\u00e4ivi Majaranta and Andreas Bulling. 2014. Eye Tracking and Eye-Based Human-Computer Interaction. Springer Publishing London 39--65.","DOI":"10.1007\/978-1-4471-6392-3_3"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1125451.1125655"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2857491.2857530"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2594368.2594388"},{"key":"e_1_2_1_40_1","first-page":"159","article-title":"Point of Gaze Estimation through Corneal Surface Reflection in an Active Illumination Environment","volume":"2012","author":"Nakazawa Atsushi","year":"2012","journal-title":"Computer Vision--ECCV"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1111\/bjop.12080"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2010.11.013"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2013.6475042"},{"key":"e_1_2_1_44_1","unstructured":"Alexander Plopski Christian Nitschke Kiyoshi Kiyokawa Dieter Schmalstieg and Haruo Takemura. 2015. Hybrid Eye Tracking: Combining Iris Contour and Corneal Imaging. In ICAT-EGVE. 183--190.   Alexander Plopski Christian Nitschke Kiyoshi Kiyokawa Dieter Schmalstieg and Haruo Takemura. 2015. Hybrid Eye Tracking: Combining Iris Contour and Corneal Imaging. In ICAT-EGVE. 183--190."},{"key":"e_1_2_1_45_1","doi-asserted-by":"crossref","unstructured":"Evan F Risko and Alan Kingstone. 2011. Eyes Wide Shut: Implied Social Presence Eye Tracking and Attention. Attention Perception 8 Psychophysics 73 2 (2011) 291--296.  Evan F Risko and Alan Kingstone. 2011. Eyes Wide Shut: Implied Social Presence Eye Tracking and Attention. Attention Perception 8 Psychophysics 73 2 (2011) 291--296.","DOI":"10.3758\/s13414-010-0042-1"},{"key":"e_1_2_1_46_1","volume-title":"Vision Interface","volume":"2","author":"Ruddarraju Ravikrishna","year":"2003"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/958432.958475"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743666.1743685"},{"key":"e_1_2_1_49_1","unstructured":"Hosnieh Sattar Mario Fritz and Andreas Bulling. 2017. Visual Decoding of Targets During Visual Search From Human Eye Fixations. arXiv:1706.05993.  Hosnieh Sattar Mario Fritz and Andreas Bulling. 2017. Visual Decoding of Targets During Visual Search From Human Eye Fixations. arXiv:1706.05993."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298700"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2016.2631582"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2807520"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470695"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807445"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.235"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984536"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2168556.2168585"},{"key":"e_1_2_1_58_1","volume-title":"Proc. PETMEI","author":"\u015awirski Lech","year":"2013"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2578153.2578188"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2857491.2857520"},{"key":"e_1_2_1_61_1","doi-asserted-by":"crossref","unstructured":"Cihan Topal Serkan Gunal Onur Ko\u00e7deviren Atakan Do\u011fan and \u00d6mer N Gerek. 2014. A Low-Computational Approach on Gaze Estimation With Eye Touch System. IEEE transactions on Cybernetics 44 2 (2014) 228--239.  Cihan Topal Serkan Gunal Onur Ko\u00e7deviren Atakan Do\u011fan and \u00d6mer N Gerek. 2014. A Low-Computational Approach on Gaze Estimation With Eye Touch System. IEEE transactions on Cybernetics 44 2 (2014) 228--239.","DOI":"10.1109\/TCYB.2013.2252792"},{"key":"e_1_2_1_62_1","volume-title":"Illumination-Free Gaze Estimation Method for First-Person Vision Wearable Device. In Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference on. IEEE","author":"Tsukada Akihiro","year":"2011"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2578153.2578155"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2168556.2168614"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2468356.2479632"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180995.1181050"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46448-0_18"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/2857491.2857492"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.428"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2013.0058"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299081"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2017.284"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2636071"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130971","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3130971","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:13:20Z","timestamp":1750212800000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130971"}},"subtitle":["Mobile Eye Tracking Using Multiple Low-Resolution Cameras and Learning-Based Gaze Estimation"],"short-title":[],"issued":{"date-parts":[[2017,9,11]]},"references-count":72,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2017,9,11]]}},"alternative-id":["10.1145\/3130971"],"URL":"https:\/\/doi.org\/10.1145\/3130971","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,9,11]]},"assertion":[{"value":"2017-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-09-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}