{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T16:04:40Z","timestamp":1774627480314,"version":"3.50.1"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2018,7,5]],"date-time":"2018-07-05T00:00:00Z","timestamp":1530748800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2018,7,5]]},"abstract":"<jats:p>Low cost virtual reality (VR) headsets powered by smartphones are becoming ubiquitous. Their unique position on the user's face opens interesting opportunities for interactive sensing. In this paper, we describe EyeSpyVR, a software-only eye sensing approach for smartphone-based VR, which uses a phone's front facing camera as a sensor and its display as a passive illuminator. Our proof-of-concept system, using a commodity Apple iPhone, enables four sensing modalities: detecting when the VR head set is worn, detecting blinks, recognizing the wearer's identity, and coarse gaze tracking - features typically found in high-end or specialty VR headsets. We demonstrate the utility and accuracy of EyeSpyVR in a series of studies with 70 participants, finding a worn detection of 100%, blink detection rate of 95.3%, family user identification accuracy of 81.4%, and mean gaze tracking error of 10.8\u00b0 when calibrated to the wearer (12.9\u00b0 without calibration). These sensing abilities can be used by developers to enable new interactive features and more immersive VR experiences on existing, off-the-shelf hardware.<\/jats:p>","DOI":"10.1145\/3214260","type":"journal-article","created":{"date-parts":[[2018,7,5]],"date-time":"2018-07-05T15:19:10Z","timestamp":1530803950000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":42,"title":["EyeSpyVR"],"prefix":"10.1145","volume":"2","author":[{"given":"Karan","family":"Ahuja","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, USA"}]},{"given":"Rahul","family":"Islam","sequence":"additional","affiliation":[{"name":"Indian Institute of Information Technology, Guwahati, Assam, India"}]},{"given":"Varun","family":"Parashar","sequence":"additional","affiliation":[{"name":"Manipal University, Jaipur, India"}]},{"given":"Kuntal","family":"Dey","sequence":"additional","affiliation":[{"name":"IBM Research, Bangalore, India"}]},{"given":"Chris","family":"Harrison","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, USA"}]},{"given":"Mayank","family":"Goel","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, USA"}]}],"member":"320","published-online":{"date-parts":[[2018,7,5]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Eye center localization and detection using radial mapping","author":"Ahuja Karan","unstructured":"Karan Ahuja, Ruchika Banerjee, Seema Nagar, Kuntal Dey, and Ferdous Barbhuiya. 2016. Eye center localization and detection using radial mapping. In ICIP. IEEE, 3121--3125."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2017.04.002"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2008.4637622"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1080\/10508400701793141"},{"key":"e_1_2_2_5_1","unstructured":"VR Box. 2018. VR Box Headset. (2018). https:\/\/www.amazon.com\/Virtual-Reality-Headset-Glasses-Smartphones\/dp\/B01IXLEJCM"},{"key":"e_1_2_2_6_1","volume-title":"Biometrics Theory, Applications and Systems (BTAS)","author":"de Freitas Pereira Tiago","unstructured":"Tiago de Freitas Pereira and S\u00e9astien Marcel. 2015. Periocular biometrics in mobile environment. In Biometrics Theory, Applications and Systems (BTAS). IEEE, 1--7."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2015.02.009"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/1778331.1778385"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/361237.361242"},{"key":"e_1_2_2_10_1","unstructured":"FOVE. 2018. FOVE eye tracker. (2018). https:\/\/www.getfove.com\/"},{"key":"e_1_2_2_11_1","volume-title":"Head-mounted eye tracking: A new method to describe infant looking. Child development 82, 6","author":"Franchak John M","year":"2011","unstructured":"John M Franchak, Kari S Kretch, Kasey C Soska, and Karen E Adolph. 2011. Head-mounted eye tracking: A new method to describe infant looking. Child development 82, 6 (2011), 1738--1750."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/642611.642703"},{"key":"e_1_2_2_13_1","doi-asserted-by":"crossref","unstructured":"Ceenu Goerge Mohamed Khamis Emanuel von Zezschwitz Marinus Burger Henri Schmidt Florian Alt and Heinrich Hussmann. 2017. Seamless and Secure VR: Adapting and Evaluating Established Authentication Systems for Virtual Reality. In USEC.","DOI":"10.14722\/usec.2017.23028"},{"key":"e_1_2_2_14_1","volume-title":"https:\/\/vr.google.com\/cardboard\/","author":"Cardboard Google","year":"2014","unstructured":"Google. 2014. Google Cardboard. (2014). https:\/\/vr.google.com\/cardboard\/"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2817721.2817722"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","unstructured":"Dan Witzner Hansen and Qiang Ji. 2010. In the eye of the beholder: A survey of models for eyes and gaze. IEEE transactions on pattern analysis and machine intelligence 32 3 (2010) 478--500. 10.1109\/TPAMI.2009.30","DOI":"10.1109\/TPAMI.2009.30"},{"key":"e_1_2_2_17_1","volume-title":"Eyemotion: Classifying facial expressions in VR using eye-tracking cameras. arXiv preprint arXiv:1707.07204","author":"Hickson Steven","year":"2017","unstructured":"Steven Hickson, Nick Dufour, Avneesh Sud, Vivek Kwatra, and Irfan Essa. 2017. Eyemotion: Classifying facial expressions in VR using eye-tracking cameras. arXiv preprint arXiv:1707.07204 (2017)."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2582051.2582066"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ITSC.2002.1041208"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/328236.328110"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2735633"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858495"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.239"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","unstructured":"Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105.","DOI":"10.5555\/2999134.2999257"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10209-011-0256-6"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CRV.2007.54"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3117811.3119866"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3081333.3089304"},{"key":"e_1_2_2_29_1","volume-title":"Advances in physiological computing","author":"Majaranta P\u00e4ivi","unstructured":"P\u00e4ivi Majaranta and Andreas Bulling. 2014. Eye tracking and eye-based human--computer interaction. In Advances in physiological computing. Springer, 39--65."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2010.2096810"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980246"},{"key":"e_1_2_2_32_1","volume-title":"2017 IEEE Symposium on. IEEE, 36--39","author":"Piumsomboon Thammathip","year":"2017","unstructured":"Thammathip Piumsomboon, Gun Lee, Robert W Lindeman, and Mark Billinghurst. 2017. Exploring natural eye-gaze-based interaction for immersive virtual reality. In 3D User Interfaces (3DUI), 2017 IEEE Symposium on. IEEE, 36--39."},{"key":"e_1_2_2_33_1","volume-title":"Eye tracking in HCI and usability research. Encyclopedia of human computer interaction 1","author":"Poole Alex","year":"2006","unstructured":"Alex Poole and Linden J Ball. 2006. Eye tracking in HCI and usability research. Encyclopedia of human computer interaction 1 (2006), 211--219."},{"key":"e_1_2_2_34_1","volume-title":"ICIP 2016 competition on mobile ocular biometric recognition. In Image Processing (ICIP), 2016 IEEE International Conference on. IEEE, 320--324","author":"Rattani Ajita","year":"2016","unstructured":"Ajita Rattani, Reza Derakhshani, Sashi K Saripalle, and Vikas Gottemukkula. 2016. ICIP 2016 competition on mobile ocular biometric recognition. In Image Processing (ICIP), 2016 IEEE International Conference on. IEEE, 320--324."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.21307\/ijssis-2017-212"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2968274"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3084822.3084841"},{"key":"e_1_2_2_38_1","unstructured":"Tobii. 2014. Tobii eye tracker for HTC Vive. (2014). https:\/\/blog.tobii.com\/eye-tracking-vr-devkit-for-htc-vive-311cbca952df"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","unstructured":"Eric Whitmire Laura Trutoiu Robert Cavin David Perek Brian Scally James Phillips and Shwetak Patel. 2016. EyeContact: scleral coil eye tracking for virtual reality. In ISWC. ACM 184--191. 10.1145\/2971763.2971771","DOI":"10.1145\/2971763.2971771"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161410"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3214260","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3214260","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,12]],"date-time":"2025-08-12T15:11:01Z","timestamp":1755011461000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3214260"}},"subtitle":["Interactive Eye Sensing Using Off-the-Shelf, Smartphone-Based VR Headsets"],"short-title":[],"issued":{"date-parts":[[2018,7,5]]},"references-count":40,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2018,7,5]]}},"alternative-id":["10.1145\/3214260"],"URL":"https:\/\/doi.org\/10.1145\/3214260","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,5]]},"assertion":[{"value":"2018-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-04-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-07-05","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}