{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T14:01:50Z","timestamp":1779976910335,"version":"3.53.1"},"reference-count":48,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T00:00:00Z","timestamp":1779926400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/legalcode"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2026,5,31]]},"abstract":"<jats:p>Smart eyewear is emerging as an always-on platform capable of perceiving the environment and inferring intent through eye movements, making pupil tracking essential for personalized interaction. However, reliable tracking on wearable hardware remains challenging due to strict power limits and scarce annotated data. Event-based cameras offer a low-power, microsecond-latency solution, but labeled recordings still remain limited. We address this issue with a training framework that combines limited annotated real data with synthetic events and unlabeled real recordings, learning event-based pupil trackers with strong real-world generalization. We pair the U2Eyes tool with the v2e event camera simulator to generate realistic event streams, showing that networks trained on these events exhibit smaller sim-to-real gaps than networks trained on synthetic images. Moreover, our training procedure further bridges this gap, enabling our models to outperform networks trained exclusively on real data across all benchmarks, advancing toward more robust event-based eye tracking on wearable platforms.<\/jats:p>","DOI":"10.1145\/3806032","type":"journal-article","created":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T12:44:33Z","timestamp":1779972273000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Overcoming Data Scarcity for Event-Based Pupil Tracking with Synthetic and Unlabeled Data ETRA018"],"prefix":"10.1145","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-1429-7171","authenticated-orcid":false,"given":"Aaron","family":"Tognoli","sequence":"first","affiliation":[{"name":"DEIB","place":["Milan, Italy"]},{"name":"Politecnico di Milano","place":["Milan, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2700-4808","authenticated-orcid":false,"given":"Andrea","family":"Simpsi","sequence":"additional","affiliation":[{"name":"DEIB","place":["Milan, Italy"]},{"name":"Politecnico di Milano","place":["Milan, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-4936-5973","authenticated-orcid":false,"given":"Andrea","family":"Aspesi","sequence":"additional","affiliation":[{"name":"EssilorLuxottica","place":["Milan, Italy"]},{"name":"Politecnico di Milano","place":["Milan, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9217-3552","authenticated-orcid":false,"given":"Marco","family":"Cannici","sequence":"additional","affiliation":[{"name":"DEIB","place":["Milan, Italy"]},{"name":"Politecnico di Milano","place":["Milan, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-5954-426X","authenticated-orcid":false,"given":"Luca","family":"Merigo","sequence":"additional","affiliation":[{"name":"EssilorLuxottica","place":["Milan, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8306-6739","authenticated-orcid":false,"given":"Matteo","family":"Matteucci","sequence":"additional","affiliation":[{"name":"DEIB","place":["Milan, Italy"]},{"name":"Politecnico di Milano","place":["Milan, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7059-413X","authenticated-orcid":false,"given":"Simone","family":"Mentasti","sequence":"additional","affiliation":[{"name":"DEIB","place":["Milano, Italy"]},{"name":"Politecnico di Milano","place":["Milano, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,5,28]]},"reference":[{"key":"e_1_3_2_2_1","doi-asserted-by":"publisher","unstructured":"Anastasios\u00a0N. Angelopoulos Julien\u00a0N.P. Martel Amit\u00a0P. Kohli J\u00f6rg Conradt and Gordon Wetzstein. 2021. Event-Based Near-Eye Gaze Tracking Beyond 10 000 Hz. IEEE Transactions on Visualization and Computer Graphics 27 5 (2021) 2577\u20132586. doi:10.1109\/TVCG.2021.3067784","DOI":"10.1109\/TVCG.2021.3067784"},{"key":"e_1_3_2_3_1","doi-asserted-by":"crossref","unstructured":"Hajra Ashraf Mikael\u00a0H Sodergren Nabeel Merali George Mylonas Harsimrat Singh and Ara Darzi. 2018. Eye-tracking technology in medical education: A systematic review. Medical teacher 40 1 (2018) 62\u201369.","DOI":"10.1080\/0142159X.2017.1391373"},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN64981.2025.11228557"},{"key":"e_1_3_2_5_1","doi-asserted-by":"crossref","unstructured":"Anna Belardinelli. 2024. Gaze-based intention estimation: principles methodologies and applications in HRI. ACM Transactions on Human-Robot Interaction 13 3 (2024) 1\u201330.","DOI":"10.1145\/3656376"},{"key":"e_1_3_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW63382.2024.00577"},{"key":"e_1_3_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW67362.2025.00512"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/BioCAS58349.2023.10389062"},{"key":"e_1_3_2_9_1","doi-asserted-by":"crossref","unstructured":"Javier de Lope and Manuel Gra\u00f1a. 2022. Deep transfer learning-based gaze tracking for behavioral activity recognition. Neurocomputing 500 (2022) 518\u2013527.","DOI":"10.1016\/j.neucom.2021.06.100"},{"key":"e_1_3_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR51125.2022.00059"},{"key":"e_1_3_2_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-75238-9_6"},{"key":"e_1_3_2_12_1","doi-asserted-by":"crossref","unstructured":"Guillermo Gallego Tobi Delbr\u00fcck Garrick Orchard Chiara Bartolozzi Brian Taba Andrea Censi Stefan Leutenegger Andrew\u00a0J Davison J\u00f6rg Conradt Kostas Daniilidis et\u00a0al. 2020. Event-based vision: A survey. IEEE transactions on pattern analysis and machine intelligence 44 1 (2020) 154\u2013180.","DOI":"10.1109\/TPAMI.2020.3008413"},{"key":"e_1_3_2_13_1","unstructured":"Andrew\u00a0G Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand Marco Andreetto and Hartwig Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/1704.04861 (2017)."},{"key":"e_1_3_2_14_1","doi-asserted-by":"crossref","unstructured":"Yuhuang Hu Shih-Chii Liu and Tobi Delbruck. 2021. v2e: From Video Frames to Realistic DVS Events. arxiv:https:\/\/arXiv.org\/abs\/2006.07722\u00a0[cs.CV] https:\/\/arxiv.org\/abs\/2006.07722","DOI":"10.1109\/CVPRW53098.2021.00144"},{"key":"e_1_3_2_15_1","doi-asserted-by":"crossref","unstructured":"Khadija Iddrisu Waseem Shariff Peter Corcoran Noel\u00a0E O\u2019Connor Joe Lemley and Suzanne Little. 2024a. Event camera-based eye motion analysis: A survey. IEEE Access 12 (2024) 136783\u2013136804.","DOI":"10.1109\/ACCESS.2024.3462109"},{"key":"e_1_3_2_16_1","first-page":"224","volume-title":"European Conference on Computer Vision","author":"Iddrisu Khadija","year":"2024","unstructured":"Khadija Iddrisu, Waseem Shariff, Noel\u00a0E O\u2019Connor, Joseph Lemley, and Suzanne Little. 2024b. Evaluating image-based face and eye tracking with event cameras. In European Conference on Computer Vision. Springer, 224\u2013240."},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3534086.3534331"},{"key":"e_1_3_2_18_1","unstructured":"Analog\u00a0Devices Inc.2020. MAX78000: Artificial Intelligence Microcontroller with Ultra-Low-Power CNN Accelerator. https:\/\/www.analog.com\/en\/products\/max78000.html. Datasheet Rev. 1."},{"key":"e_1_3_2_19_1","doi-asserted-by":"crossref","unstructured":"Yizhou Jiang Wenwei Wang Lei Yu and Chu He. 2024. Eye tracking based on event camera and spiking neural network. Electronics 13 14 (2024) 2879.","DOI":"10.3390\/electronics13142879"},{"key":"e_1_3_2_20_1","volume-title":"Ultralytics YOLOv8","author":"Jocher Glenn","year":"2023","unstructured":"Glenn Jocher, Ayush Chaurasia, and Jing Qiu. 2023. Ultralytics YOLOv8. https:\/\/github.com\/ultralytics\/ultralytics"},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3586182.3616657"},{"key":"e_1_3_2_22_1","unstructured":"Diederik\u00a0P Kingma. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/1412.6980 (2014)."},{"key":"e_1_3_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/AICAS57966.2023.10168551"},{"key":"e_1_3_2_24_1","unstructured":"Tsung-Yi Lin Priya Goyal Ross Girshick Kaiming He and Piotr Doll\u00e1r. 2018. Focal Loss for Dense Object Detection. arxiv:https:\/\/arXiv.org\/abs\/1708.02002\u00a0[cs.CV] https:\/\/arxiv.org\/abs\/1708.02002"},{"key":"e_1_3_2_25_1","doi-asserted-by":"publisher","unstructured":"W. Lin. 2025. Augmented Reality Smart Glasses: Current Challenges and Future Innovations in Wearable Technology. Theoretical and Natural Science 83 (2025) 209\u2013215. doi:10.54254\/2753-8818\/2025.20151","DOI":"10.54254\/2753-8818\/2025.20151"},{"key":"e_1_3_2_26_1","doi-asserted-by":"crossref","unstructured":"Larisa\u00a0YC Loke Demiana\u00a0R Barsoum Todd\u00a0D Murphey and Brenna\u00a0D Argall. 2025. Characterizing eye gaze and mental workload for assistive device control. Wearable Technologies 6 (2025) e13.","DOI":"10.1017\/wtc.2024.27"},{"key":"e_1_3_2_27_1","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1518\/1\/012020"},{"key":"e_1_3_2_28_1","doi-asserted-by":"crossref","unstructured":"Jes\u00fas Moreno-Arjonilla Alfonso L\u00f3pez-Ruiz J\u00a0Roberto Jim\u00e9nez-P\u00e9rez Jos\u00e9\u00a0E Callejas-Aguilera and Juan\u00a0M Jurado. 2024. Eye-tracking on virtual reality: a survey. Virtual Reality 28 1 (2024) 38.","DOI":"10.1007\/s10055-023-00903-y"},{"key":"e_1_3_2_29_1","doi-asserted-by":"crossref","unstructured":"Wei-Liang Ou Tzu-Ling Kuo Chin-Chieh Chang and Chih-Peng Fan. 2021. Deep-learning-based pupil center detection and tracking technology for visible-light wearable gaze tracking devices. Applied Sciences 11 2 (2021) 851.","DOI":"10.3390\/app11020851"},{"key":"e_1_3_2_30_1","doi-asserted-by":"crossref","unstructured":"Francesca Palermo Luca Casciano Lokmane Demagh Aurelio Teliti Niccol\u00f2 Antonello Giacomo Gervasoni Hazem Hesham\u00a0Yousef Shalby Marco\u00a0Brando Paracchini Simone Mentasti Hao Quan et\u00a0al. 2025. Advancements in Context Recognition for Edge Devices and Smart Eyewear: Sensors and Applications. IEEE Access (2025).","DOI":"10.1109\/ACCESS.2025.3555426"},{"key":"e_1_3_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW63382.2024.00587"},{"key":"e_1_3_2_32_1","doi-asserted-by":"crossref","unstructured":"Mirco Planamente Chiara Plizzari Marco Cannici Marco Ciccone Francesco Strada Andrea Bottino Matteo Matteucci and Barbara Caputo. 2021. Da4event: towards bridging the sim-to-real gap for event cameras using domain adaptation. IEEE Robotics and Automation Letters 6 4 (2021) 6616\u20136623.","DOI":"10.1109\/LRA.2021.3093870"},{"key":"e_1_3_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00451"},{"key":"e_1_3_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.00933"},{"key":"e_1_3_2_35_1","doi-asserted-by":"crossref","unstructured":"Cian Ryan Brian O\u2019Sullivan Amr Elrasad Aisling Cahill Joe Lemley Paul Kielty Christoph Posch and Etienne Perot. 2021. Real-time face & eye tracking and blink detection using event cameras. Neural Networks 141 (2021) 87\u201397.","DOI":"10.1016\/j.neunet.2021.03.019"},{"key":"e_1_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.241"},{"key":"e_1_3_2_37_1","first-page":"295","volume-title":"European Conference on Computer Vision","author":"Simpsi Andrea","year":"2024","unstructured":"Andrea Simpsi, Andrea Aspesi, Simone Mentasti, Luca Merigo, Tommaso Ongarello, and Matteo Matteucci. 2024. High-frequency near-eye ground truth for event-based eye tracking. In European Conference on Computer Vision. Springer, 295\u2013304."},{"key":"e_1_3_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV51458.2022.00399"},{"key":"e_1_3_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.235"},{"key":"e_1_3_2_40_1","doi-asserted-by":"publisher","DOI":"10.1002\/sdtp.14693"},{"key":"e_1_3_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2578153.2578188"},{"key":"e_1_3_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW63382.2024.00590"},{"key":"e_1_3_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW63382.2024.00585"},{"key":"e_1_3_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2857491.2857492"},{"key":"e_1_3_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.428"},{"key":"e_1_3_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP48485.2024.10446677"},{"key":"e_1_3_2_47_1","unstructured":"Guangrong Zhao Yiran Shen Chenlong Zhang Zhaoxin Shen Yuanfeng Zhou and Hongkai Wen. 2024. Rgbe-gaze: A large-scale event-based multimodal dataset for high frequency remote gaze tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence (2024)."},{"key":"e_1_3_2_48_1","doi-asserted-by":"crossref","unstructured":"Guangrong Zhao Yurun Yang Jingwei Liu Ning Chen Yiran Shen Hongkai Wen and Guohao Lan. 2023. Ev-eye: Rethinking high-frequency eye tracking through the lenses of event cameras. Advances in Neural Information Processing Systems 36 (2023) 62169\u201362182.","DOI":"10.52202\/075280-2716"},{"key":"e_1_3_2_49_1","first-page":"28863","volume-title":"Proceedings of the Computer Vision and Pattern Recognition Conference","author":"Zubic Nikola","year":"2025","unstructured":"Nikola Zubic and Davide Scaramuzza. 2025. Gg-ssms: Graph-generating state space models. In Proceedings of the Computer Vision and Pattern Recognition Conference. 28863\u201328873."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3806032","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T13:03:24Z","timestamp":1779973404000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3806032"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,28]]},"references-count":48,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,5,31]]}},"alternative-id":["10.1145\/3806032"],"URL":"https:\/\/doi.org\/10.1145\/3806032","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,28]]},"assertion":[{"value":"2026-05-28","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}