{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,21]],"date-time":"2026-06-21T01:49:23Z","timestamp":1782006563196,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":38,"publisher":"ACM","license":[{"start":{"date-parts":[[2026,5,31]],"date-time":"2026-05-31T00:00:00Z","timestamp":1780185600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,6]]},"DOI":"10.1145\/3797246.3803031","type":"proceedings-article","created":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T12:08:10Z","timestamp":1780056490000},"page":"1-7","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Gaze patterns predict preference and confidence in pairwise AI image evaluation"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-1082-5140","authenticated-orcid":false,"given":"Nikolas","family":"Papadopoulos","sequence":"first","affiliation":[{"name":"Columbia University, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-3132-3393","authenticated-orcid":false,"given":"Shreenithi","family":"Navaneethan","sequence":"additional","affiliation":[{"name":"Columbia University, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-1595-6375","authenticated-orcid":false,"given":"Sheng","family":"Bai","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, Columbia University, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6392-1574","authenticated-orcid":false,"given":"Ankur","family":"Samanta","sequence":"additional","affiliation":[{"name":"Biomedical Engineering, Columbia University, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9738-1342","authenticated-orcid":false,"given":"Paul","family":"Sajda","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, Columbia University, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,5,31]]},"reference":[{"key":"e_1_3_3_1_2_1","doi-asserted-by":"publisher","unstructured":"K.\u00a0Carrie Armel Aurelie Beaumel and Antonio Rangel. 2008. Biasing simple choices by manipulating relative visual attention. Judgment and Decision Making 3 5 (2008) 396\u2013403. 10.1017\/S1930297500000413","DOI":"10.1017\/S1930297500000413"},{"key":"e_1_3_3_1_3_1","unstructured":"Yuntao Bai Saurav Kadavath Sandipan Kundu Amanda Askell John Kernion Andy Jones Anna Chen Anna Goldie Azalia Mirhoseini Cameron McKinnon Carol Chen Catherine Olsson Chris Olah Danny Hernandez Dawn Drain Deep Ganguli Dustin Li Eli Tran-Johnson E Perez Jamie Kerr Jared Mueller Jeffrey Ladish J Landau Kamal Ndousse Kamil\u0117 Luko\u0161i\u016bt\u0117 Liane Lovitt Michael Sellitto Nelson Elhage Nicholas Schiefer Noem\u00ed Mercado Nova Dassarma Robert Lasenby Robin Larson Sam Ringer Scott Johnston Shauna Kravec Sheer\u00a0El Showk Stanislav Fort Tamera Lanham Timothy Telleen-Lawton Tom Conerly T.\u00a0J. Henighan Tristan Hume Sam Bowman Zac Hatfield-Dodds Benjamin Mann Dario Amodei Nicholas Joseph Sam McCandlish Tom\u00a0B. Brown and Jared Kaplan. 2022. Constitutional AI: Harmlessness from AI Feedback. ArXiv abs\/2212.08073 (2022)."},{"key":"e_1_3_3_1_4_1","unstructured":"Daniel Berenstein Ben Burtenshaw David Vila Daniel van Strien Suraj Paul Anh Vi and Lior Tsaban. 2024. Open Preference Dataset for Text-to-Image Generation by the Data Is Better Together Community. https:\/\/huggingface.co\/blog\/image-preferences. Hugging Face Blog."},{"key":"e_1_3_3_1_5_1","first-page":"4965","volume-title":"International Conference on Learning Representations","volume":"2024","author":"Black Kevin","year":"2024","unstructured":"Kevin Black, Michael Janner, Yilun Du, Ilya Kostrikov, and Sergey Levine. 2024. Training Diffusion Models with Reinforcement Learning. In International Conference on Learning Representations , B.\u00a0Kim, Y.\u00a0Yue, S.\u00a0Chaudhuri, K.\u00a0Fragkiadaki, M.\u00a0Khan, and Y.\u00a0Sun (Eds.), Vol.\u00a02024. 4965\u20134987."},{"key":"e_1_3_3_1_6_1","doi-asserted-by":"publisher","DOI":"10.26615\/978-954-452-104-2-008"},{"key":"e_1_3_3_1_7_1","unstructured":"Stephen Casper Xander Davies Claudia Shi Thomas\u00a0Krendl Gilbert J\u00e9r\u00e9my Scheurer Javier Rando Rachel Freedman Tomek Korbak David Lindner Pedro Freire Tony\u00a0Tong Wang Samuel Marks Charbel-Raphael Segerie Micah Carroll Andi Peng Phillip\u00a0J.K. Christoffersen Mehul Damani Stewart Slocum Usman Anwar Anand Siththaranjan Max Nadeau Eric\u00a0J Michaud Jacob Pfau Dmitrii Krasheninnikov Xin Chen Lauro Langosco Peter Hase Erdem Biyik Anca Dragan David Krueger Dorsa Sadigh and Dylan Hadfield-Menell. 2023. Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback. Transactions on Machine Learning Research (2023)."},{"key":"e_1_3_3_1_8_1","unstructured":"Dimitrios Christodoulou and Mads Kuhlmann-J\u00f8rgensen. 2024. Finding the Subjective Truth: Collecting 2 Million Votes for Comprehensive Gen-AI Model Evaluation. arxiv:https:\/\/arXiv.org\/abs\/2409.11904"},{"key":"e_1_3_3_1_9_1","volume-title":"The Twelfth International Conference on Learning Representations","author":"Clark Kevin","year":"2024","unstructured":"Kevin Clark, Paul Vicol, Kevin Swersky, and David\u00a0J. Fleet. 2024. Directly Fine-Tuning Diffusion Models on Differentiable Rewards. In The Twelfth International Conference on Learning Representations."},{"key":"e_1_3_3_1_10_1","first-page":"79858","volume-title":"Advances in Neural Information Processing Systems","author":"Fan Ying","year":"2023","unstructured":"Ying Fan, Olivia Watkins, Yuqing Du, Hao Liu, Moonkyung Ryu, Craig Boutilier, Pieter Abbeel, Mohammad Ghavamzadeh, Kangwook Lee, and Kimin Lee. 2023. DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Models. In Advances in Neural Information Processing Systems , A.\u00a0Oh, T.\u00a0Naumann, A.\u00a0Globerson, K.\u00a0Saenko, M.\u00a0Hardt, and S.\u00a0Levine (Eds.), Vol.\u00a036. Curran Associates, Inc., 79858\u201379885."},{"key":"e_1_3_3_1_11_1","series-title":"(NIPS \u201924)","volume-title":"Proceedings of the 38th International Conference on Neural Information Processing Systems","author":"Furuta Hiroki","year":"2024","unstructured":"Hiroki Furuta, Kuang-Huei Lee, Shixiang\u00a0Shane Gu, Yutaka Matsuo, Aleksandra Faust, Heiga Zen, and Izzeddin Gur. 2024. Geometric-averaged preference optimization for soft preference labels. In Proceedings of the 38th International Conference on Neural Information Processing Systems (Vancouver, BC, Canada) (NIPS \u201924). Curran Associates Inc., Red Hook, NY, USA, Article 1819, 39\u00a0pages."},{"key":"e_1_3_3_1_12_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2025.emnlp-main.1559"},{"key":"e_1_3_3_1_13_1","doi-asserted-by":"publisher","unstructured":"Mackenzie\u00a0G. Glaholt and Eyal\u00a0M. Reingold. 2009. The time course of gaze bias in visual decision tasks. Visual Cognition 17 8 (2009) 1228\u20131243. 10.1080\/13506280802362962","DOI":"10.1080\/13506280802362962"},{"key":"e_1_3_3_1_14_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.emnlp-main.1189"},{"key":"e_1_3_3_1_15_1","volume-title":"ICML 2024 Workshop on LLMs and Cognition","author":"Kiegeland Samuel","year":"2024","unstructured":"Samuel Kiegeland, David\u00a0Robert Reich, Ryan Cotterell, Lena\u00a0Ann J\u00e4ger, and Ethan Wilcox. 2024. The Pupil Becomes the Master: Eye-Tracking Feedback for Tuning LLMs. In ICML 2024 Workshop on LLMs and Cognition."},{"key":"e_1_3_3_1_16_1","doi-asserted-by":"publisher","DOI":"10.52202\/075280-1594"},{"key":"e_1_3_3_1_17_1","doi-asserted-by":"publisher","unstructured":"Christian Kothe Seyed\u00a0Yahya Shirazi Tristan Stenner David Medine Chadwick Boulay Matthew\u00a0I. Grivich Fiorenzo Artoni Tim Mullen Arnaud Delorme and Scott Makeig. 2025. The Lab Streaming Layer for Synchronized Multimodal Recording. Imaging Neuroscience 3 (2025) IMAG.a.136. 10.1162\/IMAG.a.136","DOI":"10.1162\/IMAG.a.136"},{"key":"e_1_3_3_1_18_1","unstructured":"Kimin Lee Youwei Liu Xiaoshi Zhang Xiaojian Wu Yingyu Tian Tengyu Zhu JianCong Tao Tong Sun Qifeng Liu Conghui Wang et\u00a0al. 2023. Aligning Text-to-Image Models using Human Feedback. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2302.12192 (2023)."},{"key":"e_1_3_3_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.01835"},{"key":"e_1_3_3_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3725840"},{"key":"e_1_3_3_1_21_1","volume-title":"International Conference on Learning Representations (ICLR)","author":"Lopez-Cardona Angela","year":"2025","unstructured":"Angela Lopez-Cardona, Carlos Segura, Alexandros Karatzoglou, Sergi Abadal, and Ioannis Arapakis. 2025b. Seeing Eye to AI: Human Alignment via Gaze-Based Response Rewards for Large Language Models. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_3_3_1_22_1","doi-asserted-by":"publisher","unstructured":"Richard Nisbett and Timothy Wilson. 1977. Telling more than we can know: Verbal reports on mental processes. Psychological Review 84 (05 1977) 231\u2013259. 10.1037\/0033-295X.84.3.231","DOI":"10.1037\/0033-295X.84.3.231"},{"key":"e_1_3_3_1_23_1","series-title":"(NIPS \u201922)","volume-title":"Proceedings of the 36th International Conference on Neural Information Processing Systems","author":"Ouyang Long","year":"2022","unstructured":"Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll\u00a0L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, and Ryan Lowe. 2022. Training language models to follow instructions with human feedback. In Proceedings of the 36th International Conference on Neural Information Processing Systems (New Orleans, LA, USA) (NIPS \u201922). Curran Associates Inc., Red Hook, NY, USA, Article 2011, 15\u00a0pages."},{"key":"e_1_3_3_1_24_1","doi-asserted-by":"publisher","unstructured":"Jonathan\u00a0W. Peirce Jeremy\u00a0R. Gray Sol Simpson Michael\u00a0R. MacAskill Richard H\u00f6chenberger Hiroyuki Sogo Erik Kastman and Jonas\u00a0K. Lindel\u00f8v. 2019. PsychoPy2: Experiments in Behavior Made Easy. Behavior Research Methods 51 1 (2019) 195\u2013203. 10.3758\/s13428-018-01193-y","DOI":"10.3758\/s13428-018-01193-y"},{"key":"e_1_3_3_1_25_1","unstructured":"Mihir Prabhudesai Anirudh Goyal Deepak Pathak and Katerina Fragkiadaki. 2023. Aligning Text-to-Image Diffusion Models with Reward Backpropagation. arxiv:https:\/\/arXiv.org\/abs\/2310.03739"},{"key":"e_1_3_3_1_26_1","doi-asserted-by":"publisher","unstructured":"Philip P\u00e4rnamets Petter Johansson Lars Hall Christian Balkenius Michael\u00a0J. Spivey and Daniel\u00a0C. Richardson. 2015. Biasing moral decisions by exploiting the dynamics of eye gaze. Proceedings of the National Academy of Sciences 112 13 (2015) 4170\u20134175. 10.1073\/pnas.1415250112","DOI":"10.1073\/pnas.1415250112"},{"key":"e_1_3_3_1_27_1","series-title":"(NIPS \u201923)","volume-title":"Proceedings of the 37th International Conference on Neural Information Processing Systems","author":"Rafailov Rafael","year":"2023","unstructured":"Rafael Rafailov, Archit Sharma, Eric Mitchell, Stefano Ermon, Christopher\u00a0D. Manning, and Chelsea Finn. 2023. Direct preference optimization: your language model is secretly a reward model. In Proceedings of the 37th International Conference on Neural Information Processing Systems (New Orleans, LA, USA) (NIPS \u201923). Curran Associates Inc., Red Hook, NY, USA, Article 2338, 14\u00a0pages."},{"key":"e_1_3_3_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/355017.355028"},{"key":"e_1_3_3_1_29_1","volume-title":"The Thirty-ninth Annual Conference on Neural Information Processing Systems","author":"Sawarni Ayush","year":"2025","unstructured":"Ayush Sawarni, Sahasrajit Sarmasarkar, and Vasilis Syrgkanis. 2025. Preference Learning with Response Time: Robust Losses and Guarantees. In The Thirty-ninth Annual Conference on Neural Information Processing Systems."},{"key":"e_1_3_3_1_30_1","doi-asserted-by":"publisher","unstructured":"Elizabeth\u00a0R. Schotter Raymond\u00a0W. Berry Craig R.\u00a0M. McKenzie and Keith Rayner. 2010. Gaze bias: Selective encoding and liking effects. Visual Cognition 18 8 (2010) 1113\u20131132. 10.1080\/13506281003668900","DOI":"10.1080\/13506281003668900"},{"key":"e_1_3_3_1_31_1","doi-asserted-by":"publisher","unstructured":"Shinsuke Shimojo Claudiu Simion Eiko Shimojo and Christian Scheier. 2003. Gaze bias both reflects and influences preference. Nature Neuroscience 6 12 (2003) 1317\u20131322. 10.1038\/nn1150","DOI":"10.1038\/nn1150"},{"key":"e_1_3_3_1_32_1","doi-asserted-by":"publisher","unstructured":"Claudiu Simion and Shinsuke Shimojo. 2006. Early interactions between orienting visual sampling and decision making in facial preference. Vision Research 46 20 (2006) 3331\u20133335. 10.1016\/j.visres.2006.04.019","DOI":"10.1016\/j.visres.2006.04.019"},{"key":"e_1_3_3_1_33_1","doi-asserted-by":"publisher","unstructured":"Claudiu Simion and Shinsuke Shimojo. 2007. Interrupting the Cascade: Orienting Contributes to Decision Making Even in the Absence of Visual Stimulation. Perception & Psychophysics 69 (2007) 591\u2013595. 10.3758\/BF03193916","DOI":"10.3758\/BF03193916"},{"key":"e_1_3_3_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.00786"},{"key":"e_1_3_3_1_35_1","unstructured":"Binghai Wang Rui Zheng Lu Chen Yan Liu Shihan Dou Caishuang Huang Wei Shen Senjie Jin Enyu Zhou Chenyu Shi Songyang Gao Nuo Xu Yuhao Zhou Xiaoran Fan Zhiheng Xi Jun Zhao Xiao Wang Tao Ji Hang Yan Lixing Shen Zhan Chen Tao Gui Qi Zhang Xipeng Qiu Xuanjing Huang Zuxuan Wu and Yu-Gang Jiang. 2024. Secrets of RLHF in Large Language Models Part II: Reward Modeling. arxiv:https:\/\/arXiv.org\/abs\/2401.06080"},{"key":"e_1_3_3_1_36_1","unstructured":"Xiaoshi Wu Yiming Hao Keqiang Sun Yixiong Chen Feng Zhu Rui Zhao and Hongsheng Li. 2023. Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2306.09341 (2023)."},{"key":"e_1_3_3_1_37_1","first-page":"15903","volume-title":"Proceedings of the 37th International Conference on Neural Information Processing Systems","author":"Xu Jiazheng","year":"2023","unstructured":"Jiazheng Xu, Xiao Liu, Yuchen Wu, Yuxuan Tong, Qinkai Li, Ming Ding, Jie Tang, and Yuxiao Dong. 2023. ImageReward: learning and evaluating human preferences for text-to-image generation. In Proceedings of the 37th International Conference on Neural Information Processing Systems. 15903\u201315935."},{"key":"e_1_3_3_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.00766"},{"key":"e_1_3_3_1_39_1","first-page":"51112","volume-title":"International Conference on Learning Representations","volume":"2025","author":"Zhu Huaisheng","year":"2025","unstructured":"Huaisheng Zhu, Teng Xiao, and Vasant Honavar. 2025. DSPO: Direct Score Preference Optimization for Diffusion Model Alignment. In International Conference on Learning Representations , Y.\u00a0Yue, A.\u00a0Garg, N.\u00a0Peng, F.\u00a0Sha, and R.\u00a0Yu (Eds.), Vol.\u00a02025. 51112\u201351133."}],"event":{"name":"ETRA '26: 2026 Symposium on Eye Tracking Research and Applications","location":"Marrakesh Morocco","acronym":"ETRA '26","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction","SIGGRAPH ACM Special Interest Group on Computer Graphics and Interactive Techniques"]},"container-title":["Proceedings of the 2026 Symposium on Eye Tracking Research and Applications"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3797246.3803031","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,21]],"date-time":"2026-06-21T01:08:14Z","timestamp":1782004094000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3797246.3803031"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,31]]},"references-count":38,"alternative-id":["10.1145\/3797246.3803031","10.1145\/3797246"],"URL":"https:\/\/doi.org\/10.1145\/3797246.3803031","relation":{},"subject":[],"published":{"date-parts":[[2026,5,31]]},"assertion":[{"value":"2026-05-31","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}