{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T00:06:50Z","timestamp":1773878810959,"version":"3.50.1"},"reference-count":56,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T00:00:00Z","timestamp":1773792000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000286","name":"British Academy","doi-asserted-by":"publisher","award":["SRG2324\\240833"],"award-info":[{"award-number":["SRG2324\\240833"]}],"id":[{"id":"10.13039\/501100000286","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JEMR"],"abstract":"<jats:p>Gaze analysis often relies on hypothesised, subjectively defined regions of interest (ROIs) or heatmaps: ROIs enable condition comparisons but reduce objectivity and exploration; while heatmaps avoid this, they require many pixel-wise comparisons, making differences hard to detect. Here, we propose an advanced data-driven approach for analysing gaze behaviour. We use DNNs (adapted versions of AlexNet) to classify conditions from gaze patterns, paired with reverse correlation to show where and how gaze differs between conditions. We test our approach on data from an experiment investigating the effects of object-specific sounds (e.g., church bell ringing) on gaze allocation. ROI-based analysis shows a significant difference between conditions (congruent sound, no sound, phase-scrambled sound and pink noise), with more gaze allocation on sound-associated objects in the congruent sound condition. However, as expected, significance depends on the definition of the ROIs. Heatmaps show some unclear qualitative differences, but none are significant after correcting for pixelwise comparisons. We showed that, for some scenes, the DNNs could classify the task based on individual fixations with accuracy significantly higher than chance. Our approach shows that sound can alter gaze allocation, revealing task-specific, non-trivial strategies: fixations are not always drawn to the sound source but shift away from salient features, sometimes falling between salient features and the sound source. Crucially, such fixation strategies could not be revealed using a traditional hypothesis-driven approach. Overall, the method is objective, data-driven, and enables clear comparisons of conditions.<\/jats:p>","DOI":"10.3390\/jemr19020033","type":"journal-article","created":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T17:12:26Z","timestamp":1773853946000},"page":"33","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Data-Driven Approach for Comparing Gaze Allocation Across Conditions"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-4101-9819","authenticated-orcid":false,"given":"Jack","family":"Prosser","sequence":"first","affiliation":[{"name":"School of Psychology, Bournemouth University, Poole BH12 5BB, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anna","family":"Metzger","sequence":"additional","affiliation":[{"name":"School of Psychology, Bournemouth University, Poole BH12 5BB, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matteo","family":"Toscani","sequence":"additional","affiliation":[{"name":"School of Psychology, Bournemouth University, Poole BH12 5BB, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"428","DOI":"10.1016\/S0959-4388(03)00105-3","article-title":"Visual attention: The where, what, how and why of saliency","volume":"13","author":"Treue","year":"2003","journal-title":"Curr. Opin. Neurobiol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1038\/35058500","article-title":"Computational modelling of visual attention","volume":"2","author":"Itti","year":"2001","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3852","DOI":"10.1109\/TIP.2016.2577498","article-title":"A Locally Weighted Fixation Density-Based Metric for Assessing the Quality of Visual Saliency Predictions","volume":"25","author":"Gide","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1016\/j.visres.2004.09.017","article-title":"Visual correlates of fixation selection: Effects of scale and time","volume":"45","author":"Tatler","year":"2005","journal-title":"Vis. Res."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yarbus, A.L. (1967). Eye Movements During Perception of Complex Objects. Eye Movements and Vision, Springer US.","DOI":"10.1007\/978-1-4899-5379-7"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.tics.2005.02.009","article-title":"Eye movements in natural behavior","volume":"9","author":"Hayhoe","year":"2005","journal-title":"Trends Cogn. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1017\/S0952523808080899","article-title":"Vision, eye movements, and natural behavior","volume":"26","author":"Land","year":"2009","journal-title":"Vis. Neurosci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1167\/11.5.9","article-title":"Eye movements and perception: A selective review","volume":"11","author":"Braun","year":"2011","journal-title":"J. Vis."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1167\/16.15.21","article-title":"Lightness perception for surfaces moving through different illumination levels","volume":"16","author":"Toscani","year":"2016","journal-title":"J. Vis."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"11163","DOI":"10.1073\/pnas.1216954110","article-title":"Optimal sampling of visual information for lightness judgments","volume":"110","author":"Toscani","year":"2013","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"20130056","DOI":"10.1098\/rstb.2013.0056","article-title":"Selection of visual information for lightness judgements by eye movements","volume":"368","author":"Toscani","year":"2013","journal-title":"Philos. Trans. R. Soc. B Biol. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2041669519889070","DOI":"10.1177\/2041669519889070","article-title":"Gloss and speed judgments yield different fine tuning of saccadic sampling in dynamic scenes","volume":"10","author":"Toscani","year":"2019","journal-title":"i-Perception"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1177\/03010066241253816","article-title":"Perceptual task drives later fixations and long latency saccades, while early fixations and short latency saccades are more automatic","volume":"53","author":"Metzger","year":"2024","journal-title":"Perception"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.visres.2012.03.019","article-title":"Reconsidering Yarbus: A failure to predict observers\u2019 task from eye movement patterns","volume":"62","author":"Greene","year":"2012","journal-title":"Vis. Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1167\/jov.24.5.3","article-title":"Oculomotor routines for perceptual judgments","volume":"24","author":"Aizenman","year":"2024","journal-title":"J. Vis."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Toscani, M., Gather, M., Seiss, E., and Metzger, A. (2026). EXPRESS: Effect of prior haptic object exploration on eye-movements. Q. J. Exp. Psychol., 17470218261417305.","DOI":"10.1177\/17470218261417305"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"180596","DOI":"10.1098\/rsos.180596","article-title":"Task instructions can accelerate the early preference for social features in naturalistic scenes","volume":"6","author":"End","year":"2019","journal-title":"R. Soc. Open Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1645","DOI":"10.3758\/s13428-017-0998-z","article-title":"Threats to the validity of eye-movement research in psychology","volume":"50","author":"Orquin","year":"2018","journal-title":"Behav. Res. Methods"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1002\/bdm.1867","article-title":"Areas of Interest as a Signal Detection Problem in Behavioral Eye-Tracking Research","volume":"29","author":"Orquin","year":"2016","journal-title":"J. Behav. Decis. Mak."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.jml.2016.10.003","article-title":"False positives and other statistical errors in standard analyses of eye movements in reading","volume":"94","author":"Angele","year":"2017","journal-title":"J. Mem. Lang."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"515","DOI":"10.3109\/09637486.2012.759187","article-title":"How do design features influence consumer attention when looking for nutritional information on food labels? Results from an eye-tracking study on pan bread labels","volume":"64","author":"Vidal","year":"2013","journal-title":"Int. J. Food Sci. Nutr."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1167\/15.12.783","article-title":"Objects in the peripheral visual field influence gaze location in natural vision","volume":"15","author":"Hitzel","year":"2015","journal-title":"J. Vis."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wooding, D.S. (2002, January 25\u201327). Fixation Maps: Quantifying Eye-Movement Traces. Proceedings of the Eye Tracking Research & Application Symposium, ETRA 2002, New Orleans, LA, USA.","DOI":"10.1145\/507072.507078"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3327","DOI":"10.1080\/014311600750019930","article-title":"Locating regions-of-interest for the Mars Rover expedition","volume":"21","author":"Privitera","year":"2000","journal-title":"Int. J. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Santella, A., and DeCarlo, D. (2004, January 22\u201324). Robust clustering of eye movement recordings for quantification of visual interest. Proceedings of the Eye Tracking Research & Application Symposium, ETRA 2004, San Antonio, TX, USA.","DOI":"10.1145\/968363.968368"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1751","DOI":"10.1121\/1.1912577","article-title":"Stimulus Features in Signal Detection","volume":"49","author":"Ahumada","year":"1971","journal-title":"J. Acoust. Soc. Am."},{"key":"ref_27","unstructured":"Rogowitz, B.E., and Pappas, T.N. (1998). Technique to Extract Relevant Image Features for Visual Tasks, SPIE."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"i","DOI":"10.1167\/2.1.i","article-title":"Classification images: A tool to analyze visual strategies","volume":"2","author":"Eckstein","year":"2002","journal-title":"J. Vis."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1943","DOI":"10.1016\/j.cub.2005.09.040","article-title":"Mechanisms for Allocating Auditory Attention: An Auditory Saliency Map","volume":"15","author":"Kayser","year":"2005","journal-title":"Curr. Biol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1395","DOI":"10.1038\/s41598-020-80675-6","article-title":"Deep neural network model of haptic saliency","volume":"11","author":"Metzger","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2109","DOI":"10.1177\/09567976221121348","article-title":"What You See Is What You Hear: Sounds Alter the Contents of Visual Perception","volume":"33","author":"Williams","year":"2022","journal-title":"Psychol. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/415429a","article-title":"Humans integrate visual and haptic information in a statistically optimal fashion","volume":"415","author":"Ernst","year":"2002","journal-title":"Nature"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"729","DOI":"10.1080\/00140139.2013.771219","article-title":"Improving target detection in visual search through the augmenting multi-sensory cues","volume":"56","author":"Hancock","year":"2013","journal-title":"Ergonomics"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1149","DOI":"10.3758\/BRM.41.4.1149","article-title":"Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses","volume":"41","author":"Faul","year":"2009","journal-title":"Behav. Res. Methods"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Piczak, K.J. (2015). ESC: Dataset for Environmental Sound Classification. Proceedings of the 23rd ACM International Conference on Multimedia, Brisbane, Australia, 26\u201330 October 2015, ACM.","DOI":"10.1145\/2733373.2806390"},{"key":"ref_36","unstructured":"(2026, March 12). Public Domain Sounds Backup [Internet]. Available online: https:\/\/pdsounds.tuxfamily.org\/."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1167\/7.14.4","article-title":"The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions","volume":"7","author":"Tatler","year":"2007","journal-title":"J. Vis."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1167\/8.14.18","article-title":"Objects predict fixations better than early saliency","volume":"8","author":"Spain","year":"2008","journal-title":"J. Vis."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"A353","DOI":"10.1364\/JOSAA.29.00A353","article-title":"Role of eye movements in chromatic induction","volume":"29","author":"Granzier","year":"2012","journal-title":"J. Opt. Soc. Am. A"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1007\/s42979-021-00855-7","article-title":"Colour calibration of a head mounted display for colour vision research using virtual reality","volume":"3","author":"Bayer","year":"2022","journal-title":"SN Comput. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Toscani, M., Gil, R., Guarnera, D., Guarnera, G., Kalouaz, A., and Gegenfurtner, K.R. (2019). Assessment of OLED Head Mounted Display for Vision Research with Virtual Reality, IEEE.","DOI":"10.1109\/SITIS.2019.00120"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Arizpe, J., Kravitz, D.J., Yovel, G., and Baker, C.I. (2012). Start Position Strongly Influences Fixation Patterns during Face Processing: Difficulties with Eye Movements as a Measure of Information Use. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0031106"},{"key":"ref_43","unstructured":"Raschka, S. (2024). Machine Learning Q and AI: 30 Essential Questions and Answers on Machine Learning and AI, No Starch Press."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"17039","DOI":"10.1038\/s41598-018-35259-w","article-title":"Selective eye fixations on diagnostic face regions of dynamic emotional expressions: KDEF-dyn database","volume":"8","author":"Calvo","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2557","DOI":"10.1016\/j.visres.2007.06.003","article-title":"Perceiving colour at a glimpse: The relevance of where one fixates","volume":"47","author":"Brenner","year":"2007","journal-title":"Vis. Res."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2465","DOI":"10.1016\/j.visres.2006.02.002","article-title":"Receptive versus perceptive fields from the reverse-correlation viewpoint","volume":"46","author":"Neri","year":"2006","journal-title":"Vis. Res."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2081","DOI":"10.1364\/JOSAA.22.002081","article-title":"Classification images for chromatic signal detection","volume":"22","author":"Hansen","year":"2005","journal-title":"J. Opt. Soc. Am. A"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"e64876","DOI":"10.7554\/eLife.64876","article-title":"Unsupervised learning of haptic material properties","volume":"11","author":"Metzger","year":"2022","journal-title":"eLife"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"559","DOI":"10.3758\/s13428-016-0737-x","article-title":"I map4: An open source toolbox for the statistical fixation mapping of eye movement data with linear mixed modeling","volume":"49","author":"Lao","year":"2017","journal-title":"Behav. Res. Methods"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"11687","DOI":"10.1073\/pnas.1820553116","article-title":"Individual differences in visual salience vary along semantic dimensions","volume":"116","author":"Iakovidis","year":"2019","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_51","unstructured":"K\u00fcmmerer, M., Theis, L., and Bethge, M. (2014). Deep gaze i: Boosting saliency prediction with feature maps trained on imagenet. arXiv."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Mahanama, B., Jayawardana, Y., Rengarajan, S., Jayawardena, G., Chukoskie, L., Snider, J., and Jayarathna, S. (2022). Eye movement and pupil measures: A review. Front. Comput. Sci., 3.","DOI":"10.3389\/fcomp.2021.733531"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/j.neulet.2005.11.071","article-title":"Gaze tracking accuracy in humans: Two eyes are better than one","volume":"396","author":"Cui","year":"2006","journal-title":"Neurosci. Lett."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1167\/9.12.10","article-title":"Faces and text attract gaze independent of the task: Experimental data and computer model","volume":"9","author":"Cerf","year":"2009","journal-title":"J. Vis."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.visres.2016.09.012","article-title":"Influence of initial fixation position in scene viewing","volume":"129","author":"Rothkegel","year":"2016","journal-title":"Vis. Res."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Yarbus, A.L. (1967). Eye movements during fixation on stationary objects. Eye Movements and Vision, Springer.","DOI":"10.1007\/978-1-4899-5379-7"}],"container-title":["Journal of Eye Movement Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1995-8692\/19\/2\/33\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T17:29:53Z","timestamp":1773854993000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1995-8692\/19\/2\/33"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,18]]},"references-count":56,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2026,4]]}},"alternative-id":["jemr19020033"],"URL":"https:\/\/doi.org\/10.3390\/jemr19020033","relation":{},"ISSN":["1995-8692"],"issn-type":[{"value":"1995-8692","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,18]]}}}