{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T07:23:33Z","timestamp":1780471413401,"version":"3.54.1"},"reference-count":70,"publisher":"Association for Computing Machinery (ACM)","issue":"ETRA","license":[{"start":{"date-parts":[[2024,5,20]],"date-time":"2024-05-20T00:00:00Z","timestamp":1716163200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany's Excellence Strategy","award":["EXC 2075 -- 390740016"],"award-info":[{"award-number":["EXC 2075 -- 390740016"]}]},{"name":"European Research Council","award":["801708"],"award-info":[{"award-number":["801708"]}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"crossref","award":["Project-ID 251654672 -- TRR 161"],"award-info":[{"award-number":["Project-ID 251654672 -- TRR 161"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Swiss National Science Foundation (SNSF) through a Postdoc.Mobility Fellowship","award":["214434"],"award-info":[{"award-number":["214434"]}]},{"DOI":"10.13039\/501100002341","name":"Research Council of Finland","doi-asserted-by":"crossref","award":["(Subjective Functions, grant 357578)"],"award-info":[{"award-number":["(Subjective Functions, grant 357578)"]}],"id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,5,20]]},"abstract":"<jats:p>Question answering has recently been proposed as a promising means to assess the recallability of information visualisations. However, prior works are yet to study the link between visually encoding a visualisation in memory and recall performance. To fill this gap, we propose VisRecall++ -- a novel 40-participant recallability dataset that contains gaze data on 200 visualisations and 1,000 questions, including identifying the title and retrieving values. We measured recallability by asking participants questions after they observed the visualisation for 10 seconds. Our analyses reveal several insights, such as saccade amplitude, number of fixations, and fixation duration significantly differ between high and low recallability groups. Finally, we propose GazeRecallNet -- a novel computational method to predict recallability from gaze behaviour that outperforms the state-of-the-art model RecallNet and three other baselines on this task. Taken together, our results shed light on assessing recallability from gaze behaviour and inform future work on recallability-based visualisation optimisation.<\/jats:p>","DOI":"10.1145\/3655613","type":"journal-article","created":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T16:00:05Z","timestamp":1716912005000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["VisRecall++: Analysing and Predicting Visualisation Recallability from Gaze Behaviour"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3633-8623","authenticated-orcid":false,"given":"Yao","family":"Wang","sequence":"first","affiliation":[{"name":"University of Stuttgart, Stuttgart, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0022-6512","authenticated-orcid":false,"given":"Yue","family":"Jiang","sequence":"additional","affiliation":[{"name":"Aalto University, Espoo, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5105-9753","authenticated-orcid":false,"given":"Zhiming","family":"Hu","sequence":"additional","affiliation":[{"name":"University of Stuttgart, Stuttgart, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-3471-9975","authenticated-orcid":false,"given":"Constantin","family":"Ruhdorfer","sequence":"additional","affiliation":[{"name":"University of Stuttgart, Stuttgart, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1446-379X","authenticated-orcid":false,"given":"Mihai","family":"B\u00e2ce","sequence":"additional","affiliation":[{"name":"KU Leuven, Leuven, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6317-7303","authenticated-orcid":false,"given":"Andreas","family":"Bulling","sequence":"additional","affiliation":[{"name":"University of Stuttgart, Stuttgart, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,5,28]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379156.3391335"},{"key":"e_1_2_2_2_1","volume-title":"Memorability: How what we see influences what we remember. In Psychology of learning and motivation.","author":"Bainbridge Wilma A","year":"2019","unstructured":"Wilma A Bainbridge. 2019. Memorability: How what we see influences what we remember. In Psychology of learning and motivation. Vol. 70. Elsevier, 1--27."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1212\/WNL.25.11.1065"},{"key":"e_1_2_2_4_1","volume-title":"Proceedings of the 2010 CHI Conference on Human Factors in Computing Systems (CHI). 2573--2582","author":"Bateman Scott","year":"2010","unstructured":"Scott Bateman, Regan L Mandryk, Carl Gutwin, Aaron Genest, David McDine, and Christopher Brooks. 2010. Useful junk? The effects of visual embellishment on comprehension and memorability of charts. In Proceedings of the 2010 CHI Conference on Human Factors in Computing Systems (CHI). 2573--2582."},{"key":"e_1_2_2_5_1","unstructured":"Tanja Blascheck Kuno Kurzhals Michael Raschke Michael Burch Daniel Weiskopf and Thomas Ertl. 2014. State-of-the-art of visualization for eye tracking data. In EuroVis (STARs). 1--20."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2016.05.047"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467732"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.234"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/MITS.2017.2743171"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2030112.2030172"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2014.42"},{"key":"e_1_2_2_12_1","volume-title":"ETVIS","author":"Burch Michael","year":"2017","unstructured":"Michael Burch, Lewis Chuang, Brian Fisher, Albrecht Schmidt, and Daniel Weiskopf. 2017. Eye tracking and visualization: Foundations, Techniques, and applications. ETVIS 2015."},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3503252.3531302"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV45572.2020.9093269"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3588015.3589841"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3588015.3589844"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01073"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1179"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1037\/0278-7393.17.4.693"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1167\/19.14.22"},{"key":"e_1_2_2_21_1","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) (NAACL). 4171--4186."},{"key":"e_1_2_2_22_1","first-page":"25","article-title":"Analysing eye-tracking data: From scanpaths and heatmaps to the dynamic visualisation of areas of interest. Advances in Science, Technology","volume":"20","author":"Drusch Gautier","year":"2014","unstructured":"Gautier Drusch, JC Bastien, and St\u00e9fane Paris. 2014. Analysing eye-tracking data: From scanpaths and heatmaps to the dynamic visualisation of areas of interest. Advances in Science, Technology, Higher Education and Society in the Conceptual Age (STHESCA), Vol. 20, 205 (2014), 25.","journal-title":"Higher Education and Society in the Conceptual Age (STHESCA)"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.7086"},{"key":"e_1_2_2_24_1","volume-title":"John T Stasko, and Chris North.","author":"Fekete Jean-Daniel","year":"2008","unstructured":"Jean-Daniel Fekete, Jarke J Van Wijk, John T Stasko, and Chris North. 2008. The value of information visualization. Information Visualization: Human-Centered Issues and Perspectives (2008), 1--18."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00453"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3204493.3204575"},{"key":"e_1_2_2_27_1","volume-title":"Long short-term memory. Neural computation","author":"Hochreiter Sepp","year":"1997","unstructured":"Sepp Hochreiter and J\u00fcrgen Schmidhuber. 1997. Long short-term memory. Neural computation, Vol. 9, 8 (1997), 1735--1780."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/VRW50115.2020.00123"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3138902"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343031.3350573"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1362550.1362587"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298710"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3586183.3606780"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2019.102376"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.3390\/ijgi12010021"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.215"},{"key":"e_1_2_2_37_1","volume-title":"Computer Graphics Forum","author":"Kim Younghoon","unstructured":"Younghoon Kim and Jeffrey Heer. 2018. Assessing effects of task and data distribution on the effectiveness of visual encodings. In Computer Graphics Forum, Vol. 37. Wiley Online Library, 157--167. Issue 3."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025592"},{"key":"e_1_2_2_39_1","volume-title":"Proceedings of the 3rd International Conference on Learning Representations (ICLR). 1--11","author":"Kingma Diederik P","year":"2015","unstructured":"Diederik P Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of the 3rd International Conference on Learning Representations (ICLR). 1--11."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300576"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2834121"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2013.04.035"},{"key":"e_1_2_2_43_1","volume-title":"Eye fixations and recognition memory for pictures. Cognitive psychology","author":"Loftus Geoffrey R","year":"1972","unstructured":"Geoffrey R Loftus. 1972. Eye fixations and recognition memory for pictures. Cognitive psychology, Vol. 3, 4 (1972), 525--551."},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-1523.4.4.565"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV45572.2020.9093523"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.20131"},{"key":"e_1_2_2_47_1","volume-title":"British Machine Vision Conference (BMVC). 1--13","author":"Palmero Cristina","year":"2018","unstructured":"Cristina Palmero, Javier Selva, Mohammad Ali Bagheri, and Sergio Escalera. 2018. Recurrent cnn for 3d gaze estimation using appearance and shape cues. In British Machine Vision Conference (BMVC). 1--13."},{"key":"e_1_2_2_48_1","volume-title":"Proceedings, Part XII 16","author":"Park Seonwook","year":"2020","unstructured":"Seonwook Park, Emre Aksan, Xucong Zhang, and Otmar Hilliges. 2020. Towards end-to-end video-based eye-tracking. In Computer Vision--ECCV 2020: 16th European Conference, Glasgow, UK, August 23--28, 2020, Proceedings, Part XII 16. Springer, 747--763."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357101"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858117"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2018.01.010"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3576050.3576063"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2020.04.001"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/355017.355028"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.01.028"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.120"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743666.1743693"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00031"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-32381-3_16"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1097\/01445442-198507000-00012"},{"key":"e_1_2_2_61_1","volume-title":"Nora Hillman Goeler, and Richard Benson","author":"Tufte Edward R","year":"1990","unstructured":"Edward R Tufte, Nora Hillman Goeler, and Richard Benson. 1990. Envisioning information. Vol. 126."},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0017739"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300839"},{"key":"e_1_2_2_64_1","volume-title":"Scanpath Prediction on Information Visualisations","author":"Wang Yao","year":"2023","unstructured":"Yao Wang, Mihai B\u00e2ce, and Andreas Bulling. 2023. Scanpath Prediction on Information Visualisations. IEEE Transactions on Visualization and Computer Graphics (TVCG) (2023), 1--15."},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2022.3198163"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3517031.3531166"},{"key":"e_1_2_2_67_1","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL)","volume":"1","author":"Xu Hu","year":"2019","unstructured":"Hu Xu, Bing Liu, Lei Shu, and Philip Yu. 2019. BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL), Vol. 1. 2324--2335."},{"key":"e_1_2_2_68_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 5333--5342","author":"Xu Yanyu","year":"2018","unstructured":"Yanyu Xu, Yanbing Dong, Junru Wu, Zhengzhong Sun, Zhiru Shi, Jingyi Yu, and Shenghua Gao. 2018. Gaze Prediction in Dynamic 360\u00b0 Immersive Videos. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 5333--5342."},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3517031.3529241"},{"key":"e_1_2_2_70_1","volume-title":"Mpiigaze: Real-world dataset and deep appearance-based gaze estimation","author":"Zhang Xucong","year":"2017","unstructured":"Xucong Zhang, Yusuke Sugano, Mario Fritz, and Andreas Bulling. 2017. Mpiigaze: Real-world dataset and deep appearance-based gaze estimation. IEEE transactions on pattern analysis and machine intelligence, Vol. 41, 1 (2017), 162--175."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3655613","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3655613","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,23]],"date-time":"2025-08-23T01:23:45Z","timestamp":1755912225000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3655613"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,20]]},"references-count":70,"journal-issue":{"issue":"ETRA","published-print":{"date-parts":[[2024,5,20]]}},"alternative-id":["10.1145\/3655613"],"URL":"https:\/\/doi.org\/10.1145\/3655613","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,20]]},"assertion":[{"value":"2024-05-28","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}