{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,3]],"date-time":"2026-05-03T03:15:18Z","timestamp":1777778118041,"version":"3.51.4"},"reference-count":91,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2016,7,26]],"date-time":"2016-07-26T00:00:00Z","timestamp":1469491200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Information Visualization"],"published-print":{"date-parts":[[2016,10]]},"abstract":"<jats:p>The application of eye tracking for the evaluation of humans\u2019 viewing behavior is a common approach in psychological research. So far, the use of this technique for the evaluation of visual analytics and visualization is less prominent. We investigate recent scientific publications from the main visualization and visual analytics conferences and journals, as well as related research fields that include an evaluation by eye tracking. Furthermore, we provide an overview of evaluation goals that can be achieved by eye tracking and state-of-the-art analysis techniques for eye tracking data. Ideally, visual analytics leads to a mixed-initiative cognitive system where the mechanism of distribution is the interaction of the user with the visualization environment. Therefore, we also include a discussion of cognitive approaches and models to include the user in the evaluation process. Based on our review of the current use of eye tracking evaluation in our field and the cognitive theory, we propose directions for future research on evaluation methodology, leading to the grand challenge of developing an evaluation approach to the mixed-initiative cognitive system of visual analytics.<\/jats:p>","DOI":"10.1177\/1473871615609787","type":"journal-article","created":{"date-parts":[[2015,10,27]],"date-time":"2015-10-27T22:36:05Z","timestamp":1445985365000},"page":"340-358","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":38,"title":["Eye tracking evaluation of visual analytics"],"prefix":"10.1177","volume":"15","author":[{"given":"Kuno","family":"Kurzhals","sequence":"first","affiliation":[{"name":"University of Stuttgart, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brian","family":"Fisher","sequence":"additional","affiliation":[{"name":"Simon Fraser University, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Burch","sequence":"additional","affiliation":[{"name":"University of Stuttgart, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Weiskopf","sequence":"additional","affiliation":[{"name":"University of Stuttgart, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2016,7,26]]},"reference":[{"key":"bibr1-1473871615609787","doi-asserted-by":"publisher","DOI":"10.3758\/BF03195475"},{"key":"bibr2-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-5379-7"},{"key":"bibr3-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1126\/science.177.4043.77"},{"key":"bibr4-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1037\/0096-1523.4.4.565"},{"key":"bibr5-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1080\/13506280902793843"},{"key":"bibr6-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.113.4.766"},{"key":"bibr7-1473871615609787","first-page":"63","volume-title":"Proceedings EuroVis state of the art reports","author":"Blascheck T","year":"2014"},{"key":"bibr8-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1037\/0096-1523.21.6.1506"},{"key":"bibr9-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.1997.tb00459.x"},{"key":"bibr10-1473871615609787","first-page":"61","volume-title":"Proceedings of the fifth workshop on beyond time and errors: novel evaluation methods for visualization (BELIV \u201814)","author":"Kurzhals K"},{"key":"bibr11-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-70956-5_2"},{"key":"bibr12-1473871615609787","first-page":"109","volume-title":"Proceedings of the working conference on advanced visual interfaces AVI \u201804","author":"Plaisant C"},{"key":"bibr13-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2013.151"},{"key":"bibr14-1473871615609787","first-page":"12:1","volume-title":"Proceedings of the workshop on beyond time and errors: novel evaluation methods for visualization (BELIV \u201812)","author":"Elmqvist N"},{"key":"bibr15-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-7485-2_16"},{"key":"bibr16-1473871615609787","first-page":"315","volume-title":"Handbook of Human Centric Visualization","author":"Freitas CMDS"},{"key":"bibr17-1473871615609787","first-page":"71","volume-title":"Proceedings of the workshop on beyond time and errors: novel evaluation methods for visualization (BELIV \u201810)","author":"Goldberg JH"},{"key":"bibr18-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.279"},{"key":"bibr19-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.126"},{"key":"bibr20-1473871615609787","volume-title":"Illuminating the Path: The Research and Development Agenda for Visual Analytics","author":"Thomas JJ","year":"2005"},{"key":"bibr21-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1057\/ivs.2009.28"},{"key":"bibr22-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.276"},{"key":"bibr23-1473871615609787","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/5657.001.0001"},{"key":"bibr24-1473871615609787","first-page":"5:1","volume-title":"Proceedings of the workshop on beyond time and errors: novel evaluation methods for visualization (BELIV \u201812)","author":"Anderson EW"},{"key":"bibr25-1473871615609787","first-page":"69","volume-title":"Proceedings of the symposium on ETRA \u201808","author":"Klingner J"},{"key":"bibr26-1473871615609787","volume-title":"Eye Tracking: A Comprehensive Guide to Methods and Measures","author":"Holmqvist K","year":"2011"},{"key":"bibr27-1473871615609787","doi-asserted-by":"publisher","DOI":"10.4018\/978-1-59140-562-7.ch034"},{"key":"bibr28-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2011.02.008"},{"key":"bibr29-1473871615609787","first-page":"101","volume-title":"Proceedings of the symposium on ETRA \u201810","author":"Grindinger T"},{"key":"bibr30-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2006.70"},{"key":"bibr31-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.120"},{"key":"bibr32-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12115"},{"key":"bibr33-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.149"},{"key":"bibr34-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.194"},{"key":"bibr35-1473871615609787","first-page":"43","volume-title":"Proceedings of the symposium on ETRA \u201814","author":"Kurzhals K"},{"key":"bibr36-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/IV.2013.32"},{"key":"bibr37-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1007\/BF00422717"},{"key":"bibr38-1473871615609787","doi-asserted-by":"publisher","DOI":"10.4324\/9781315799438"},{"key":"bibr39-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.111.4.1036"},{"key":"bibr40-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1037\/0096-1523.31.2.235"},{"key":"bibr41-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1016\/S1364-6613(00)01477-7"},{"key":"bibr42-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1007\/11510154_2"},{"key":"bibr43-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-19641-6_2"},{"key":"bibr44-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-37620-8_3"},{"key":"bibr45-1473871615609787","first-page":"272","volume-title":"Proceedings of the ACM SIGCHI conference on human factors in computing systems (CHI \u201997)","author":"Faraday P"},{"key":"bibr46-1473871615609787","first-page":"360","volume-title":"Proceedings of the 1982 conference on human factors in computing systems (CHI \u201982)","author":"Bolt RA"},{"key":"bibr47-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467757"},{"key":"bibr48-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/APVIS.2007.329282"},{"key":"bibr49-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.215"},{"key":"bibr50-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.70624"},{"key":"bibr51-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12092"},{"key":"bibr52-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346420"},{"key":"bibr53-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/IV.2009.25"},{"key":"bibr54-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2377753"},{"key":"bibr55-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01457.x"},{"key":"bibr56-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/PacificVis.2013.6596142"},{"key":"bibr57-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.193"},{"key":"bibr58-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1177\/1473871611406623"},{"key":"bibr59-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2371858"},{"key":"bibr60-1473871615609787","first-page":"51","volume-title":"Proceedings of the Asia\u2013Pacific symposium on visualization","author":"Huang W","year":"2005"},{"key":"bibr61-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2315995"},{"key":"bibr62-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/VISUAL.2005.1532837"},{"key":"bibr63-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.42"},{"key":"bibr64-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.271"},{"key":"bibr65-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9280.00309"},{"key":"bibr66-1473871615609787","first-page":"402","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems (CHI \u201999)","author":"Byrne MD"},{"key":"bibr67-1473871615609787","first-page":"211","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems (CHI \u201902)","author":"Ehret BD"},{"key":"bibr68-1473871615609787","first-page":"249","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems CHI \u201903","author":"Hornof AJ"},{"key":"bibr69-1473871615609787","first-page":"27","volume-title":"Proceedings of the symposium on ETRA \u201906","author":"Peters RJ"},{"key":"bibr70-1473871615609787","first-page":"254","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems (CHI \u201999)","author":"Salvucci DD"},{"key":"bibr71-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.154"},{"key":"bibr72-1473871615609787","first-page":"417","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems (CHI \u201907)","author":"Guan Z"},{"key":"bibr73-1473871615609787","first-page":"1225","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems (CHI \u201911)","author":"Huang J"},{"key":"bibr74-1473871615609787","first-page":"311","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems (CHI \u201905)","author":"Iqbal ST"},{"key":"bibr75-1473871615609787","first-page":"141","volume-title":"Proceedings of the symposium on ETRA \u201910","author":"Palinko O"},{"key":"bibr76-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1145\/355017.355042"},{"key":"bibr77-1473871615609787","first-page":"1161","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems (CHI \u201911)","author":"Elling S"},{"key":"bibr78-1473871615609787","first-page":"1253","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems (CHI \u201906)","author":"Guan Z"},{"key":"bibr79-1473871615609787","first-page":"135","volume-title":"Proceedings of the symposium on ETRA \u201814","author":"Raschke M"},{"key":"bibr80-1473871615609787","first-page":"70","volume-title":"Proceedings of the workshop on beyond time and errors: novel evaluation methods for visualization (BELIV \u201914)","author":"Blascheck T"},{"key":"bibr81-1473871615609787","volume-title":"The Psychology of Human\u2013Computer Interaction","author":"Card SK","year":"1983"},{"key":"bibr82-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1126\/science.7777863"},{"key":"bibr83-1473871615609787","first-page":"431","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems (CHI \u201907)","author":"Halverson T"},{"key":"bibr84-1473871615609787","first-page":"284","volume-title":"Proceedings of the international joint conference on computer vision, imaging and computer graphics theory and applications (IVAAP)","author":"Raschke M","year":"2014"},{"key":"bibr85-1473871615609787","first-page":"221","volume-title":"Proceedings of the 11th international conference on cognitive modeling","author":"Raschke M","year":"2013"},{"key":"bibr86-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-54894-9"},{"key":"bibr87-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-55860-092-8.50006-X"},{"key":"bibr88-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci1204_4"},{"key":"bibr89-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog2502_2"},{"key":"bibr90-1473871615609787","doi-asserted-by":"publisher","DOI":"10.1111\/j.1756-8765.2011.01148.x"},{"key":"bibr91-1473871615609787","first-page":"1","volume-title":"Proceedings of the workshop on: beyond time and errors: novel evaluation methods for visualization (BELIV \u201812)","volume":"14","author":"Kaastra LT"}],"container-title":["Information Visualization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1473871615609787","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1473871615609787","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1473871615609787","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T19:18:43Z","timestamp":1777490323000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1473871615609787"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,7,26]]},"references-count":91,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,10]]}},"alternative-id":["10.1177\/1473871615609787"],"URL":"https:\/\/doi.org\/10.1177\/1473871615609787","relation":{},"ISSN":["1473-8716","1473-8724"],"issn-type":[{"value":"1473-8716","type":"print"},{"value":"1473-8724","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,7,26]]}}}