{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T17:33:12Z","timestamp":1781803992838,"version":"3.54.5"},"reference-count":49,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2016,7,25]],"date-time":"2016-07-25T00:00:00Z","timestamp":1469404800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Information Visualization"],"published-print":{"date-parts":[[2016,10]]},"abstract":"<jats:p>Empirical evaluation methods for visualizations have traditionally focused on assessing the outcome of the visual analytic process as opposed to characterizing how that process unfolds. There are only a handful of methods that can be used to systematically study how people use visualizations, making it difficult for researchers to capture and characterize the subtlety of cognitive and interaction behaviors users exhibit during visual analysis. To validate and improve visualization design, it is important for researchers to be able to assess and understand how users interact with visualization systems under realistic scenarios. This article presents a methodology for modeling and evaluating the behavior of users in exploratory visual analysis. We model visual exploration using a Markov chain process comprising transitions between mental, interaction, and computational states. These states and the transitions between them can be deduced from a variety of sources, including verbal transcripts, videos and audio recordings, and log files. This model enables the evaluator to characterize the cognitive and computational processes that are essential to insight acquisition in exploratory visual analysis and reconstruct the dynamics of interaction between the user and the visualization system. We illustrate this model with two exemplar user studies, and demonstrate the qualitative and quantitative analytical tools it affords.<\/jats:p>","DOI":"10.1177\/1473871616638546","type":"journal-article","created":{"date-parts":[[2016,3,21]],"date-time":"2016-03-21T21:18:24Z","timestamp":1458595104000},"page":"325-339","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":22,"title":["Modeling and evaluating user behavior in exploratory visual analysis"],"prefix":"10.1177","volume":"15","author":[{"given":"Khairi","family":"Reda","sequence":"first","affiliation":[{"name":"Argonne National Laboratory, Argonne, IL, USA"},{"name":"University of Hawai\u2019i at M\u0101noa, Honolulu, HI, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew E.","family":"Johnson","sequence":"additional","affiliation":[{"name":"University of Illinois at Chicago, Chicago, IL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael E.","family":"Papka","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Argonne, IL, USA"},{"name":"Northern Illinois University, DeKalb, IL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason","family":"Leigh","sequence":"additional","affiliation":[{"name":"University of Hawai\u2019i at M\u0101noa, Honolulu, HI, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2016,7,25]]},"reference":[{"key":"bibr1-1473871616638546","volume-title":"Exploratory data analysis","author":"Tukey JW.","year":"1977"},{"key":"bibr2-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1080\/00031305.1980.10482706"},{"key":"bibr3-1473871616638546","volume-title":"The elements of graphing data","author":"Cleveland WS.","year":"1985"},{"key":"bibr4-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1038\/scientificamerican1186-114B"},{"key":"bibr5-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.177"},{"key":"bibr6-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.127"},{"key":"bibr7-1473871616638546","volume-title":"Information visualization: perception for design","author":"Ware C.","year":"2012","edition":"3"},{"key":"bibr8-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-70956-5_2"},{"key":"bibr9-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2005.53"},{"key":"bibr10-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2006.70"},{"key":"bibr11-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1080\/07370020902739429"},{"key":"bibr12-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1177\/1473871611415987"},{"key":"bibr13-1473871616638546","first-page":"16","volume-title":"Proceedings of the 3rd BELIV\u201910 workshop: beyond time and errors: novel evaluation methods for information visualization","author":"Pohl M"},{"key":"bibr14-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467613"},{"key":"bibr15-1473871616638546","first-page":"41","volume-title":"Proceedings of the 5th BELIV\u201914 workshop: beyond time and errors: novel evaluation methods for visualization","author":"Reda K"},{"key":"bibr16-1473871616638546","first-page":"2047","volume-title":"CHI\u201914 extended abstracts on human factors in computing systems","author":"Reda K"},{"key":"bibr17-1473871616638546","first-page":"2759","volume-title":"Proceedings of CHI\u201915: conference on human factors in computing systems","author":"Reda K"},{"key":"bibr18-1473871616638546","first-page":"1","volume-title":"Proceedings of BELIV\u201906 workshop: beyond time and errors: novel evaluation methods for information visualization","author":"Ellis G"},{"key":"bibr19-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.279"},{"key":"bibr20-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2009.111"},{"key":"bibr21-1473871616638546","first-page":"336","volume-title":"Proceedings of the symposium on visual languages","author":"Shneiderman B"},{"key":"bibr22-1473871616638546","first-page":"111","volume-title":"Proceedings of the IEEE symposium on information visualization","author":"Amar R"},{"key":"bibr23-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2005.63"},{"key":"bibr24-1473871616638546","volume-title":"Proceedings of international conference on intelligence analysis","volume":"5","author":"Pirolli P"},{"key":"bibr25-1473871616638546","first-page":"109","volume-title":"Proceedings of the working conference on advanced visual interfaces","author":"Plaisant C"},{"key":"bibr26-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.126"},{"key":"bibr27-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2011.01955.x"},{"key":"bibr28-1473871616638546","first-page":"55","volume-title":"Proceedings of CHI\u201910: conference on human factors in computing systems","author":"Andrews C"},{"key":"bibr29-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2009.22"},{"key":"bibr30-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346575"},{"key":"bibr31-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346452"},{"key":"bibr32-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467871"},{"key":"bibr33-1473871616638546","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/1881.001.0001"},{"issue":"1","key":"bibr34-1473871616638546","first-page":"12","volume":"3","author":"Sedig K","year":"2012","journal-title":"J Multimed Process Technol"},{"key":"bibr35-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-7485-2_28"},{"key":"bibr36-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.28"},{"key":"bibr37-1473871616638546","volume-title":"Markov chains","author":"Norris JR","year":"1998"},{"key":"bibr38-1473871616638546","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/5657.001.0001"},{"key":"bibr39-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.70515"},{"key":"bibr40-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.124"},{"key":"bibr41-1473871616638546","first-page":"473","volume-title":"Proceedings of CHI\u201912: conference on human factors in computing systems","author":"Endert A"},{"key":"bibr42-1473871616638546","first-page":"21","volume-title":"Proceedings of CHI\u201912: conference on human factors in computing systems","author":"Amershi S"},{"key":"bibr43-1473871616638546","first-page":"43","volume-title":"Proceedings of the IEEE conferences on visual analytics science and technology (VAST)","author":"Behrisch M"},{"key":"bibr44-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1007\/11555261_30"},{"key":"bibr45-1473871616638546","volume-title":"The visual display of quantitative information","author":"Tufte ER.","year":"2001","edition":"2"},{"key":"bibr46-1473871616638546","first-page":"196","volume-title":"Proceedings of SC companion: high performance computing, networking, storage and analysis (SCC)","author":"Reda K"},{"key":"bibr47-1473871616638546","first-page":"184","volume-title":"Graph drawing","author":"Purchase HC","year":"2006"},{"key":"bibr48-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2013.37"},{"key":"bibr49-1473871616638546","doi-asserted-by":"publisher","DOI":"10.1057\/ivs.2008.28"}],"container-title":["Information Visualization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1473871616638546","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1473871616638546","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1473871616638546","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T19:18:44Z","timestamp":1777490324000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1473871616638546"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,7,25]]},"references-count":49,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,10]]}},"alternative-id":["10.1177\/1473871616638546"],"URL":"https:\/\/doi.org\/10.1177\/1473871616638546","relation":{},"ISSN":["1473-8716","1473-8724"],"issn-type":[{"value":"1473-8716","type":"print"},{"value":"1473-8724","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,7,25]]}}}