{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,3]],"date-time":"2026-05-03T03:29:36Z","timestamp":1777778976576,"version":"3.51.4"},"reference-count":26,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2012,10,8]],"date-time":"2012-10-08T00:00:00Z","timestamp":1349654400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Information Visualization"],"published-print":{"date-parts":[[2013,1]]},"abstract":"<jats:p>Iterative, opportunistic and evolving visual sense-making has been an important research topic as it assists users in overcoming ever-increasing information overload. Exploratory visualization systems (EVSs) maximize the amount of information users can gain through learning and have been widely used in scientific discovery and decision-making contexts. Although many EVSs have been developed recently, there is a lack of general guidance on how to evaluate such systems. Researchers face challenges such as understanding the cognitive learning process supported by these systems. In this paper, we present a formal user study on Newdle, a clustering-based EVS for large news collections, shedding light on a general methodology for EVS evaluation. Our approach is built upon cognitive load theory, which takes the user as well as the system as the focus of evaluation. The carefully designed procedures allow us to thoroughly examine the user\u2019s cognitive process as well as control the variability among human subjects. Through this study, we analyse how and why clustering-based EVSs benefit (or hinder) users in a variety of information-seeking tasks. We also summarize leverage points for designing clustering-based EVSs.<\/jats:p>","DOI":"10.1177\/1473871612459995","type":"journal-article","created":{"date-parts":[[2012,10,8]],"date-time":"2012-10-08T21:12:39Z","timestamp":1349730759000},"page":"25-43","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":9,"title":["Evaluating exploratory visualization systems: A user study on how clustering-based visualization systems support information seeking from large document collections"],"prefix":"10.1177","volume":"12","author":[{"given":"Yujie","family":"Liu","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of North Carolina at Charlotte, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Scott","family":"Barlowe","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of North Carolina at Charlotte, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yaqin","family":"Feng","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Statistics, University of North Carolina at Charlotte, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jing","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of North Carolina at Charlotte, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Min","family":"Jiang","sequence":"additional","affiliation":[{"name":"Affiliate Faculty, International Studies, Affiliate Researcher, Center for Advanced Research in the Humanities, Complex Systems Institute, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2012,10,8]]},"reference":[{"key":"bibr1-1473871612459995","unstructured":"Popova M. Data visualization: stories for the information age. BloomBerg Businessweek, 2009. http:\/\/www.businessweek.com\/innovate\/content\/aug2009\/id20090811_137179.htm."},{"key":"bibr2-1473871612459995","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2007.09.011"},{"key":"bibr3-1473871612459995","doi-asserted-by":"publisher","DOI":"10.1016\/S1389-1286(99)00054-7"},{"key":"bibr4-1473871612459995","first-page":"51","volume-title":"Proceedings of IEEE information visualization","author":"Wise JA"},{"key":"bibr5-1473871612459995","first-page":"1969","volume-title":"Proceedings of extended abstracts of the ACM conference on human factors in computing systems","author":"Lee B"},{"key":"bibr6-1473871612459995","first-page":"213","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems","author":"Pirolli P"},{"key":"bibr7-1473871612459995","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog1202_4"},{"key":"bibr8-1473871612459995","volume-title":"Designing the user interface: strategies for effective human\u2013computer interaction","author":"Shneiderman B","year":"2010"},{"key":"bibr9-1473871612459995","doi-asserted-by":"publisher","DOI":"10.1145\/567498.567525"},{"key":"bibr10-1473871612459995","first-page":"463","volume":"44","author":"Kules B","year":"2008","journal-title":"Manage"},{"key":"bibr11-1473871612459995","first-page":"625","volume-title":"Proceedings of the 27th international conference on human factors in computing systems","author":"Kammerer Y"},{"key":"bibr12-1473871612459995","first-page":"139","volume-title":"Proceedings of human mental workload","author":"Hart SG"},{"key":"bibr13-1473871612459995","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2011.01928.x"},{"key":"bibr14-1473871612459995","first-page":"17","volume-title":"Proceedings of graphics interface conference","author":"Kang Y"},{"key":"bibr15-1473871612459995","first-page":"101","volume-title":"Proceedings of ACM SIGCOMM","author":"Kellar M"},{"key":"bibr16-1473871612459995","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2007.02.006"},{"key":"bibr17-1473871612459995","unstructured":"Carnegie Mellon University. Assessing Prior Knowledge, http:\/\/www.cmu.edu\/teaching\/designteach\/teach\/priorknowledge.html"},{"key":"bibr18-1473871612459995","volume-title":"Mental models: towards a cognitive science of language, inference, and consciousness","author":"Johnson-Laird PN","year":"1983"},{"key":"bibr19-1473871612459995","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2007.03.008"},{"key":"bibr20-1473871612459995","doi-asserted-by":"publisher","DOI":"10.1207\/S15326985EP3801_7"},{"key":"bibr21-1473871612459995","doi-asserted-by":"publisher","DOI":"10.1207\/S15326985EP3801_8"},{"key":"bibr22-1473871612459995","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2010.93"},{"key":"bibr23-1473871612459995","first-page":"36","volume":"7","author":"Newman M","year":"2006","journal-title":"Phys Rev E"},{"key":"bibr24-1473871612459995","first-page":"1134","volume":"15","author":"Viegas AB","year":"2009","journal-title":"Phys Rev E"},{"key":"bibr25-1473871612459995","first-page":"85","volume-title":"SIGIR 1996","author":"Veerasamy A"},{"key":"bibr26-1473871612459995","first-page":"1","volume-title":"Proceedings of Hawaii international conference on system sciences","author":"Green TM"}],"container-title":["Information Visualization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1473871612459995","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1473871612459995","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1473871612459995","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T19:21:07Z","timestamp":1777490467000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1473871612459995"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,10,8]]},"references-count":26,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2013,1]]}},"alternative-id":["10.1177\/1473871612459995"],"URL":"https:\/\/doi.org\/10.1177\/1473871612459995","relation":{},"ISSN":["1473-8716","1473-8724"],"issn-type":[{"value":"1473-8716","type":"print"},{"value":"1473-8724","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,10,8]]}}}