{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T21:36:28Z","timestamp":1778794588930,"version":"3.51.4"},"reference-count":69,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2014,9,24]],"date-time":"2014-09-24T00:00:00Z","timestamp":1411516800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Information Visualization"],"published-print":{"date-parts":[[2015,10]]},"abstract":"<jats:p>In this article, we are reporting the findings of a usability study of opinion mining systems\u2019 visualizations. The objectives of this study are to first to rank the visualizations of the opinion mining systems and second to identify important visualization metrics. A questionnaire survey was designed to ask users their level of agreement or disagreement about the 11 selected visualizations against a set of information visualization metrics on a Likert scale. The data were collected by conducting seminars and using a web-based online questionnaire (N\u2009=\u2009146). The collected data were analyzed using descriptive statistics and an independent sample t-test to rank the visualizations and investigate differences between perceptions of the two groups of respondents (the participants of the seminars and the online questionnaire), respectively. The results revealed that simple, eye pleasing, easy to understand, user-friendly visualizations with less pre-knowledge required rated higher than others. It is concluded that the participants of the online questionnaire mostly required more pre-knowledge to comprehend the visualizations as compared to the participants of the seminars. The important information visualization metrics are eye pleasing, easy to understand, user-friendly, informative design, usefulness, and representation style. The results of this study could aid in the design and development of visualizations for opinion mining systems.<\/jats:p>","DOI":"10.1177\/1473871614550537","type":"journal-article","created":{"date-parts":[[2014,9,25]],"date-time":"2014-09-25T00:41:29Z","timestamp":1411605689000},"page":"339-358","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":15,"title":["Evaluation of opinion visualization techniques"],"prefix":"10.1177","volume":"14","author":[{"given":"Azra","family":"Shamim","sequence":"first","affiliation":[{"name":"Department of Information System, FSKTM, University of Malaya, Kuala Lumpur, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vimala","family":"Balakrishnan","sequence":"additional","affiliation":[{"name":"Department of Information System, FSKTM, University of Malaya, Kuala Lumpur, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Muhammad","family":"Tahir","sequence":"additional","affiliation":[{"name":"COMSATS Institute of Information Technology, Islamabad, Pakistan"},{"name":"Faculty of Computing and Information Technology, King Abdulaziz University, North Jeddah Branch, Jeddah, Kingdom of Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2014,9,24]]},"reference":[{"key":"bibr1-1473871614550537","doi-asserted-by":"crossref","unstructured":"Dave K, Way I, Lawrence S, Mining the peanut gallery: opinion extraction and semantic classification of product reviews. In: Proceedings of the 12th international conference on World Wide Web (WWW \u201903), 2003, pp. 519\u2013528. New York: ACM Press, http:\/\/doi.acm.org\/10.1145\/775152.775226","DOI":"10.1145\/775152.775226"},{"key":"bibr2-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.183"},{"key":"bibr3-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1145\/944012.944013"},{"key":"bibr4-1473871614550537","first-page":"271","volume-title":"Proceedings of 42nd meeting of the Association for Computational Linguistics (ACL \u201804)","author":"Pang B"},{"key":"bibr5-1473871614550537","first-page":"23","volume-title":"Proceedings of the workshop on sentiment and subjectivity in text","author":"Gregory ML"},{"key":"bibr6-1473871614550537","volume-title":"Workshop on visual interfaces to the social and the semantic web (VISSW 2009)","author":"Wanner F"},{"key":"bibr7-1473871614550537","first-page":"59","volume-title":"Proceedings of the IEEE symposium on visual analytics and technology","author":"Chen C"},{"key":"bibr8-1473871614550537","volume-title":"Proceedings of the international conference on weblogs and social media","author":"Gamon M"},{"issue":"1","key":"bibr9-1473871614550537","first-page":"1","volume":"34","author":"Khan M","year":"2011","journal-title":"Int J Comput Appl"},{"key":"bibr10-1473871614550537","unstructured":"Osimo D, Mureddu F. Research challenge on opinion mining and sentiment analysis. In: Using open data: policy modeling, citizen empowerment, data journalism, 2012, http:\/\/www.w3.org\/2012\/06\/pmod\/opinionmining.pdf"},{"key":"bibr11-1473871614550537","first-page":"341","volume-title":"Proceedings of the eighth ACM SIGKDD international conference on knowledge discovery and data mining","author":"Morinaga S"},{"key":"bibr12-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2008.09.035"},{"key":"bibr13-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2010.08.021"},{"key":"bibr14-1473871614550537","doi-asserted-by":"crossref","unstructured":"Gamon M, Aue A, Corston-Oliver S, Pulse: mining customer opinions from free text. In: International symposium on intelligent data analysis, 2005, pp. 121\u2013132, http:\/\/www.springerlink.com\/index\/94q1nrhfc8a4e8tn.pdf (accessed 12 December 2011).","DOI":"10.1007\/11552253_12"},{"key":"bibr15-1473871614550537","first-page":"187","volume-title":"Proceedings of the IEEE symposium on visual analytics science and technology","author":"Oelke D"},{"key":"bibr16-1473871614550537","doi-asserted-by":"crossref","unstructured":"Liu B, Hu M, Cheng J. Opinion observer: analyzing and comparing opinions on the Web. In: Proceedings of the 14th international conference on World Wide Web (WWW \u201905), 2005, pp. 342\u2013351. New York: ACM Press, http:\/\/doi.acm.org\/10.1145\/1060745.1060797","DOI":"10.1145\/1060745.1060797"},{"key":"bibr17-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2009.23"},{"key":"bibr18-1473871614550537","volume-title":"Notes on matters affecting the health, efficiency, and hospital administration of the British army: founded chiefly on the experience of the late war","author":"Nightingale F","year":"1858"},{"key":"bibr19-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1145\/1556262.1556326"},{"key":"bibr20-1473871614550537","unstructured":"ISO 9241-10:1996. Ergonomic requirements for office work with visual display terminals (VDTs). Part 10: dialogue principles."},{"key":"bibr21-1473871614550537","unstructured":"ISO 9241-11:1994. Ergonomic requirements for office work with visual display terminals (VDTs). Part 11: guidance on usability. Draft international standard."},{"key":"bibr22-1473871614550537","volume-title":"Principles and guidelines in software user interface","author":"Mayhew DJ","year":"1992"},{"key":"bibr23-1473871614550537","volume-title":"Design guidelines for user-system interface software","author":"Smith SL","year":"1984"},{"key":"bibr24-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1108\/02640470210454001"},{"key":"bibr25-1473871614550537","volume-title":"Usability for the web: designing web sites that work","author":"Brinck T","year":"2002"},{"key":"bibr26-1473871614550537","unstructured":"MIT Information Services and Technology Department. Usability guidelines, 2 December 2004."},{"key":"bibr27-1473871614550537","volume-title":"A study on the improvement plan by analyzing user interaction pattern with the RISS","author":"Lee KP","year":"2004"},{"key":"bibr28-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-08-052029-2.50007-3"},{"key":"bibr29-1473871614550537","volume-title":"Introduction into human-computer interaction","author":"Booth P","year":"1989"},{"key":"bibr30-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1016\/j.im.2005.04.002"},{"key":"bibr31-1473871614550537","first-page":"145","volume-title":"Proceedings of the IEEE symposium on visual analytics science and technology","author":"Scholtz J"},{"key":"bibr32-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1108\/10650751211279120"},{"key":"bibr33-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1108\/07378830710840491"},{"key":"bibr34-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1108\/02640470810921637"},{"key":"bibr35-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1108\/02652320810902433"},{"issue":"4","key":"bibr36-1473871614550537","first-page":"143","volume":"7","author":"Ravendran R","year":"2012","journal-title":"J Usability Stud"},{"key":"bibr37-1473871614550537","first-page":"1089","volume-title":"2012 International conference on computer & information sciences","author":"Feizi A"},{"key":"bibr38-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1108\/09564230110405280"},{"key":"bibr39-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1108\/00242530710736000"},{"key":"bibr40-1473871614550537","volume-title":"CHI 2002\u20145th workshop on human factors in computer systems","author":"Freitas CMDS","year":"2002"},{"key":"bibr41-1473871614550537","volume-title":"Proceedings of the 2006 AVI workshop on beyond time and errors: novel evaluation methods for information visualization","author":"Zuk T"},{"key":"bibr42-1473871614550537","volume-title":"Proceedings of the SPIE-IS&T electronic imaging","volume":"6060","author":"Zuk T"},{"key":"bibr43-1473871614550537","first-page":"143","volume-title":"Proceedings of the IEEE symposium on information visualization (INFOVIS \u201804)","author":"Amar R"},{"key":"bibr44-1473871614550537","first-page":"336","volume-title":"Proceedings of the IEEE symposium on visual languages","author":"Shneiderman B"},{"key":"bibr45-1473871614550537","first-page":"139","volume-title":"Proceedings of the first IEEE conference on visualization","author":"Wehrend S"},{"key":"bibr46-1473871614550537","first-page":"1","volume-title":"Proceedings of the 3rd BELIV \u201910 workshop: beyond time and errors: novel evaluation methods for information visualization","author":"Scholtz J"},{"key":"bibr47-1473871614550537","first-page":"199","volume-title":"Proceedings of the international conference on advanced visual interfaces (AVI \u201910)","author":"Forsell C"},{"key":"bibr48-1473871614550537","first-page":"108","volume-title":"Proceedings of the IEEE symposium on information visualization","author":"Brath R"},{"key":"bibr49-1473871614550537","first-page":"1493","volume-title":"Proceedings of ACM CHI 2008 conference on human factors in computing systems","author":"Connell TAO"},{"key":"bibr50-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.70412"},{"key":"bibr51-1473871614550537","first-page":"1","volume-title":"Proceedings of the 44th Hawaii international conference on system sciences","author":"Bai X"},{"key":"bibr52-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(05)70412-8"},{"key":"bibr53-1473871614550537","volume-title":"Semiology of graphics","author":"Bertin J","year":"1983"},{"key":"bibr54-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1016\/B978-155860819-1\/50004-2"},{"key":"bibr55-1473871614550537","first-page":"137","volume-title":"Proceedings of the IEEE conference on information visualization","author":"Wiss U"},{"key":"bibr56-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1177\/1473871611407399"},{"key":"bibr57-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.279"},{"key":"bibr58-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1177\/1473871613490290"},{"key":"bibr59-1473871614550537","first-page":"1","volume-title":"Proceedings of HCI international \u201897","author":"Brath R"},{"key":"bibr60-1473871614550537","first-page":"20","volume-title":"Proceedings of the 2005 Latin American conference on human-computer interaction (CLIHC \u201905)","author":"Pillat RM"},{"key":"bibr61-1473871614550537","first-page":"1","volume-title":"Proceedings of the 2005 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries (SAICSIT \u201905)","author":"Pretorius MC","year":"2005"},{"key":"bibr62-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.84"},{"key":"bibr63-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2002.1021578"},{"key":"bibr64-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2006.200"},{"key":"bibr65-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.1023"},{"key":"bibr66-1473871614550537","first-page":"285","volume-title":"Proceedings of the vision, modeling, and visualization workshop 2011","author":"Kratt J"},{"key":"bibr67-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1109\/INFVIS.2000.885091"},{"key":"bibr68-1473871614550537","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2008.153"},{"key":"bibr69-1473871614550537","volume-title":"Proceedings of visualization and data analysis","volume":"7530","author":"Hao MC"}],"container-title":["Information Visualization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1473871614550537","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1473871614550537","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1473871614550537","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T19:18:40Z","timestamp":1777490320000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1473871614550537"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,9,24]]},"references-count":69,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2015,10]]}},"alternative-id":["10.1177\/1473871614550537"],"URL":"https:\/\/doi.org\/10.1177\/1473871614550537","relation":{},"ISSN":["1473-8716","1473-8724"],"issn-type":[{"value":"1473-8716","type":"print"},{"value":"1473-8724","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,9,24]]}}}