{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T15:23:54Z","timestamp":1759937034577,"version":"3.41.2"},"reference-count":39,"publisher":"Emerald","issue":"3","license":[{"start":{"date-parts":[[2014,5,6]],"date-time":"2014-05-06T00:00:00Z","timestamp":1399334400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2014,5,6]]},"abstract":"\n Purpose<\/jats:title>\n \u2013 The authors introduce two semantics-based navigation applications that facilitate information-seeking activities in internal link-based web sites in Wikipedia. These applications aim to help users find concepts within a topic and related articles on a given topic quickly and then gain topical knowledge from internal link-based encyclopedia web sites. The paper aims to discuss these issues. <\/jats:p>\n <\/jats:sec>\n \n Design\/methodology\/approach<\/jats:title>\n \u2013 The WNavi<\/jats:italic>\n s<\/jats:italic> application consists of three information visualization (IV) tools which are a topic network, a hierarchy topic tree and summaries for topics. The WikiMap<\/jats:italic> application consists of a topic network. The goal of the topic network and topic tree tools is to help users to find the major concepts of a topic and identify relationships between these major concepts easily. In addition, in order to locate specific information and enable users to explore and read topic-related articles quickly, the topic tree and summaries for topics tools support users to gain topical knowledge quickly. The authors then apply the k<\/jats:italic>-clique of cohesive indicator to analyze the sub topics of the seed query and find out the best clustering results via the cosine measure. The authors utilize four metrics, which are correctness, time cost, usage behaviors, and satisfaction, to evaluate the three interfaces. These metrics measure both the outputs and outcomes of applications. As a baseline system for evaluation the authors used a traditional Wikipedia interface. For the evaluation, the authors used an experimental user study with 30 participants. <\/jats:p>\n <\/jats:sec>\n \n Findings<\/jats:title>\n \u2013 The results indicate that both WikiMap<\/jats:italic> and WNavi<\/jats:italic>\n s<\/jats:italic> supported users to identify concepts and their relations better compared to the baseline. In topical tasks WNavi<\/jats:italic>\n s<\/jats:italic> over performed both WikiMap<\/jats:italic> and the baseline system. Although there were no time differences in finding concepts or answering topical questions, the test systems provided users with a greater gain per time unit. The users of WNavi<\/jats:italic>\n s<\/jats:italic> leaned on the hierarchy tree instead of other tools, whereas WikiMap<\/jats:italic> users used the topic map. <\/jats:p>\n <\/jats:sec>\n \n Research limitations\/implications<\/jats:title>\n \u2013 The findings have implications for the design of IR support tools in knowledge-intensive web sites that help users to explore topics and concepts. <\/jats:p>\n <\/jats:sec>\n \n Originality\/value<\/jats:title>\n \u2013 The authors explored to what extent the use of each IV support tool contributed to successful exploration of topics in search tasks. The authors propose extended task-based evaluation measures to understand how each application provides useful context for users to accomplish the tasks and attain the search goals. That is, the authors not only evaluate the output of the search results, e.g. the number of relevant items retrieved, but also the outcome provided by the system for assisting users to attain the search goal.<\/jats:p>\n <\/jats:sec>","DOI":"10.1108\/jd-10-2012-0138","type":"journal-article","created":{"date-parts":[[2014,6,17]],"date-time":"2014-06-17T12:52:30Z","timestamp":1403009550000},"page":"392-424","source":"Crossref","is-referenced-by-count":7,"title":["Supporting navigation in Wikipedia by information visualization: extended evaluation measures"],"prefix":"10.1108","volume":"70","author":[{"given":"I-Chin","family":"Wu","sequence":"first","affiliation":[]},{"given":"Pertti","family":"Vakkari","sequence":"additional","affiliation":[]}],"member":"140","reference":[{"key":"key2020061111403746400_b1","doi-asserted-by":"crossref","unstructured":"Allan, J.\n , \n Croft, W.B.\n , \n Moffat, A.\n and \n Sanderson, M.\n (2012), \u201cFrontiers, challenges, and opportunities for information retrieval: report from SWIRL 2012\u201d, SIGIR Forum, Vol. 46 No. 1, pp. 2-32.","DOI":"10.1145\/2215676.2215678"},{"key":"key2020061111403746400_b2","doi-asserted-by":"crossref","unstructured":"Belkin, N.J.\n , \n Cool, C.\n , \n Stein, A.\n and \n Thiel, U.\n (1995), \u201cCases, scripts, and information-seeking strategies: on the design of interactive information retrieval systems\u201d, Expert Systems with Applications, Vol. 9 No. 3, pp. 379-396.","DOI":"10.1016\/0957-4174(95)00011-W"},{"key":"key2020061111403746400_b3","doi-asserted-by":"crossref","unstructured":"Borlund, P.\n (2000), \u201cExperimental components for the evaluation of interactive information retrieval systems\u201d, Journal of Documentation, Vol. 56 No. 1, pp. 71-90.","DOI":"10.1108\/EUM0000000007110"},{"key":"key2020061111403746400_b5","doi-asserted-by":"crossref","unstructured":"Butcher, K.R.\n , \n Davies, S.\n , \n Crockett, A.\n , \n Dewald, A.\n and \n Zheng, R.\n (2011), \u201cDo graphical search interfaces support effective search for and evaluation of digital library resources?\u201d, Proceedings of ACM\/IEEE Joint Conference on Digital Libraries, Ottawa, pp. 315-324.","DOI":"10.1145\/1998076.1998136"},{"key":"key2020061111403746400_b6","doi-asserted-by":"crossref","unstructured":"Callan, J.\n , \n Allan, J.\n , \n Clarke, C.L.A.\n , \n Dumais, S.\n , \n Evans, D.A.\n , \n Sanderson, M.\n and \n Zhai, C.X.\n (2007), \u201cMeeting of the MINDS: an information retrieval research agenda\u201d, Forum of the 30th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201907 Forum), Vol. 41, pp. 25-34.","DOI":"10.1145\/1328964.1328967"},{"key":"key2020061111403746400_b7","doi-asserted-by":"crossref","unstructured":"Chehreghani, M.H.\n , \n Abolhassani, H.\n and \n Chehreghani, M.H.\n (2009), \u201cDensity link-based methods for clustering web pages\u201d, Decision Support Systems, Vol. 47 No. 4, pp. 374-382.","DOI":"10.1016\/j.dss.2009.04.002"},{"key":"key2020061111403746400_b8","doi-asserted-by":"crossref","unstructured":"Chung, W.Y.\n , \n Chen, H.C.\n and \n Nunamaker, J.F. Jr\n (2005), \u201cA visual framework for knowledge discovery on the web: an empirical study of business intelligence exploration\u201d, Journal of Management Information Systems, Vol. 21 No. 4, pp. 57-84.","DOI":"10.1080\/07421222.2005.11045821"},{"key":"key2020061111403746400_b9","doi-asserted-by":"crossref","unstructured":"Cilibrasi, R.L.\n and \n Vit\u00e1nyi, P.M.B.\n (2007), \u201cThe Google similarity distance\u201d, IEEE Transactions on Knowledge and Data Engineering, Vol. 19 No. 3, pp. 370-383.","DOI":"10.1109\/TKDE.2007.48"},{"key":"key2020061111403746400_b10","doi-asserted-by":"crossref","unstructured":"Doan, A.\n , \n Ramakrishnan, R.\n and \n Halevy, A.Y.\n (2011), \u201cCrowdsourcing systems on the World-Wide Web\u201d, Communications of the ACM, Vol. 54 No. 4, pp. 86-96.","DOI":"10.1145\/1924421.1924442"},{"key":"key2020061111403746400_b11","unstructured":"Fogarolli, A.\n and \n Ronchetti, M.\n (2008), \u201cDiscovering semantics in multimedia content\u201d, Proceedings of 11th International Conference on Business Information Systems, Lecture Notes in Business Information Processing, Vol. 7, Heidelberg, pp. 48-57."},{"key":"key2020061111403746400_b12","unstructured":"Hansen, P.\n (1998), \u201cEvaluation of IR user interface: implications for user interface design\u201d, Human IT, Vol. 2 No. 2, pp. 28-41."},{"key":"key2020061111403746400_b13","unstructured":"Hanson, N.R.\n (1958), Patterns of Discovery, Cambridge University Press, London."},{"key":"key2020061111403746400_b14","doi-asserted-by":"crossref","unstructured":"Hu, X.\n , \n Zhang, X.\n , \n Lu, C.\n , \n Park, E.K.\n and \n Zhou, X.\n (2009), \u201cExploiting Wikipedia as external knowledge for document clustering\u201d, Proceedings of ACM Knowledge Discovery and Data Mining (KDD), Paris, pp. 389-396.","DOI":"10.1145\/1557019.1557066"},{"key":"key2020061111403746400_b15","doi-asserted-by":"crossref","unstructured":"J\u00e4rvelin, K.\n (2009), \u201cExplaining user performance in information retrieval: challenges to IR evaluation\u201d, Proceedings of the 2nd International Conference on the Theory of Information Retrieval, Heidelberg, pp. 289-296.","DOI":"10.1007\/978-3-642-04417-5_28"},{"key":"key2020061111403746400_b16","doi-asserted-by":"crossref","unstructured":"Johnson, S.C.\n (1967), \u201cHierarchical clustering schemes\u201d, Psychometrika, Vol. 32 No. 3, pp. 241-254.","DOI":"10.1007\/BF02289588"},{"key":"key2020061111403746400_b18","doi-asserted-by":"crossref","unstructured":"Joho, H.\n and \n Jose, J.M.\n (2008), \u201cEffectiveness of additional representations for the search result presentation on the web\u201d, Information Processing & Management, Vol. 44 No. 1, pp. 226-241.","DOI":"10.1016\/j.ipm.2007.02.004"},{"key":"key2020061111403746400_b17","doi-asserted-by":"crossref","unstructured":"Joho, H.\n , \n Sanderson, M.\n and \n Beaulieu, M.\n (2004), \u201cA study of user interaction with a concept-based interactive query expansion support tool\u201d, Proceedings of 26th European Conference on IR Research, (ECIR '04), Heidelberg, Sunderland, pp. 42-56.","DOI":"10.1007\/978-3-540-24752-4_4"},{"key":"key2020061111403746400_b19","doi-asserted-by":"crossref","unstructured":"Julien, C.-A.\n , \n Leide, J.E.\n and \n Bouthillier, F.\n (2008), \u201cControlled user evaluations of information visualization interfaces for text retrieval: literature review and meta-analysis\u201d, Journal of the American Society for Information Science and Technology, Vol. 59 No. 6, pp. 1012-1024.","DOI":"10.1002\/asi.20786"},{"key":"key2020061111403746400_b20","unstructured":"Kelly, D.\n (2009), \u201cMethods for evaluating interactive information retrieval systems with users\u201d, Foundations and Trends in Information Retrieval, Vol. 3 Nos 1-2, pp. 1-224."},{"key":"key2020061111403746400_b21","doi-asserted-by":"crossref","unstructured":"Kelly, D.\n , \n Harper, D.J.\n and \n Landau, B.\n (2008), \u201cQuestionnaire mode effects in interactive information retrieval experiments\u201d, Information Processing & Management, Vol. 44 No. 1, pp. 122-141.","DOI":"10.1016\/j.ipm.2007.02.007"},{"key":"key2020061111403746400_b22","doi-asserted-by":"crossref","unstructured":"Lazonder, A.W.\n , \n Biemans, H.J.A.\n and \n Wopereis, I.G.J.H.\n (2000), \u201cDifferences between novice and experienced users in searching information on the World Wide Web\u201d, Journal of the American Society for Information Science, Vol. 51 No. 6, pp. 576-581.","DOI":"10.1002\/(SICI)1097-4571(2000)51:6<576::AID-ASI9>3.0.CO;2-7"},{"key":"key2020061111403746400_b23","unstructured":"Lechtenfeld, M.\n and \n Fuhr, N.\n (2012), \u201cResult clustering supports users with vague information needs\u201d, Proceedings of the 12th Dutch-Belgian Information Retrieval Workshop 2012, Ghent, February 23-24."},{"key":"key2020061111403746400_b24","doi-asserted-by":"crossref","unstructured":"Marchionini, G.\n (2006), \u201cExploratory search: from finding to understanding\u201d, Communications of the ACM, Vol. 49 No. 4, pp. 41-46.","DOI":"10.1145\/1121949.1121979"},{"key":"key2020061111403746400_b25","doi-asserted-by":"crossref","unstructured":"Miller, G.A.\n (1956), \u201cThe magical number seven, plus or minus two: some limits on our capacity for processing information\u201d, Psychological Review, Vol. 63 No. 2, pp. 81-97.","DOI":"10.1037\/h0043158"},{"key":"key2020061111403746400_b26","doi-asserted-by":"crossref","unstructured":"Milne, D.\n , \n Witten, I.H.\n and \n Nichols, D.M.\n (2007), \u201cA knowledge-based search engine powered by Wikipedia\u201d, Proceedings of the 6th ACM Conference on Information and Knowledge Management, Lisbon, pp. 445-454.","DOI":"10.1145\/1321440.1321504"},{"key":"key2020061111403746400_b27","doi-asserted-by":"crossref","unstructured":"Murdock, V.\n and \n Lalmas, M.\n (2008), \u201cWorkshop on aggregated search\u201d, SIGIR Forum, Vol. 42 No. 2, pp. 80-83.","DOI":"10.1145\/1480506.1480520"},{"key":"key2020061111403746400_b28","doi-asserted-by":"crossref","unstructured":"Robertson, S.\n , \n Walker, S.\n and \n Hancock-Beaulieu, M.\n (1995), \u201cLarge test collection experiments on an operational, interactive system: Okapi at TREC\u201d, Information Processing & Management, Vol. 31 No. 3, pp. 345-360.","DOI":"10.1016\/0306-4573(94)00051-4"},{"key":"key2020061111403746400_b29","unstructured":"Rossi, P.H.\n , \n Lipsey, M.W.\n and \n Freeman, H.E.\n (2004), Evaluation: A Systematic Approach, Sage Publications Inc., Thousand Oaks, CA."},{"key":"key2020061111403746400_b30","doi-asserted-by":"crossref","unstructured":"Sihvonen, A.\n and \n Vakkari, P.\n (2004), \u201cSubject knowledge improves interactive query expansion assisted by a thesaurus\u201d, Journal of Documentation, Vol. 60 No. 6, pp. 673-690.","DOI":"10.1108\/00220410410568151"},{"key":"key2020061111403746400_b31","unstructured":"Vakkari, P.\n (2010), \u201cExploratory searching as conceptual exploration\u201d, Proceedings of the 4th Workshop on Human-Computer Interaction and Information Retrieval (HCIR '10), New Brunswick, NJ, pp. 24-27."},{"key":"key2020061111403746400_b32","unstructured":"Vakkari, P.\n and \n Kek\u00e4l\u00e4inen, J.\n (2011), \u201cAn evaluation methodology reflecting the aims of search tools\u201d, Proceedings of the TPDL 2011 Workshop on User Oriented Evaluation of Digital Library Interfaces, Berlin, pp. 1-9."},{"key":"key2020061111403746400_b33","unstructured":"Wasserman, S.\n and \n Faust, K.\n (1994), Social Network Analysis: Methods and Application, 1st ed., Cambridge University Press, Cambridge and New York, NY."},{"key":"key2020061111403746400_b34","doi-asserted-by":"crossref","unstructured":"White, R.W.\n , \n Jose, J.M.\n and \n Ruthven, I.G.\n (2003), \u201cA task-oriented study on the influencing effects of query-biased summarization in web searching\u201d, Information Processing & Management, Vol. 39 No. 5, pp. 707-733.","DOI":"10.1016\/S0306-4573(02)00033-X"},{"key":"key2020061111403746400_b35","doi-asserted-by":"crossref","unstructured":"Wilson, M.L.\n , \n Schraefel, M.C.\n and \n White, R.W.\n (2009), \u201cEvaluating advanced search interfaces using established information-seeking models\u201d, Journal of the American Society for Information Science and Technology, Vol. 60 No. 7, pp. 1407-1422.","DOI":"10.1002\/asi.21080"},{"key":"key2020061111403746400_b270","doi-asserted-by":"crossref","unstructured":"Wu, I.C.\n and \n Lin, Y.S.\n (2012), \u201c\n WNavis: navigating Wikipedia semantically with an SNA-based summarization technique\u201d, Decision Support Systems, Vol. 54 No. 1, pp. 46-62.","DOI":"10.1016\/j.dss.2012.04.002"},{"key":"key2020061111403746400_b37","doi-asserted-by":"crossref","unstructured":"Wu, M.F.\n , \n Fuller, M.\n and \n Wilkinson, R.\n (2001), \u201cUsing clustering and classification approaches in interactive retrieval\u201d, Information Processing & Management, Vol. 37 No. 3, pp. 459-484.","DOI":"10.1016\/S0306-4573(00)00057-1"},{"key":"key2020061111403746400_b271","doi-asserted-by":"crossref","unstructured":"Wu, I.C.\n and \n Wu, C.Y.\n (2011), \u201cUsing internal link and social network analysis to support searches in Wikipedia: a model and its evaluation\u201d, Journal of Information Science, Vol. 37 No. 2, pp. 189-207.","DOI":"10.1177\/0165551511400955"},{"key":"key2020061111403746400_b38","doi-asserted-by":"crossref","unstructured":"Zhang, X.\n , \n Asano, Y.\n and \n Yoshikawa, M.\n (2010), \u201cMining and explaining relationships in Wikipedia\u201d, Lecture Notes in Computer Science, Vol. 6262, pp. 1-16.","DOI":"10.1007\/978-3-642-15251-1_1"},{"key":"key2020061111403746400_frd1","unstructured":"Borlund, P.\n (2003), \u201cThe IIR evaluation model: a framework for evaluation of interactive information retrieval systems\u201d, Information Research, Vol. 8 No. 3, Paper 152, 32pp, available at: http:\/\/informationr.net\/ir\/8-3\/paper152.html (accessed June 13, 2012)."}],"container-title":["Journal of Documentation"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/JD-10-2012-0138","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-10-2012-0138\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-10-2012-0138\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:35:08Z","timestamp":1753396508000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/jd\/article\/70\/3\/392-424\/202415"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,5,6]]},"references-count":39,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2014,5,6]]}},"alternative-id":["10.1108\/JD-10-2012-0138"],"URL":"https:\/\/doi.org\/10.1108\/jd-10-2012-0138","relation":{},"ISSN":["0022-0418"],"issn-type":[{"type":"print","value":"0022-0418"}],"subject":[],"published":{"date-parts":[[2014,5,6]]}}}