{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T12:34:54Z","timestamp":1761395694942,"version":"3.41.2"},"reference-count":127,"publisher":"Emerald","issue":"1","license":[{"start":{"date-parts":[[2020,3,6]],"date-time":"2020-03-06T00:00:00Z","timestamp":1583452800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["LHT"],"published-print":{"date-parts":[[2020,3,6]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>The purpose was to evaluate the effectiveness of Google (as an international search engine) as well as of Parsijoo, Rismoon, and Yooz (as Persian search engines).<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>In this research, Google search engine as an international search engine, and three local ones, Parsijoo, Rismoon, and Yooz, were selected for evaluation. Likewise, 32 subject headings were selected from the Persian Subject Headings List, and then simulated work tasks were assigned based on them. A total of 192 students from Ferdowsi University of Mashhad were asked to search for the information needed for simulated work tasks in the selected search engines, and then to copy the relevant website URLs in the search form.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>The findings indicated that Google, Parsijoo, Rismoon, and Yooz had a significant difference in the precision, recall, and normalized discounted cumulative gain. There was also a significant difference in the effectiveness (average of precision, recall, and NDCG) of these four search engines in the retrieval of the Persian resources.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Practical implications<\/jats:title><jats:p>Users using an efficient search engine will attain more relevant documents, and Google search engine was more efficient in retrieving the Persian resources. It is recommended to use Google as it has a more efficient search.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>In this research, for the first time, Google has been compared with local Persian search engines considering the new approach (simulated work tasks).<\/jats:p><\/jats:sec>","DOI":"10.1108\/lht-11-2019-0229","type":"journal-article","created":{"date-parts":[[2020,3,6]],"date-time":"2020-03-06T09:42:41Z","timestamp":1583487761000},"page":"166-189","source":"Crossref","is-referenced-by-count":6,"title":["Evaluating the effectiveness of Google, Parsijoo, Rismoon, and Yooz to retrieve Persian documents"],"prefix":"10.1108","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2145-2666","authenticated-orcid":false,"given":"Mahdi","family":"Zeynali Tazehkandi","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohsen","family":"Nowkarizi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"key":"key2021022303363325000_ref001","first-page":"4","article-title":"Performance evaluation of selected search engines","volume":"4","year":"2014","journal-title":"Performance Evaluation"},{"key":"key2021022303363325000_ref002","doi-asserted-by":"crossref","first-page":"6","DOI":"10.5120\/3046-4138","article-title":"Assessment of measures for information retrieval system evaluation: a user-centered approach","volume":"25","year":"2011","journal-title":"International Journal of Computers and Applications"},{"key":"key2021022303363325000_ref003","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1016\/j.compeleceng.2011.10.005","article-title":"An overview of Web search evaluation methods","volume":"37","year":"2011","journal-title":"Computers and Electrical Engineering"},{"key":"key2021022303363325000_ref004","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1300\/J103v25n01_07","article-title":"Indexing the internet","volume":"25","year":"2006","journal-title":"Behavioral and Social Sciences Librarian"},{"key":"key2021022303363325000_ref005","first-page":"8","article-title":"Comparative study on selected search engines in retrieving information cleft Lip & Palate in 2013-2015","volume":"18","year":"2016","journal-title":"Navid No"},{"key":"key2021022303363325000_ref006","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1007\/s10115-011-0391-7","article-title":"How many performance measures to evaluate information retrieval systems?","volume":"30","year":"2012","journal-title":"Knowledge and Information Systems"},{"key":"key2021022303363325000_ref007","first-page":"1015","article-title":"A survey on performance evaluation measures for information retrieval system","volume":"2","year":"2015","journal-title":"International Research Journal of Engineering and Technology"},{"key":"key2021022303363325000_ref008","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1007\/BF02458356","article-title":"On the overlap, the precision and estimated recall of search engines. A case study of the query \u2018Erdos\u2019","volume":"42","year":"1998","journal-title":"Scientometrics"},{"key":"key2021022303363325000_ref009","doi-asserted-by":"crossref","first-page":"1511","DOI":"10.1016\/j.ipm.2005.03.008","article-title":"Comparing rankings of search results on the web","volume":"41","year":"2005","journal-title":"Information Processing and Management"},{"key":"key2021022303363325000_ref010","doi-asserted-by":"crossref","first-page":"1448","DOI":"10.1016\/j.comnet.2005.10.020","article-title":"Methods for comparing rankings of search engine results","volume":"50","year":"2006","journal-title":"Computer Networks"},{"key":"key2021022303363325000_ref011","first-page":"1","article-title":"Toward an integrated model of information seeking and searching","volume":"3","year":"2002","journal-title":"New Review of Information Behaviour Research"},{"key":"key2021022303363325000_ref012","doi-asserted-by":"crossref","first-page":"1879","DOI":"10.1002\/asi.22675","article-title":"Ranking, relevance judgment, and precision of information retrieval on children's queries evaluation of Google, Yahoo!, Bing, Yahoo! Kids, and ask Kids","volume":"63","year":"2012","journal-title":"Journal of the American Society for Information Science and Technology"},{"first-page":"93","article-title":"Information retrieval effectiveness of Turkish search engines","year":"2002","key":"key2021022303363325000_ref013"},{"key":"key2021022303363325000_ref014","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1002\/asi.4630300505","article-title":"Relevance","volume":"30","year":"1979","journal-title":"Journal of the American Society for Information Science"},{"issue":"3","key":"key2021022303363325000_ref015","first-page":"3","article-title":"The IIR evaluation model a framework for evaluation of interactive information retrieval systems","volume":"8","year":"2003","journal-title":"Information Research"},{"key":"key2021022303363325000_ref016","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1108\/JD-06-2015-0068","article-title":"A study of the use of simulated work task situations in interactive information retrieval evaluation a meta-evaluation","volume":"72","year":"2016","journal-title":"Journal of Documentation"},{"key":"key2021022303363325000_ref017","doi-asserted-by":"crossref","unstructured":"Borlund, P. and Schneider, J.W. (2010), \u201cReconsideration of the simulated work task situation: a context instrument for evaluation of information retrieval interaction\u201d, Proceedings of the Third Symposium on Information Interaction in Context, ACM, pp. 155-164.","DOI":"10.1145\/1840784.1840808"},{"year":"2011","key":"key2021022303363325000_ref018","article-title":"Using context to improve the evaluation of information retrieval systems"},{"volume-title":"Information and Society","year":"2017","key":"key2021022303363325000_ref019"},{"key":"key2021022303363325000_ref020","first-page":"447","article-title":"Relevance: language, semantics, philosophy","volume":"52","year":"2004","journal-title":"Library Trends"},{"key":"key2021022303363325000_ref021","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1016\/S0306-4573(03)00040-2","article-title":"Automatic performance evaluation of Web search engines","volume":"40","year":"2004","journal-title":"Information Processing and Management"},{"key":"key2021022303363325000_ref022","doi-asserted-by":"crossref","unstructured":"Cen, R., Liu, Y., Zhang, M., Ru, L. and Ma, S. (2009), \u201cAutomatic search engine performance evaluation with the wisdom of crowds\u201d, Asia Information Retrieval Symposium, Springer, pp. 351-362.","DOI":"10.1007\/978-3-642-04769-5_31"},{"first-page":"421","article-title":"Automatic evaluation of world wide web search services","year":"2002","key":"key2021022303363325000_ref023"},{"key":"key2021022303363325000_ref024","unstructured":"Chu, H. and Rosenthal, M. (1996), \u201cSearch engines for the World Wide Web: a comparative study and evaluation methodology\u201d, Proceedings of the Annual Meeting-American Society for Information Science, pp. 127-135."},{"key":"key2021022303363325000_ref025","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1300\/J141v02n03_06","article-title":"Search engines for the world wide web","volume":"2","year":"2000","journal-title":"Journal of Internet Cataloging"},{"key":"key2021022303363325000_ref026","doi-asserted-by":"crossref","unstructured":"Cleverdon, C.W. (1967), \u201cThe Cranfield tests on index language devices\u201d, Aslib Proceedings, MCB UP, pp. 173-194.","DOI":"10.1108\/eb050097"},{"year":"1966","key":"key2021022303363325000_ref027","article-title":"Factors determining the performance of indexing systems, (Volume 1: design)"},{"volume-title":"Basic Research Methods for Librarians","year":"2010","key":"key2021022303363325000_ref028"},{"key":"key2021022303363325000_ref029","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/0020-0271(71)90024-6","article-title":"A definition of relevance for information retrieval","volume":"7","year":"1971","journal-title":"Information Storage and Retrieval"},{"volume-title":"Search Engines: Information Retrieval in Practice","year":"2010","key":"key2021022303363325000_ref030"},{"first-page":"73","article-title":"The effect of document order and topic difficulty on assessor agreement","year":"2016","key":"key2021022303363325000_ref031"},{"key":"key2021022303363325000_ref032","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1002\/asi.4630280507","article-title":"The effect of individual differences of cognitive style on judgments of document relevance","volume":"28","year":"1977","journal-title":"Journal of the American Society for Information Science"},{"key":"key2021022303363325000_ref033","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1108\/14684521011084609","article-title":"Performance evaluation and comparison of the five most used search engines in retrieving web resources","volume":"34","year":"2010","journal-title":"Online Information Review"},{"year":"2007","key":"key2021022303363325000_ref034","article-title":"An evaluation of popular search engines on finding Turkish documents"},{"key":"key2021022303363325000_ref035","first-page":"3","article-title":"Information needs and use","volume":"21","year":"1986","journal-title":"Annual Review of Information Science and Technology"},{"key":"key2021022303363325000_ref036","first-page":"77","article-title":"Evaluating function of Persian search engines on the web using correspondence analysis","volume":"8","year":"2012","journal-title":"International Journal of Integrated Supply Management"},{"key":"key2021022303363325000_ref037","first-page":"219","article-title":"Qualitative methods in information retrieval research","volume":"15","year":"1993","journal-title":"Library and Information Science Research"},{"key":"key2021022303363325000_ref038","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/j.lisr.2008.04.001","article-title":"Are we there yet?: mixed methods research in library and information science","volume":"30","year":"2008","journal-title":"Library and Information Science Research"},{"key":"key2021022303363325000_ref039","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1108\/00330331211221837","article-title":"Evaluating search engines: a comparative study between international and Greek SE by Greek librarians","volume":"46","year":"2012","journal-title":"Program"},{"key":"key2021022303363325000_ref040","doi-asserted-by":"crossref","first-page":"7","DOI":"10.5120\/ijais12-450156","article-title":"An overview of search engine evaluation strategies","volume":"1","year":"2012","journal-title":"International Journal of Applied Information Systems"},{"key":"key2021022303363325000_ref041","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1108\/14684520310471699","article-title":"Relevancy rankings pay for performance search engines in the hot seat","volume":"27","year":"2003","journal-title":"Online Information Review"},{"year":"2013","key":"key2021022303363325000_ref042","article-title":"Comparison of search engine to retrieve Persian web pages"},{"key":"key2021022303363325000_ref043","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/S0306-4573(98)00041-7","article-title":"Finding information on the World Wide Web: the retrieval effectiveness of search engines","volume":"35","year":"1999","journal-title":"Information Processing and Management"},{"key":"key2021022303363325000_ref044","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1108\/14684520010330283","article-title":"The evolution of Web searching","volume":"24","year":"2000","journal-title":"Online Information Review"},{"key":"key2021022303363325000_ref045","article-title":"Evaluation of three German search engines: Altavista. de, Google. de and Lycos. de","volume":"9","year":"2004","journal-title":"Information Research"},{"key":"key2021022303363325000_ref046","doi-asserted-by":"crossref","first-page":"598","DOI":"10.1108\/14684521111161954","article-title":"Relevance ranking on Google: are top ranked results really considered more relevant by the users?","volume":"35","year":"2011","journal-title":"Online Information Review"},{"key":"key2021022303363325000_ref047","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1002\/(SICI)1097-4571(199601)47:1<37::AID-ASI4>3.0.CO;2-3","article-title":"Variations in relevance assessments and the measurement of retrieval effectiveness","volume":"47","year":"1996","journal-title":"Journal of the American Society for Information Science"},{"key":"key2021022303363325000_ref048","doi-asserted-by":"crossref","first-page":"1321","DOI":"10.1016\/S1389-1286(99)00024-9","article-title":"Results and challenges in web search evaluation","volume":"31","year":"1999","journal-title":"Computer Networks"},{"key":"key2021022303363325000_ref049","first-page":"18","article-title":"The web search engines and general reference questions","volume":"3","year":"2012","journal-title":"International Journal of Integrated Supply Management"},{"key":"key2021022303363325000_ref050","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1002\/asi.21261","article-title":"The foundation of the concept of relevance","volume":"61","year":"2010","journal-title":"Journal of the American Society for Information Science and Technology"},{"volume-title":"Experimental Design for Measuring the Intra-and Inter-group Consistency of Human Judgment of Relevance","year":"1965","key":"key2021022303363325000_ref051"},{"first-page":"16","article-title":"Research on design of an automatic evaluation system of search engine","year":"2009","key":"key2021022303363325000_ref052"},{"key":"key2021022303363325000_ref053","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1197\/jamia.M1733","article-title":"Agreement, the f-measure, and reliability in information retrieval","volume":"12","year":"2005","journal-title":"Journal of the American Medical Informatics Association"},{"key":"key2021022303363325000_ref054","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1002\/asi.22811","article-title":"Relevance an improved framework for explicating the notion","volume":"64","year":"2013","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"key2021022303363325000_ref055","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1108\/00242530610667567","article-title":"A comparative study on overlapping of search results in metasearch engines and their common underlying search engines","volume":"55","year":"2006","journal-title":"Library Review"},{"key":"key2021022303363325000_ref056","doi-asserted-by":"crossref","first-page":"2270","DOI":"10.1016\/j.patcog.2005.01.012","article-title":"Score normalization in multimodal biometric systems","volume":"38","year":"2005","journal-title":"Pattern Recognition"},{"key":"key2021022303363325000_ref057","first-page":"45","article-title":"Min max normalization based data perturbation method for privacy protection","volume":"2","year":"2011","journal-title":"International Journal of Computer and Communication Technology"},{"key":"key2021022303363325000_ref058","doi-asserted-by":"crossref","first-page":"1075","DOI":"10.1016\/j.ipm.2005.09.003","article-title":"The effectiveness of Web search engines for retrieving relevant ecommerce links","volume":"42","year":"2006","journal-title":"Information Processing and Management"},{"key":"key2021022303363325000_ref059","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1002\/asi.20589","article-title":"An analysis of two approaches in information retrieval: from frameworks to study designs","volume":"58","year":"2007","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"key2021022303363325000_ref060","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1145\/582415.582418","article-title":"Cumulated gain-based evaluation of IR techniques","volume":"20","year":"2002","journal-title":"ACM Transactions on Information Systems"},{"first-page":"101","article-title":"Development and evaluation of search tasks for IIR experiments using a cognitive complexity framework","year":"2015","key":"key2021022303363325000_ref061"},{"key":"key2021022303363325000_ref062","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1002\/asi.5090060209","article-title":"Operational criteria for designing information retrieval systems","volume":"6","year":"1955","journal-title":"American Documentation"},{"key":"key2021022303363325000_ref063","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1108\/00242531211292105","article-title":"Accessibility of web search engines","volume":"61","year":"2012","journal-title":"Library Review"},{"key":"key2021022303363325000_ref064","first-page":"124","article-title":"Precision and relative recall of search engines: a comparative study of Google and Yahoo","volume":"38","year":"2009","journal-title":"Singapore Journal of Library and Information Management"},{"key":"key2021022303363325000_ref065","first-page":"124","article-title":"Precision and relative recall of search engines: a comparative study of Google and Yahoo","volume":"38","year":"2009","journal-title":"Singapore Journal of Library and Information Management"},{"key":"key2021022303363325000_ref066","first-page":"87","article-title":"Evaluating the searching capabilities of search engines and metasearch engines: a comparative study","volume":"57","year":"2010","journal-title":"Annals of Library and Information Studies"},{"key":"key2021022303363325000_ref067","unstructured":"Kunder, D.M. (2019), \u201cThe size of the world wide web\u201d, available at: https:\/\/www.worldwidewebsize.com\/."},{"year":"1971","key":"key2021022303363325000_ref068","article-title":"An evaluation of ears (epilepsy abstracts retrieval system) and factors governing its effectiveness"},{"key":"key2021022303363325000_ref069","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1038\/21987","article-title":"Accessibility of information on the web","volume":"400","year":"1999","journal-title":"Nature"},{"key":"key2021022303363325000_ref070","doi-asserted-by":"crossref","first-page":"870","DOI":"10.1002\/(SICI)1097-4571(1999)50:10<870::AID-ASI4>3.0.CO;2-G","article-title":"First 20 precision among World Wide Web search services (search engines)","volume":"50","year":"1999","journal-title":"Journal of the American Society for Information Science"},{"key":"key2021022303363325000_ref071","doi-asserted-by":"crossref","first-page":"668","DOI":"10.1108\/14684520810914034","article-title":"Problems with the use of web search engines to find results in foreign languages","volume":"32","year":"2008","journal-title":"Online Information Review"},{"journal-title":"Journal of Documentation","article-title":"The retrieval effectiveness of web search engines: considering results descriptions","year":"2008","key":"key2021022303363325000_ref072"},{"key":"key2021022303363325000_ref073","doi-asserted-by":"crossref","unstructured":"Lewandowski, D. (2011), \u201cThe retrieval effectiveness of search engines on navigational queries\u201d, Aslib Proceedings: New Information Perspectives, Emerald Group Publishing, pp. 354-363.","DOI":"10.1108\/00012531111148949"},{"key":"key2021022303363325000_ref074","doi-asserted-by":"crossref","first-page":"1763","DOI":"10.1002\/asi.23304","article-title":"Evaluating the retrieval effectiveness of web search engines using a representative query sample","volume":"66","year":"2015","journal-title":"Journal of the Association for Information Science and Technology"},{"volume-title":"User Personal Evaluation of Search Engines-Google, Bing and Blekko","year":"2011","key":"key2021022303363325000_ref075"},{"key":"key2021022303363325000_ref076","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1108\/14684520910969925","article-title":"Searching locally: a comparison of Yehey! and google","volume":"33","year":"2009","journal-title":"Online Information Review"},{"key":"key2021022303363325000_ref077","doi-asserted-by":"crossref","first-page":"1859","DOI":"10.1002\/asi.22711","article-title":"Some philosophical considerations in using mixed methods in library and information science research","volume":"63","year":"2012","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"key2021022303363325000_ref078","doi-asserted-by":"crossref","unstructured":"MacFarlane, A. (2007), \u201cEvaluation of web search for the information practitioner\u201d, Aslib Proceedings, Emerald Group Publishing, pp. 352-366.","DOI":"10.1108\/00012530710817573"},{"first-page":"563","article-title":"Evaluating the retrieval effectiveness of search engines using Persian navigational queries","year":"2014","key":"key2021022303363325000_ref079"},{"issue":"2","key":"key2021022303363325000_ref080","first-page":"131","article-title":"A comparison of accuracy in specialized medical search and general search engines for retrieving medical image","volume":"6","year":"2015","journal-title":"Educational Development of Jundishapur"},{"volume-title":"A Comparative Study on Overlapping of Search Results in Metasearch Engines and Their Common Underlying Search Engines","year":"2006","key":"key2021022303363325000_ref081"},{"key":"key2021022303363325000_ref082","first-page":"44","article-title":"Qualitative ranking of Persian and non-Persian search engines in information retrieval of Islamic subjects","volume":"19","year":"2016","journal-title":"Library and Information Science"},{"key":"key2021022303363325000_ref083","first-page":"48","article-title":"The overlap and coverage of 4 local search engines: Parsijoo, Yooz, Parseek and Rismoun","volume":"4","year":"2017","journal-title":"Human Information Interaction"},{"key":"key2021022303363325000_ref084","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1016\/j.ipm.2005.03.023","article-title":"Automatic ranking of information retrieval systems using data fusion","volume":"42","year":"2006","journal-title":"Information Processing and Management"},{"key":"key2021022303363325000_ref085","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1108\/00220410010803810","article-title":"The evaluation of WWW search engines","volume":"56","year":"2000","journal-title":"Journal of Documentation"},{"key":"key2021022303363325000_ref086","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1108\/EUM0000000006884","article-title":"The design of World Wide Web search engines: a critical review","volume":"31","year":"1997","journal-title":"Program"},{"issue":"1","key":"key2021022303363325000_ref087","first-page":"37","article-title":"Evaluation: From precision, recall and f-measure to ROC, informedness, markedness and correlation","volume":"2","year":"2011","journal-title":"Journal of Machine Learning Technologies"},{"key":"key2021022303363325000_ref088","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1126\/science.134.3484.1004","article-title":"Relative effectiveness of document titles and abstracts for determining relevance of documents","volume":"134","year":"1961","journal-title":"Science"},{"key":"key2021022303363325000_ref089","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1002\/asi.5090150206","article-title":"The consistency of human judgments of relevance","volume":"15","year":"1964","journal-title":"American Documentation"},{"key":"key2021022303363325000_ref090","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1108\/00330330710724908","article-title":"Putting Google Scholar to the test: a preliminary study","volume":"41","year":"2007","journal-title":"Program"},{"key":"key2021022303363325000_ref091","doi-asserted-by":"crossref","first-page":"957","DOI":"10.1108\/14684521111193229","article-title":"Automatic performance evaluation of web search engines using judgments of metasearch engines","volume":"35","year":"2011","journal-title":"Online Information Review"},{"volume-title":"Introduction to Modern Information Retrieval","year":"1983","key":"key2021022303363325000_ref092"},{"key":"key2021022303363325000_ref093","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1108\/PROG-03-2012-0009","article-title":"Search engines and their search strategies: the effective use by Indian academics","volume":"47","year":"2013","journal-title":"Program"},{"key":"key2021022303363325000_ref094","first-page":"124","article-title":"Precision and relative recall of search engines: a comparative study of Google and Yahoo","volume":"38","year":"2009","journal-title":"Singapore Journal of Library and Information Management"},{"first-page":"138","article-title":"Evaluation of evaluation in information retrieval","year":"1995","key":"key2021022303363325000_ref095"},{"key":"key2021022303363325000_ref096","doi-asserted-by":"crossref","first-page":"2126","DOI":"10.1002\/asi.20681","article-title":"Relevance: a review of the literature and a framework for thinking on the notion in information science. Part III: behavior and effects of relevance","volume":"58","year":"2007","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"key2021022303363325000_ref097","first-page":"49","article-title":"Research on relevance in information science: a historical perspective. International perspectives on the history of information science and technology","year":"2012","journal-title":"Proceedings of the ASIS&T"},{"key":"key2021022303363325000_ref098","unstructured":"Saracevic, T. (2015), \u201cWhy is relevance still the basic notion in information science. Re: inventing information science in the networked society\u201d, Proceedings of the 14th International Symposium on Information Science (ISI 2015), pp. 26-35."},{"key":"key2021022303363325000_ref099","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1002\/(SICI)1097-4571(198805)39:3<197::AID-ASI4>3.0.CO;2-A","article-title":"A study of information seeking and retrieving. III. Searchers, searches, and overlap","volume":"39","year":"1988","journal-title":"Journal of the American Society for Information Science"},{"key":"key2021022303363325000_ref100","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1023\/A:1019679624079","article-title":"Precision evaluation of search engines","volume":"5","year":"2002","journal-title":"World Wide Web"},{"first-page":"183","article-title":"Using global statistics to rank retrieval systems without relevance judgments","year":"2010","key":"key2021022303363325000_ref101"},{"key":"key2021022303363325000_ref102","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1108\/14684520310471716","article-title":"Think local, search global? Comparing search engines for searching geographically specific information","volume":"27","year":"2003","journal-title":"Online Information Review"},{"key":"key2021022303363325000_ref103","doi-asserted-by":"crossref","first-page":"1059","DOI":"10.1016\/j.ipm.2006.09.009","article-title":"Using the structure of overlap between search results to rank retrieval systems without relevance judgments","volume":"43","year":"2007","journal-title":"Information Processing and Management"},{"key":"key2021022303363325000_ref104","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1002\/(SICI)1097-4571(199404)45:3<207::AID-ASI10>3.0.CO;2-1","article-title":"The relevance of recall and precision in user evaluation","volume":"45","year":"1994","journal-title":"Journal of the American Society for Information Science"},{"key":"key2021022303363325000_ref105","unstructured":"Su, L.T. and Chen, H.-l. (1999), \u201cEvaluation of web search engines by undergraduate students\u201d, Proceedings of the ASIS Annual Meeting, ERIC, pp. 98-114."},{"key":"key2021022303363325000_ref106","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/(SICI)1097-4571(199601)47:1<1::AID-ASI1>3.0.CO;2-3","article-title":"Some perspectives on the evaluation of information retrieval systems","volume":"47","year":"1996","journal-title":"Journal of the American Society for Information Science"},{"key":"key2021022303363325000_ref107","first-page":"221","article-title":"Evaluation of five web search engines in Arabic language","year":"2010","journal-title":"LWA"},{"key":"key2021022303363325000_ref108","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1108\/14684521111193175","article-title":"Comparative evaluation of web search engines in health information retrieval","volume":"35","year":"2011","journal-title":"Online Information Review"},{"key":"key2021022303363325000_ref109","unstructured":"The Search Engines List(2010), \u201cThe Search Engine List: the comprehensive list of search engines\u201d, available at: http:\/\/www.thesearchenginelist.com\/."},{"key":"key2021022303363325000_ref110","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1108\/00220410710827781","article-title":"A dialectical approach to information retrieval","volume":"63","year":"2007","journal-title":"Journal of Documentation"},{"volume-title":"A Dialectical Approach to Information Retrieval: Exploring a Contradiction in Terms","year":"2005","key":"key2021022303363325000_ref111"},{"first-page":"113","volume-title":"Explanation in Information Seeking and Retrieval. New Directions in Cognitive Information Retrieval","year":"2005","key":"key2021022303363325000_ref112"},{"key":"key2021022303363325000_ref113","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1108\/eb026584","article-title":"Foundation of evaluation","volume":"30","year":"1974","journal-title":"Journal of Documentation"},{"first-page":"1275","article-title":"The structure of information retrieval systems","year":"1959","key":"key2021022303363325000_ref114"},{"volume-title":"Techniques of Information Retrieval","year":"1970","key":"key2021022303363325000_ref115"},{"key":"key2021022303363325000_ref116","unstructured":"Voorhees, E.M. (2001), \u201cThe philosophy of information retrieval evaluation\u201d, Workshop of the Cross-Language Evaluation Forum for European Languages, Springer, pp. 355-370."},{"key":"key2021022303363325000_ref117","first-page":"76","article-title":"Recent trends in user studies: action research and qualitative methods","volume":"5","year":"2000","journal-title":"Information Research"},{"year":"2002","key":"key2021022303363325000_ref118","article-title":"Philosophical foundations and research relevance: issues for information research (Keynote address)"},{"key":"key2021022303363325000_ref119","doi-asserted-by":"crossref","unstructured":"Wu, S. and Crestani, F. (2003), \u201cMethods for ranking information retrieval systems without relevance judgments\u201d, Proceedings of the 2003 ACM Symposium on Applied Computing, pp. 811-816.","DOI":"10.1145\/952532.952693"},{"first-page":"303","article-title":"Effectiveness evaluation and comparison of Web search engines and meta-search engines","year":"2004","key":"key2021022303363325000_ref120"},{"issue":"1","key":"key2021022303363325000_ref121","article-title":"Evaluating the effectiveness of Web search engines on results diversification","volume":"24","year":"2019","journal-title":"Information Research: An International Electronic Journal"},{"key":"key2021022303363325000_ref122","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1108\/14684520410543652","article-title":"Online IR system evaluation: online databases versus Web search engines","volume":"28","year":"2004","journal-title":"Online Information Review"},{"key":"key2021022303363325000_ref123","doi-asserted-by":"crossref","unstructured":"Yaltaghian, B. and Chignell, M. (2002), \u201cHow good is search engine ranking? a validation study with human judges\u201d, Proceedings of the Human Factors and Ergonomics Society Annual Meeting, SAGE Publications Sage CA, Los Angeles, CA, pp. 1276-1280.","DOI":"10.1177\/154193120204601408"},{"key":"key2021022303363325000_ref124","article-title":"A dialectical approach to search engine evaluation","volume":"70","year":"2020","journal-title":"Libri - International Journal of Libraries and Information Services"},{"key":"key2021022303363325000_ref125","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1080\/10572317.2010.10762866","article-title":"Search engines' responses to several search feature selections","volume":"42","year":"2010","journal-title":"The International Information and Library Review"},{"key":"key2021022303363325000_ref126","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1108\/OIR-07-2011-0099","article-title":"A comparative analysis of the search feature effectiveness of the major English and Chinese search engines","volume":"37","year":"2013","journal-title":"Online Information Review"},{"volume-title":"Knowledge and Knowing in Library and Information Science: A Philosophical Framework","year":"2001","key":"key2021022303363325000_ref127"}],"container-title":["Library Hi Tech"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/LHT-11-2019-0229\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/LHT-11-2019-0229\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:15:29Z","timestamp":1753395329000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/lht\/article\/39\/1\/166-189\/268666"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,6]]},"references-count":127,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,3,6]]}},"alternative-id":["10.1108\/LHT-11-2019-0229"],"URL":"https:\/\/doi.org\/10.1108\/lht-11-2019-0229","relation":{},"ISSN":["0737-8831"],"issn-type":[{"type":"print","value":"0737-8831"}],"subject":[],"published":{"date-parts":[[2020,3,6]]}}}